-- Logs begin at Fri 2022-09-02 20:10:02 UTC, end at Fri 2022-09-02 21:43:33 UTC. -- Sep 02 21:00:34.115788 dv-cinder-852209-11-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Sep 02 21:00:34.123465 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 02 21:00:34.125455 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 2 21:00:34 2022] *** Sep 02 21:00:34.125455 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 02 21:00:34.125455 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 02 21:00:34.125455 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: nodename: dv-cinder-852209-11-iscsi Sep 02 21:00:34.125455 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: machine: x86_64 Sep 02 21:00:34.125455 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: clock source: unix Sep 02 21:00:34.125455 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: pcre jit disabled Sep 02 21:00:34.125980 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: detected number of CPU cores: 4 Sep 02 21:00:34.125980 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: current working directory: / Sep 02 21:00:34.125980 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: detected binary path: /usr/bin/uwsgi-core Sep 02 21:00:34.125980 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: your processes number limit is 47680 Sep 02 21:00:34.125980 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: your memory page size is 4096 bytes Sep 02 21:00:34.125980 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: detected max file descriptor number: 2048 Sep 02 21:00:34.125980 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: lock engine: pthread robust mutexes Sep 02 21:00:34.125980 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: thunder lock: enabled Sep 02 21:00:34.126904 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 02 21:00:34.127005 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 02 21:00:34.167202 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: Python main interpreter initialized at 0x5584d3f199c0 Sep 02 21:00:34.167202 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: python threads support enabled Sep 02 21:00:34.167202 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: your server socket listen backlog is limited to 100 connections Sep 02 21:00:34.167202 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: your mercy for graceful operations on workers is 90 seconds Sep 02 21:00:34.167644 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: mapped 403077 bytes (393 KB) for 2 cores Sep 02 21:00:34.167644 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: *** Operational MODE: preforking *** Sep 02 21:00:34.167940 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: *** uWSGI is running in multiple interpreter mode *** Sep 02 21:00:34.167940 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: spawned uWSGI master process (pid: 82111) Sep 02 21:00:34.168150 dv-cinder-852209-11-iscsi systemd[1]: Started Devstack devstack@keystone.service. Sep 02 21:00:34.169183 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: spawned uWSGI worker 1 (pid: 82124, cores: 1) Sep 02 21:00:34.169503 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: spawned uWSGI worker 2 (pid: 82125, cores: 1) Sep 02 21:00:34.171096 dv-cinder-852209-11-iscsi devstack@keystone.service[82111]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 02 21:00:38.539077 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 21:00:38.539077 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: from cryptography.utils import int_from_bytes Sep 02 21:00:38.540068 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 21:00:38.540068 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: from cryptography.utils import int_from_bytes Sep 02 21:00:38.542253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 21:00:38.542253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: from cryptography.utils import int_from_bytes Sep 02 21:00:38.542723 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 21:00:38.542723 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: from cryptography.utils import int_from_bytes Sep 02 21:00:38.590511 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 21:00:38.590713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 21:00:38.590881 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] command line args: [] {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 21:00:38.591151 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 21:00:38.591330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ================================================================================ {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 21:00:38.591585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] admin_token = **** {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.591833 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] config_dir = [] {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.592021 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.592205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] config_source = [] {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.592386 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] debug = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.592585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.592950 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.593131 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.593382 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.593594 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 21:00:38.593714 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.593847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 21:00:38.593962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] list_limit = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.594068 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] command line args: [] {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 21:00:38.594173 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] log_config_append = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.594268 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.594365 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 21:00:38.594474 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] log_dir = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.594580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ================================================================================ {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 21:00:38.594681 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] log_file = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.594782 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] admin_token = **** {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.594894 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.594984 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] config_dir = [] {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.595108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.595188 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.595303 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.595376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] config_source = [] {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.595495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] debug = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.595575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.595657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.595779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.595878 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.595958 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.596080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.596161 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.596282 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.596356 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.596469 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.596542 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.596686 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.596774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] list_limit = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.596900 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] log_config_append = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.596977 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.597097 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.597176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.597255 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] log_dir = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.597375 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.597453 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] log_file = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.597621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.597707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.597906 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.597994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.598162 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.598466 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.79/identity {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.598566 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.598566 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.598760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] publish_errors = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.598874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.598948 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.599071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.599158 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.599275 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.599383 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.599467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.599545 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.599668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.599795 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.599921 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] standard_threads = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.599995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.600064 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.600167 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.600330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.600420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.600497 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.600663 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.600845 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] use_journal = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.600948 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.601030 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] use_json = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.601193 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] use_stderr = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.601370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] use_syslog = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.601446 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.79/identity {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.601593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] publish_errors = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.601676 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.604073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.604254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.604369 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.604485 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.604592 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.604692 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.604806 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.604878 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.604943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.605086 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.605150 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] standard_threads = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.605207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.605207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.605307 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.605369 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.605369 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.605369 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.605369 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.605586 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.605586 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.605693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.605762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] use_journal = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.605847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.605910 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] use_json = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.605967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.606024 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] use_stderr = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.606024 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] use_syslog = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.606136 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.606201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:00:38.606270 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.606330 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.606393 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.606451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.606532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.606596 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.606659 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.606716 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.606772 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.606827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.606899 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.606959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.607016 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.607077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.607134 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.607190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.607254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.607423 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.607515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.607660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.607729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.607890 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.607967 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.608120 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.608200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.608353 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.608431 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.608600 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.608693 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.608846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.608923 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.609075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.609155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.609305 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.609390 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.609548 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.609627 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.609793 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.609901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.610055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.610139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.610304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.610381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.610536 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.610613 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.610771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.610849 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.611005 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.611081 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.611236 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.611313 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.611465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.611550 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.611695 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.611771 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.611923 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.612041 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.612147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.612213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.612390 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.612484 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.612622 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.612724 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.612860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.612948 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.613090 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.613174 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.613341 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.613472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.613609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.613692 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.613791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.613901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.614095 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.614170 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.614300 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.614377 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.614489 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.614620 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.614724 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.614803 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.614957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.615048 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.615190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.615308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.615416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.615493 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.615648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.616235 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.616443 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.616573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.616696 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.616910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.616988 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.617170 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.617252 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.617408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.617537 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.617650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.617729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.617909 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.617987 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.618133 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.618214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.618371 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.618452 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.618612 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.618703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.618854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.618933 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.619095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.619173 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.619351 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.619477 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.619562 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.619633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.619791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.619869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.620025 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.620105 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.620272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.620356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.620507 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.620585 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.620743 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.620823 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.620994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.621080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.621205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.621284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.621450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.621529 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.621687 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.621765 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.621949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.622029 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.622192 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.622277 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.622405 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.622492 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.622639 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.622717 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.622900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.622988 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.623139 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.623217 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.623384 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.623468 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.623621 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.623707 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.623861 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.623992 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.624097 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.624173 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.624322 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.624414 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.624556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.624635 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.624789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.624868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.625019 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.625106 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.625248 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.625326 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.625476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.625553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.625710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.625858 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.625965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.626045 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.626205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.626283 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.626437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.626531 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.626683 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.626761 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.626918 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.626996 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.627180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.627267 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.627420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.627498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.627667 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.627744 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.627898 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] auth.external = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.627988 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.628127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.628206 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.628364 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.628441 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.628602 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.628688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.628838 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.628916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] auth.password = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.629073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.629151 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] auth.token = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.629310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.629398 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.629541 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.629634 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.629784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.629879 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.630040 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.630119 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.630287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.630383 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.630528 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.630607 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.630758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.630836 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.630994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] credential.caching = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.631081 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.631242 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.631329 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.632207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.632379 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] auth.external = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.632379 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.632566 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.632646 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.632718 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.632860 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.632940 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.633099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] auth.password = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.633191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.633337 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] auth.token = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.633417 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.633585 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.633664 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.633842 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.633966 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.634100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.634187 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.634421 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.634509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.634682 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.634771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.634936 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.635016 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.635175 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.635253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.635416 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] credential.caching = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.635573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.635649 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] federation.caching = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.635720 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.635879 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.635958 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.636125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.636213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.636371 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.636450 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.636602 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.636682 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.636850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.636938 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.637095 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.637182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.637347 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.637426 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.637584 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.637666 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.637884 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.637976 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.638099 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.638178 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.638348 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.638438 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.638584 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] identity.caching = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.638666 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.638831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.638911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.639077 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.639158 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.639311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.639397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] federation.caching = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.639545 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.639624 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.639790 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.639872 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.640023 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.640102 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.640262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.640363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.640516 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.640604 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.640755 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.640835 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.640982 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.641060 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.641213 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.641294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.641441 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.641521 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.641682 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.641769 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.641952 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.642035 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.642199 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.642326 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] identity.caching = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.642448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.642535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.642691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.642771 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.642930 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.643009 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.643173 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.643252 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.643406 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.643485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.643637 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.643716 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.643875 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.643976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.644098 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.644192 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.644330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.644410 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.644569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.644648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.644806 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.644894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.645038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.645117 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.645289 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.645368 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.645535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.645614 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.645781 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.645890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.646039 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.646121 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.646283 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.646370 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.646529 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.646598 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.646759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.646847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.647051 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.647139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.647306 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.647386 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.647621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.647712 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.647775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.647833 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.647994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.648076 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.648229 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.648318 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.648466 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.648546 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.648715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.648794 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.648952 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.649088 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.649204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.649403 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.649482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.649641 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.649720 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.649918 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.650016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.650171 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.650251 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.650405 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.650484 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.650641 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.650720 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.650882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.651028 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.651105 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.user = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.651177 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.651326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.651408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.651570 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.651648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.651806 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.651885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.652046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.652132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.652291 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.652369 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.652536 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.652615 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.652770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.652850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.652997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.653077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.653234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.653375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.653462 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.653632 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.653711 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.653901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.653983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.654149 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.654241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.654395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.654476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.654636 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.user = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.654715 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.654879 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.654966 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.655126 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.655206 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.655358 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.655438 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.655606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.655694 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.655844 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.655924 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.656080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.656159 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.656316 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.656403 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.656551 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.656629 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.656832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.656924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.657045 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.657125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.657288 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.657369 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.657525 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.657605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.657894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.658002 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.658079 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.658151 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.658294 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.658373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.658531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.658689 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.658765 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.658837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.659001 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.659082 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.659242 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.659331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.659474 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.659558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.659712 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.659792 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.659952 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.660040 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] resource.caching = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.660195 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.660275 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.660440 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.660519 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.660678 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.660767 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.660925 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.661004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.661173 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.661252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.661409 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.661497 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.661654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.661735 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.661919 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.662001 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.662161 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.662242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.662397 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] role.caching = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.662477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.662695 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.662780 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] role.driver = sql {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.662978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.663061 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.663175 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.663255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.663420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.663500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.663671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] resource.caching = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.663753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.663927 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.664007 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.664174 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.664252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.664417 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.664498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.664663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.664751 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.664909 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.664989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.665143 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.665224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.665390 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.665475 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.665634 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.665714 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.665908 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.665994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.666152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] role.caching = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.666232 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.666407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] role.driver = sql {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.666624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.666714 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.666872 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.666952 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.667128 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.667212 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.667381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.667470 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.667631 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.667711 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.667884 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.667965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.668121 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.668208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.668376 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.668456 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.668628 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.668706 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.668867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.668955 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.669097 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.669175 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.669330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.669409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.669667 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.669764 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.669907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.669972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.670084 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.670272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.670366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.670518 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.670598 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.670773 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.670853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.671001 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.671093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.671236 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] token.caching = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.671320 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.671474 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.671553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.671721 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.671810 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.671958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.672038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.672213 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.672293 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.672460 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.672548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.672696 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.672775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.672934 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.673014 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.673174 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.673264 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.673419 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.673498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.673687 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.673766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.673951 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.674047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.674189 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.674269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.674435 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.674515 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.674702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.674789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.674929 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.675017 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] token.caching = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.675173 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.675255 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.675429 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.675522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.675671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.675754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] database.connection = **** {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.675919 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.675997 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.676164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.676244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.676402 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.676491 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.676643 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.676723 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.676884 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.676964 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.677121 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.677202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.677359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.677450 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.677593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.677673 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.677847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.677976 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.678104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.678183 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.678917 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.678999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.679157 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.679291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.679401 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.679485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.679814 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.679909 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.679984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.680056 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] database.connection = **** {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.680170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.680253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.680411 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.680491 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.680648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.680728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.680809 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 21:00:38.680924 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.681168 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.681412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.681657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.681931 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.682183 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.682427 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.682677 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.682920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.683173 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.683416 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.683668 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.683904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.684149 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.684389 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:00:38.684566 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 21:00:38.711274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:38.711505 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:38.711775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:38.714231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:38.714468 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:38.714700 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:38.720339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:38.723195 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:38.749420 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:38.749646 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:38.750908 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:38.751149 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:38.804330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:38.805471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:38.869865 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:38.870094 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:38.870582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:38.870826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.039883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.040127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.040341 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.040568 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.040784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.040973 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.041186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.041281 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.041428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.041652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.041897 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.042118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.065897 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.066085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.066318 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.066563 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.066785 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.067006 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.067225 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.070669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.070902 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.071126 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.071347 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.071564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.071779 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.071991 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.087325 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.089060 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.100297 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.100533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.100767 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.101041 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.101137 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.101264 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.101360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.101485 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.101570 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.101727 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.101840 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.102162 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.102264 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.102474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 02 21:00:39.119024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.119233 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 02 21:00:39.119582 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.119788 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 02 21:00:39.120047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.120134 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.120285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 02 21:00:39.120370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.120575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.120660 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.120839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.120922 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 02 21:00:39.121115 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.121382 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.121649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.121948 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.130668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.130902 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.131183 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.132089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.132757 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.133043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.133322 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.133621 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.139148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.140903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.142116 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.142377 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.142668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.142960 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.143255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.143528 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.143806 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.143962 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.144086 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.144254 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.144364 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.144543 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.144691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.144832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.144968 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.145125 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.145394 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.145669 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.145983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.146262 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.146547 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.146901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.168265 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.169739 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.170055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.171109 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.172600 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.172892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.174772 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.175066 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.175356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.177742 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.178055 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.178972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.182584 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.182881 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.185830 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.186127 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.188667 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.188970 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.189261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.189548 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.189853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.190147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.190422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.190701 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.192045 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.192353 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.192655 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.193078 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.193369 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.193653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.194534 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.195013 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.207184 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.207479 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.211723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.211849 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.212060 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.215063 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.215369 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.215954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.219262 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.219564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.219653 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.222936 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.223758 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.226374 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.226677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.227280 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.227280 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.227522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.227615 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.227826 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.230847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.231156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.231452 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.231745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.232029 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.232314 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.244343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.244650 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.244928 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.245198 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.249101 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.249392 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.249669 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.249965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.252127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.253691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.255261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.255547 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.257923 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.258826 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.259161 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.259475 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.259565 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.259805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.260242 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.261051 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.261335 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.263995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.264284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.264606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.264900 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.265295 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.271604 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.271905 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.272281 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.273073 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.273073 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.273393 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.273691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.277116 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.277413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.277704 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.278026 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.278417 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.278705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.279057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.289543 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.292556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.295296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.295501 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.296979 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.298406 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.298759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.299048 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.301758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.301994 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.302799 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.305395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.305683 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.306127 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.307339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.308844 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.311788 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.312198 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.312492 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.312782 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.313156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.314722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.317675 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.318059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.318356 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.318641 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.321634 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.321975 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.322285 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.327915 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.329146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.329146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.329469 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.329604 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.329838 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.330135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.330419 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.330702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.331023 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.331311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.331591 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.331883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.332176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.332457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.332731 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.332998 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.336846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 02 21:00:39.337347 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.337848 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.338346 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.338818 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.339292 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.339761 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.340230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.340696 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.341200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.341674 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.342221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.342688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.343182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 02 21:00:39.369890 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5584d3f199c0 pid: 82124 (default app) Sep 02 21:00:39.373340 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa174a8c-f7e9-4f21-90d4-39332f22157d None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:39.373633 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa174a8c-f7e9-4f21-90d4-39332f22157d None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:39.373969 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa174a8c-f7e9-4f21-90d4-39332f22157d None None] PATH_INFO: `/v3` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:39.378116 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 791 bytes} [Fri Sep 2 21:00:39 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:39.380785 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5584d3f199c0 pid: 82125 (default app) Sep 02 21:00:47.591348 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9908687-9b62-4b3a-983b-7e2db70089ee None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:47.591993 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9908687-9b62-4b3a-983b-7e2db70089ee None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:47.591993 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9908687-9b62-4b3a-983b-7e2db70089ee None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:47.593235 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 2/2] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:00:47.601132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05640ff1-c7ee-4d78-8ce3-8b1d21a3c923 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:47.601770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05640ff1-c7ee-4d78-8ce3-8b1d21a3c923 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:47.601967 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05640ff1-c7ee-4d78-8ce3-8b1d21a3c923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:47.674184 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: INFO dbcounter [None req-05640ff1-c7ee-4d78-8ce3-8b1d21a3c923 None None] Registered counter for database keystone Sep 02 21:00:47.696897 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG oslo_db.sqlalchemy.engines [None req-05640ff1-c7ee-4d78-8ce3-8b1d21a3c923 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:00:47.703265 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writer thread running {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:00:47.887239 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG passlib.handlers.bcrypt [None req-05640ff1-c7ee-4d78-8ce3-8b1d21a3c923 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82125) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 02 21:00:47.887546 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG passlib.handlers.bcrypt [None req-05640ff1-c7ee-4d78-8ce3-8b1d21a3c923 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82125) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 02 21:00:47.946797 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-05640ff1-c7ee-4d78-8ce3-8b1d21a3c923 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:47.948414 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-05640ff1-c7ee-4d78-8ce3-8b1d21a3c923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:48.080966 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1/3] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 02 21:00:48.599504 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9908687-9b62-4b3a-983b-7e2db70089ee None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:48.668538 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: INFO dbcounter [None req-e9908687-9b62-4b3a-983b-7e2db70089ee None None] Registered counter for database keystone Sep 02 21:00:48.758556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG oslo_db.sqlalchemy.engines [None req-e9908687-9b62-4b3a-983b-7e2db70089ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:00:48.758556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writer thread running {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:00:48.817187 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9908687-9b62-4b3a-983b-7e2db70089ee None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:48.822758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e256da-ee09-4af0-a5b8-7de75bd83067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:48.823406 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e256da-ee09-4af0-a5b8-7de75bd83067 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:48.823683 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e256da-ee09-4af0-a5b8-7de75bd83067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:48.823954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e256da-ee09-4af0-a5b8-7de75bd83067 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:48.832864 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e256da-ee09-4af0-a5b8-7de75bd83067 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:48.887169 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: WARNING keystone.common.rbac_enforcer.enforcer [None req-27e256da-ee09-4af0-a5b8-7de75bd83067 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 02 21:00:48.887488 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e256da-ee09-4af0-a5b8-7de75bd83067 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:48.898077 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 3/4] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Sep 2 21:00:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:00:48.904331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05640ff1-c7ee-4d78-8ce3-8b1d21a3c923 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:48.919640 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05640ff1-c7ee-4d78-8ce3-8b1d21a3c923 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:48.924031 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21c03e-d539-4bd2-b053-496936ab4cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:48.925163 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21c03e-d539-4bd2-b053-496936ab4cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:48.925445 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21c03e-d539-4bd2-b053-496936ab4cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:48.925719 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21c03e-d539-4bd2-b053-496936ab4cd8 admin admin] PATH_INFO: `/v3/projects/c04c8d4bc7dc450a92b56e01849b9dc9` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:48.927280 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21c03e-d539-4bd2-b053-496936ab4cd8 admin admin] RBAC: Authorizing `identity:get_project(project_id=c04c8d4bc7dc450a92b56e01849b9dc9)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:48.980714 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ea21c03e-d539-4bd2-b053-496936ab4cd8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 02 21:00:48.981058 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21c03e-d539-4bd2-b053-496936ab4cd8 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:48.985670 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 2/5] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Sep 2 21:00:48 2022] GET /identity/v3/projects/c04c8d4bc7dc450a92b56e01849b9dc9 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:50.912596 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77578cd9-d2ea-407d-8fd2-9e92057ba22d None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:50.913149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77578cd9-d2ea-407d-8fd2-9e92057ba22d None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:50.913249 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77578cd9-d2ea-407d-8fd2-9e92057ba22d None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:50.917401 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 4/6] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:00:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:50.923127 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53469d-8cda-4dcd-ab8f-d704f8e93fad None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:50.923575 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53469d-8cda-4dcd-ab8f-d704f8e93fad None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:50.923684 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53469d-8cda-4dcd-ab8f-d704f8e93fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:50.943647 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-ee53469d-8cda-4dcd-ab8f-d704f8e93fad None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:50.945908 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ee53469d-8cda-4dcd-ab8f-d704f8e93fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:50.953944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 3/7] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 02 21:00:51.233125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77578cd9-d2ea-407d-8fd2-9e92057ba22d None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:51.246060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77578cd9-d2ea-407d-8fd2-9e92057ba22d None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:51.250239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0440038-a39f-4818-83e6-d8eed83f5118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:51.250839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0440038-a39f-4818-83e6-d8eed83f5118 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:51.251144 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0440038-a39f-4818-83e6-d8eed83f5118 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:51.251417 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0440038-a39f-4818-83e6-d8eed83f5118 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:51.259810 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0440038-a39f-4818-83e6-d8eed83f5118 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:51.261568 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0440038-a39f-4818-83e6-d8eed83f5118 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:51.270254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 5/8] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Sep 2 21:00:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:00:51.276068 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53469d-8cda-4dcd-ab8f-d704f8e93fad None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:51.285157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53469d-8cda-4dcd-ab8f-d704f8e93fad None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:51.289629 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3dabb-51fa-4825-8fd6-6d41592805b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:51.290299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3dabb-51fa-4825-8fd6-6d41592805b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:51.290588 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3dabb-51fa-4825-8fd6-6d41592805b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:51.290868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3dabb-51fa-4825-8fd6-6d41592805b2 admin admin] PATH_INFO: `/v3/users/ce385e879bed47f191e967e0c64d0d17` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:51.292190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3dabb-51fa-4825-8fd6-6d41592805b2 admin admin] RBAC: Authorizing `identity:get_user(user_id=ce385e879bed47f191e967e0c64d0d17)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:51.294065 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3dabb-51fa-4825-8fd6-6d41592805b2 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:51.295582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 4/9] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Sep 2 21:00:51 2022] GET /identity/v3/users/ce385e879bed47f191e967e0c64d0d17 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:53.335766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378dae4-dfa1-448d-8574-7950bb959da5 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:53.336328 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378dae4-dfa1-448d-8574-7950bb959da5 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:53.336766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378dae4-dfa1-448d-8574-7950bb959da5 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:53.338385 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 6/10] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:00:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:53.343626 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31967cd3-9402-4d77-933a-70875fa9fc8e None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:53.344101 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31967cd3-9402-4d77-933a-70875fa9fc8e None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:53.344195 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31967cd3-9402-4d77-933a-70875fa9fc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:53.348739 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760e597-46ff-4316-89ce-6d8f01054212 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:53.349024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760e597-46ff-4316-89ce-6d8f01054212 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:53.349300 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760e597-46ff-4316-89ce-6d8f01054212 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:53.351779 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 7/11] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:00:53.356633 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f6a24-30f2-4fe8-9551-316bb040ee95 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:53.356915 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f6a24-30f2-4fe8-9551-316bb040ee95 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:53.357194 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f6a24-30f2-4fe8-9551-316bb040ee95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:53.363303 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-31967cd3-9402-4d77-933a-70875fa9fc8e None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:53.364466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-31967cd3-9402-4d77-933a-70875fa9fc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:53.399784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG passlib.handlers.bcrypt [None req-683f6a24-30f2-4fe8-9551-316bb040ee95 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82124) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 02 21:00:53.400185 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG passlib.handlers.bcrypt [None req-683f6a24-30f2-4fe8-9551-316bb040ee95 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82124) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 02 21:00:53.446137 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 5/12] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:53.449239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-683f6a24-30f2-4fe8-9551-316bb040ee95 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:53.450860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-683f6a24-30f2-4fe8-9551-316bb040ee95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:53.555226 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 8/13] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:00:53.712571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31967cd3-9402-4d77-933a-70875fa9fc8e None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:53.737066 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:53.823027 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31967cd3-9402-4d77-933a-70875fa9fc8e None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:53.847075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f6a24-30f2-4fe8-9551-316bb040ee95 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:53.860705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de23e1-4a47-4f7a-82c1-29fdecf0e199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:53.861347 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de23e1-4a47-4f7a-82c1-29fdecf0e199 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:53.861637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de23e1-4a47-4f7a-82c1-29fdecf0e199 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:53.861936 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de23e1-4a47-4f7a-82c1-29fdecf0e199 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:53.874025 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de23e1-4a47-4f7a-82c1-29fdecf0e199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:53.883252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-e9de23e1-4a47-4f7a-82c1-29fdecf0e199 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:00:53.883252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:53.883252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:53.883252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:53.883252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:53.883252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:53.883252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:53.883252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:53.883252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:53.883252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:53.883252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:53.883252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:53.883252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:53.883252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:53.883252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:53.883252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:53.884373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:53.884373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:53.884373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:53.884373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:53.884373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:53.884373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:53.884373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:53.884373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:53.884373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:53.884373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:53.884373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:53.884373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:53.884373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:53.884373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:53.884373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:53.884373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:53.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:53.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:53.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:53.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:53.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:53.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:53.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:53.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:53.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:53.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:53.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:00:53.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:00:53.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 6/14] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:00:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:53.890194 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de23e1-4a47-4f7a-82c1-29fdecf0e199 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:53.950314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f6a24-30f2-4fe8-9551-316bb040ee95 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:53.952846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:53.972387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:53.988644 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06083d6-2f3c-408a-b35e-a0db00eb18ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:53.989602 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06083d6-2f3c-408a-b35e-a0db00eb18ca None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:53.989926 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06083d6-2f3c-408a-b35e-a0db00eb18ca None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:53.990208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06083d6-2f3c-408a-b35e-a0db00eb18ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:53.990702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de23e1-4a47-4f7a-82c1-29fdecf0e199 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:54.024816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a18b95-522b-4775-8b08-a6061ec588a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:54.025422 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a18b95-522b-4775-8b08-a6061ec588a3 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:54.025709 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a18b95-522b-4775-8b08-a6061ec588a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:54.026018 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a18b95-522b-4775-8b08-a6061ec588a3 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:54.026696 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a18b95-522b-4775-8b08-a6061ec588a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:54.027000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a18b95-522b-4775-8b08-a6061ec588a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:54.028404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a18b95-522b-4775-8b08-a6061ec588a3 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:54.041308 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 7/15] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:00:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:00:54.046968 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a18b95-522b-4775-8b08-a6061ec588a3 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:54.060907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06083d6-2f3c-408a-b35e-a0db00eb18ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:54.062488 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06083d6-2f3c-408a-b35e-a0db00eb18ca None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:54.146894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a18b95-522b-4775-8b08-a6061ec588a3 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:54.162848 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 9/16] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:00:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:00:54.168766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06083d6-2f3c-408a-b35e-a0db00eb18ca None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:54.171522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:54.182903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b59ab-0b4c-4002-bb60-365ee2c164fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:54.183541 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b59ab-0b4c-4002-bb60-365ee2c164fa None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:54.183823 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b59ab-0b4c-4002-bb60-365ee2c164fa None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:54.184098 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b59ab-0b4c-4002-bb60-365ee2c164fa None admin] PATH_INFO: `/v3/users/ce385e879bed47f191e967e0c64d0d17` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:54.187682 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b59ab-0b4c-4002-bb60-365ee2c164fa None admin] RBAC: Authorizing `identity:get_user(user_id=ce385e879bed47f191e967e0c64d0d17)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:54.187682 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b59ab-0b4c-4002-bb60-365ee2c164fa None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:54.188239 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 8/17] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:00:54 2022] GET /identity/v3/users/ce385e879bed47f191e967e0c64d0d17 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:00:54.193655 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b59ab-0b4c-4002-bb60-365ee2c164fa None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:54.209188 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:54.271637 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06083d6-2f3c-408a-b35e-a0db00eb18ca None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:54.294849 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b59ab-0b4c-4002-bb60-365ee2c164fa None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:54.306655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75be69-3f79-4d6a-8742-fc76c0c582e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:54.307552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75be69-3f79-4d6a-8742-fc76c0c582e4 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:54.307836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75be69-3f79-4d6a-8742-fc76c0c582e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:54.308117 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75be69-3f79-4d6a-8742-fc76c0c582e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:54.327292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75be69-3f79-4d6a-8742-fc76c0c582e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:54.328765 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75be69-3f79-4d6a-8742-fc76c0c582e4 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:54.331981 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca496633-7088-4f1f-a909-03e9fae39324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:54.332611 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca496633-7088-4f1f-a909-03e9fae39324 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:54.332894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca496633-7088-4f1f-a909-03e9fae39324 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:54.333165 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca496633-7088-4f1f-a909-03e9fae39324 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:54.334298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca496633-7088-4f1f-a909-03e9fae39324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:54.336565 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca496633-7088-4f1f-a909-03e9fae39324 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:54.338139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 9/18] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:00:54.344117 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca496633-7088-4f1f-a909-03e9fae39324 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:54.347697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-fb75be69-3f79-4d6a-8742-fc76c0c582e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:54.347697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:54.347697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:54.347697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:54.347697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:54.347697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:54.347697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:54.347697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:54.347697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:54.347697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:54.347697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:54.347697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:54.347697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:54.347697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:54.347697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:54.347697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:54.348871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:54.348871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:54.348871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:54.348871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:54.348871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:54.348871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:54.348871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:54.348871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:54.348871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:54.348871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:54.348871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:54.348871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:54.348871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:54.348871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:54.348871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:54.348871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:54.348871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:54.349651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:54.349651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:54.349651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:00:54.349651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 10/19] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:00:54.354696 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75be69-3f79-4d6a-8742-fc76c0c582e4 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:54.414285 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:54.426825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:54.446022 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca496633-7088-4f1f-a909-03e9fae39324 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:54.462974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75be69-3f79-4d6a-8742-fc76c0c582e4 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:54.481029 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f815f9-8588-4169-9bbb-64f862fa5786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:54.481646 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f815f9-8588-4169-9bbb-64f862fa5786 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:54.481953 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f815f9-8588-4169-9bbb-64f862fa5786 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:54.482233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f815f9-8588-4169-9bbb-64f862fa5786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:54.483018 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f815f9-8588-4169-9bbb-64f862fa5786 None admin] RBAC: Adding query filter params (role.id=32e6a7f83b444d1ca9e5891a2b175f9a, scope.domain.id=default, user.id=ce385e879bed47f191e967e0c64d0d17) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:54.483333 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f815f9-8588-4169-9bbb-64f862fa5786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:54.484773 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f815f9-8588-4169-9bbb-64f862fa5786 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:54.492665 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 10/20] 10.222.0.79 () {56 vars in 1322 bytes} [Fri Sep 2 21:00:54 2022] GET /identity/v3/role_assignments?user.id=ce385e879bed47f191e967e0c64d0d17&scope.domain.id=default&role.id=32e6a7f83b444d1ca9e5891a2b175f9a => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:00:54.497737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a0641-3756-4d1e-8724-90bc650bbf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:54.498398 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a0641-3756-4d1e-8724-90bc650bbf6f None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:54.498683 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a0641-3756-4d1e-8724-90bc650bbf6f None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:54.498960 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a0641-3756-4d1e-8724-90bc650bbf6f None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:54.499648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a0641-3756-4d1e-8724-90bc650bbf6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:54.499958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a0641-3756-4d1e-8724-90bc650bbf6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:54.501403 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a0641-3756-4d1e-8724-90bc650bbf6f None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:54.521347 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 11/21] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:00:56.701269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d712a-b9ce-4bad-9e3c-9be4116b8d8f None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:56.701744 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d712a-b9ce-4bad-9e3c-9be4116b8d8f None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:56.701837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d712a-b9ce-4bad-9e3c-9be4116b8d8f None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:56.703165 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 11/22] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:56.716445 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8f229-7ffc-4271-b133-5db00a2f7f5f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:56.716951 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8f229-7ffc-4271-b133-5db00a2f7f5f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:56.717032 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8f229-7ffc-4271-b133-5db00a2f7f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:56.743680 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-fab8f229-7ffc-4271-b133-5db00a2f7f5f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:56.744886 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-fab8f229-7ffc-4271-b133-5db00a2f7f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:56.798008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49424a8c-2bf3-44cd-8a79-890617eb4292 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:56.798632 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49424a8c-2bf3-44cd-8a79-890617eb4292 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:56.799127 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49424a8c-2bf3-44cd-8a79-890617eb4292 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:56.800949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 12/23] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:00:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:56.809623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891aac2-e9aa-485d-a74f-300f2fc1f41b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:56.810342 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891aac2-e9aa-485d-a74f-300f2fc1f41b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:56.810853 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891aac2-e9aa-485d-a74f-300f2fc1f41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:56.842288 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 12/24] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:56.846817 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-f891aac2-e9aa-485d-a74f-300f2fc1f41b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:56.848304 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f891aac2-e9aa-485d-a74f-300f2fc1f41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:56.862828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806bd69-b39a-48e2-9ea6-722e337a68fd None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:56.862828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806bd69-b39a-48e2-9ea6-722e337a68fd None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:56.862828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806bd69-b39a-48e2-9ea6-722e337a68fd None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:56.863154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 13/25] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:00:56.870444 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b91c28-07df-43a6-894d-d8f5d5f5a908 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:56.870731 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b91c28-07df-43a6-894d-d8f5d5f5a908 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:56.871006 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b91c28-07df-43a6-894d-d8f5d5f5a908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:56.909567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-d6b91c28-07df-43a6-894d-d8f5d5f5a908 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:56.910799 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d6b91c28-07df-43a6-894d-d8f5d5f5a908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:57.021681 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:57.023415 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 13/26] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:57.060865 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 14/27] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:57.345792 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891aac2-e9aa-485d-a74f-300f2fc1f41b None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:57.452309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:57.482570 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891aac2-e9aa-485d-a74f-300f2fc1f41b None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:57.503088 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1125607-83a3-4e21-902e-94774b7460a7 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:57.503389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1125607-83a3-4e21-902e-94774b7460a7 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:57.503651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1125607-83a3-4e21-902e-94774b7460a7 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:57.505163 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 15/28] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:00:57.509918 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f4ef4-0d0e-4d95-b4fa-7933c29a7a0e None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:57.510203 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f4ef4-0d0e-4d95-b4fa-7933c29a7a0e None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:57.510478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f4ef4-0d0e-4d95-b4fa-7933c29a7a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:57.535905 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-9b1f4ef4-0d0e-4d95-b4fa-7933c29a7a0e None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:57.537111 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-9b1f4ef4-0d0e-4d95-b4fa-7933c29a7a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:57.560321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b715dd6-c3f1-4cd1-908d-1ea31ce62fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:57.561006 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b715dd6-c3f1-4cd1-908d-1ea31ce62fcd None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:57.561288 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b715dd6-c3f1-4cd1-908d-1ea31ce62fcd None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:57.561560 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b715dd6-c3f1-4cd1-908d-1ea31ce62fcd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:57.576278 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b715dd6-c3f1-4cd1-908d-1ea31ce62fcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:00:57.582933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-1b715dd6-c3f1-4cd1-908d-1ea31ce62fcd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:00:57.582933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:57.582933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:57.582933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:57.582933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:57.582933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:57.582933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:57.582933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:57.582933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:57.582933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:57.582933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:57.582933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:57.582933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:00:57.582933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:00:57.582933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:00:57.582933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:00:57.583980 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:00:57.583980 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:00:57.583980 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:00:57.583980 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:00:57.583980 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:57.583980 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:57.583980 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:57.583980 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:57.583980 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:57.583980 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:57.583980 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:57.583980 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:57.583980 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:57.583980 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:57.583980 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:57.583980 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:57.585557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:57.585557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:57.585557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:57.585557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:57.585557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:00:57.585557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:00:57.585557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:00:57.585557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:00:57.585557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:00:57.585557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:00:57.585557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:00:57.585557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:00:57.585557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 14/29] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:00:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:57.585557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b715dd6-c3f1-4cd1-908d-1ea31ce62fcd None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:57.649153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 16/30] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:00:57.650478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f4ef4-0d0e-4d95-b4fa-7933c29a7a0e None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:57.773338 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f4ef4-0d0e-4d95-b4fa-7933c29a7a0e None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:57.782504 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:57.791475 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b715dd6-c3f1-4cd1-908d-1ea31ce62fcd None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:57.817257 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e6b6a-c343-4b43-a822-92cd1b17fadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:57.817948 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e6b6a-c343-4b43-a822-92cd1b17fadb None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:57.818366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e6b6a-c343-4b43-a822-92cd1b17fadb None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:57.818647 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e6b6a-c343-4b43-a822-92cd1b17fadb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:57.831484 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e6b6a-c343-4b43-a822-92cd1b17fadb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:57.833394 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e6b6a-c343-4b43-a822-92cd1b17fadb None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:57.852946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-6f4e6b6a-c343-4b43-a822-92cd1b17fadb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:57.852946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:00:57.852946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:00:57.852946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:00:57.852946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:00:57.852946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:00:57.852946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:00:57.852946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:00:57.852946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:00:57.852946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:00:57.852946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:00:57.852946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:00:57.852946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:00:57.852946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:00:57.852946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:00:57.852946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:00:57.856754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:00:57.856754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:00:57.856754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:00:57.856754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:00:57.856754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:00:57.856754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:00:57.856754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:00:57.856754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:00:57.856754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:00:57.856754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:00:57.856754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:00:57.856754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:00:57.856754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:00:57.856754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:00:57.856754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:00:57.856754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:00:57.856754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:00:57.857532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:00:57.857532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:00:57.857532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:00:57.857532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 17/31] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:00:57.857532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e6b6a-c343-4b43-a822-92cd1b17fadb None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:57.883906 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9022e92-d654-4a58-9289-c871e95f539c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:57.885103 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9022e92-d654-4a58-9289-c871e95f539c None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:57.886368 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9022e92-d654-4a58-9289-c871e95f539c None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:57.886995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9022e92-d654-4a58-9289-c871e95f539c None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:57.888981 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9022e92-d654-4a58-9289-c871e95f539c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:57.890800 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9022e92-d654-4a58-9289-c871e95f539c None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:57.906573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:57.999068 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e6b6a-c343-4b43-a822-92cd1b17fadb None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:58.038695 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f454d-b090-4017-804f-d26286100767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:58.039306 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f454d-b090-4017-804f-d26286100767 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:58.039584 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f454d-b090-4017-804f-d26286100767 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:58.039856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f454d-b090-4017-804f-d26286100767 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:58.040570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f454d-b090-4017-804f-d26286100767 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:58.040906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f454d-b090-4017-804f-d26286100767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:58.042322 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f454d-b090-4017-804f-d26286100767 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:58.064041 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 18/32] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:00:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:58.065273 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f454d-b090-4017-804f-d26286100767 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:58.095540 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:58.186185 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f454d-b090-4017-804f-d26286100767 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:58.202122 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 15/33] 10.222.0.79 () {60 vars in 1131 bytes} [Fri Sep 2 21:00:57 2022] POST /identity/v3/roles => generated 219 bytes in 614 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:00:58.203569 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9022e92-d654-4a58-9289-c871e95f539c None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:58.229501 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66854d-79a7-4208-b878-fdd8ffce668e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:58.230512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66854d-79a7-4208-b878-fdd8ffce668e None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:58.230971 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66854d-79a7-4208-b878-fdd8ffce668e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:58.231421 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66854d-79a7-4208-b878-fdd8ffce668e None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:58.232257 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66854d-79a7-4208-b878-fdd8ffce668e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:00:58.233461 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66854d-79a7-4208-b878-fdd8ffce668e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:58.235698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66854d-79a7-4208-b878-fdd8ffce668e None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:58.251277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 19/34] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:58.252412 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66854d-79a7-4208-b878-fdd8ffce668e None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:58.362473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9022e92-d654-4a58-9289-c871e95f539c None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:58.374979 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:58.405418 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66854d-79a7-4208-b878-fdd8ffce668e None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:58.417544 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f655d-8f7d-4f36-95fc-33418098b423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:58.418210 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f655d-8f7d-4f36-95fc-33418098b423 None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:58.418509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f655d-8f7d-4f36-95fc-33418098b423 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:58.418786 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f655d-8f7d-4f36-95fc-33418098b423 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:58.419475 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f655d-8f7d-4f36-95fc-33418098b423 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:58.421021 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f655d-8f7d-4f36-95fc-33418098b423 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:58.444288 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8c3fd-3490-4174-9977-6b4904309a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:58.444761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8c3fd-3490-4174-9977-6b4904309a97 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:58.445050 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8c3fd-3490-4174-9977-6b4904309a97 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:58.445331 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8c3fd-3490-4174-9977-6b4904309a97 None admin] PATH_INFO: `/v3/users/ce385e879bed47f191e967e0c64d0d17` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:58.446902 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8c3fd-3490-4174-9977-6b4904309a97 None admin] RBAC: Authorizing `identity:get_user(user_id=ce385e879bed47f191e967e0c64d0d17)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:58.448374 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8c3fd-3490-4174-9977-6b4904309a97 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:58.450036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 20/35] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:00:58 2022] GET /identity/v3/users/ce385e879bed47f191e967e0c64d0d17 => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:58.451740 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe10ef-7b90-411c-8e18-00cb7c64faa8 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:58.451740 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe10ef-7b90-411c-8e18-00cb7c64faa8 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:58.451740 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe10ef-7b90-411c-8e18-00cb7c64faa8 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:58.455310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 21/36] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:00:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:58.455310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe10ef-7b90-411c-8e18-00cb7c64faa8 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:58.498429 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 16/37] 10.222.0.79 () {60 vars in 1131 bytes} [Fri Sep 2 21:00:58 2022] POST /identity/v3/roles => generated 225 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:00:58.501326 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f655d-8f7d-4f36-95fc-33418098b423 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:58.580723 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:58.603787 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe10ef-7b90-411c-8e18-00cb7c64faa8 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:58.647211 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22785a5b-ca06-4d9b-8431-6856b93d0090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:58.648148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22785a5b-ca06-4d9b-8431-6856b93d0090 None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:58.654602 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22785a5b-ca06-4d9b-8431-6856b93d0090 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:58.654731 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f655d-8f7d-4f36-95fc-33418098b423 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:58.654806 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22785a5b-ca06-4d9b-8431-6856b93d0090 None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:58.654806 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22785a5b-ca06-4d9b-8431-6856b93d0090 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:58.654806 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22785a5b-ca06-4d9b-8431-6856b93d0090 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:58.690549 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3212e-80eb-4900-9b3a-62d646ed27c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:58.694951 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3212e-80eb-4900-9b3a-62d646ed27c0 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:58.694951 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3212e-80eb-4900-9b3a-62d646ed27c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:58.694951 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3212e-80eb-4900-9b3a-62d646ed27c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:58.694951 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3212e-80eb-4900-9b3a-62d646ed27c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:58.695875 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3212e-80eb-4900-9b3a-62d646ed27c0 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:58.698058 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 17/38] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:00:58.698473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a273d6-4acf-42b3-ab40-377de1f774d7 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:58.698768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a273d6-4acf-42b3-ab40-377de1f774d7 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:58.699053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a273d6-4acf-42b3-ab40-377de1f774d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:58.719358 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-f6a273d6-4acf-42b3-ab40-377de1f774d7 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:58.726412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f6a273d6-4acf-42b3-ab40-377de1f774d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:58.793648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 18/39] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:58.794523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a273d6-4acf-42b3-ab40-377de1f774d7 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:58.799655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:58.853759 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:58.902234 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a273d6-4acf-42b3-ab40-377de1f774d7 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:58.912042 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 22/40] 10.222.0.79 () {60 vars in 1141 bytes} [Fri Sep 2 21:00:58 2022] POST /identity/v3/projects => generated 301 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:00:58.914432 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84fbb7-60f1-495a-a44c-f1e95f1683f8 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:58.914727 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84fbb7-60f1-495a-a44c-f1e95f1683f8 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:58.915013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84fbb7-60f1-495a-a44c-f1e95f1683f8 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:58.916475 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 23/41] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:00:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:00:58.923230 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954d513-e743-4e14-b50c-a32de5ddeae7 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:58.924055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954d513-e743-4e14-b50c-a32de5ddeae7 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:58.924576 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954d513-e743-4e14-b50c-a32de5ddeae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:58.949661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82120c0-dcf4-4066-9d9a-80fbe81504c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:58.950312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82120c0-dcf4-4066-9d9a-80fbe81504c2 None admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:58.950604 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82120c0-dcf4-4066-9d9a-80fbe81504c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:58.950891 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82120c0-dcf4-4066-9d9a-80fbe81504c2 None admin] PATH_INFO: `/v3/domains/default/users/ce385e879bed47f191e967e0c64d0d17/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:58.951714 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-a954d513-e743-4e14-b50c-a32de5ddeae7 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:00:58.952937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82120c0-dcf4-4066-9d9a-80fbe81504c2 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ce385e879bed47f191e967e0c64d0d17, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:58.953856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-a954d513-e743-4e14-b50c-a32de5ddeae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:00:58.954470 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82120c0-dcf4-4066-9d9a-80fbe81504c2 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:59.033683 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 24/42] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:00:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:00:59.075808 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954d513-e743-4e14-b50c-a32de5ddeae7 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:59.127469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 19/43] 10.222.0.79 () {58 vars in 1361 bytes} [Fri Sep 2 21:00:58 2022] PUT /identity/v3/domains/default/users/ce385e879bed47f191e967e0c64d0d17/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:00:59.199057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954d513-e743-4e14-b50c-a32de5ddeae7 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:59.232834 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:59.239980 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59018f82-d773-4842-9a93-dea45db0416e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:59.241412 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59018f82-d773-4842-9a93-dea45db0416e None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:59.244397 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59018f82-d773-4842-9a93-dea45db0416e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:59.244397 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59018f82-d773-4842-9a93-dea45db0416e None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:59.244397 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59018f82-d773-4842-9a93-dea45db0416e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:59.244397 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59018f82-d773-4842-9a93-dea45db0416e None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:59.311315 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82120c0-dcf4-4066-9d9a-80fbe81504c2 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:59.369299 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 25/44] 10.222.0.79 () {60 vars in 1131 bytes} [Fri Sep 2 21:00:59 2022] POST /identity/v3/roles => generated 223 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:00:59.433549 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82120c0-dcf4-4066-9d9a-80fbe81504c2 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:59.448787 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:00:59.474180 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b8608-c0b9-42ae-975c-a9e5564d9eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:59.474842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b8608-c0b9-42ae-975c-a9e5564d9eee None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:59.475799 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b8608-c0b9-42ae-975c-a9e5564d9eee None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:59.476178 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b8608-c0b9-42ae-975c-a9e5564d9eee None admin] PATH_INFO: `/v3/domains/default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:59.477564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b8608-c0b9-42ae-975c-a9e5564d9eee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:59.479123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b8608-c0b9-42ae-975c-a9e5564d9eee None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:59.485762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 20/45] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:00:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:00:59.486942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59018f82-d773-4842-9a93-dea45db0416e None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:00:59.598958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59018f82-d773-4842-9a93-dea45db0416e None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:00:59.634012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028cf7e-8d5b-4284-b60d-fa3da3fdaa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:00:59.634637 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028cf7e-8d5b-4284-b60d-fa3da3fdaa69 None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:00:59.634921 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028cf7e-8d5b-4284-b60d-fa3da3fdaa69 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:00:59.635202 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028cf7e-8d5b-4284-b60d-fa3da3fdaa69 None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:00:59.635865 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028cf7e-8d5b-4284-b60d-fa3da3fdaa69 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:00:59.637317 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028cf7e-8d5b-4284-b60d-fa3da3fdaa69 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:00:59.735062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 26/46] 10.222.0.79 () {60 vars in 1141 bytes} [Fri Sep 2 21:00:59 2022] POST /identity/v3/projects => generated 312 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:01:01.087924 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ce0f9-eb10-4f32-9920-3956a95817a8 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:01.088414 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ce0f9-eb10-4f32-9920-3956a95817a8 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:01.088414 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ce0f9-eb10-4f32-9920-3956a95817a8 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:01.089881 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 21/47] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:01.095185 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c34d7-4f0b-44e5-a0d7-5509dfb032e6 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:01.095611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c34d7-4f0b-44e5-a0d7-5509dfb032e6 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:01.095755 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c34d7-4f0b-44e5-a0d7-5509dfb032e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:01.114639 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-c20c34d7-4f0b-44e5-a0d7-5509dfb032e6 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:01.115952 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-c20c34d7-4f0b-44e5-a0d7-5509dfb032e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:01.151764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:01.185557 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 27/48] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:01.457280 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ce0f9-eb10-4f32-9920-3956a95817a8 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:01.563101 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ce0f9-eb10-4f32-9920-3956a95817a8 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:01.596920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33da8b-3c13-4c43-9b8c-59e52067c2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:01.598140 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33da8b-3c13-4c43-9b8c-59e52067c2bf None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:01.598140 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33da8b-3c13-4c43-9b8c-59e52067c2bf None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:01.598140 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33da8b-3c13-4c43-9b8c-59e52067c2bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:01.608153 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33da8b-3c13-4c43-9b8c-59e52067c2bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:01.686312 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cafcbb-c558-4490-a49a-f1bd4a6bc63c None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:01.686684 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cafcbb-c558-4490-a49a-f1bd4a6bc63c None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:01.686892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cafcbb-c558-4490-a49a-f1bd4a6bc63c None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:01.688496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 28/49] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:01:01.695432 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b25579-bab9-4124-9a31-fa97a0e24640 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:01.695729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b25579-bab9-4124-9a31-fa97a0e24640 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:01.696015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b25579-bab9-4124-9a31-fa97a0e24640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:01.716989 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-62b25579-bab9-4124-9a31-fa97a0e24640 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:01.718163 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-62b25579-bab9-4124-9a31-fa97a0e24640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:01.722825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-7d33da8b-3c13-4c43-9b8c-59e52067c2bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:01.722825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:01.722825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:01.722825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:01.722825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:01.722825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:01.722825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:01.722825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:01.722825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:01.722825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:01.722825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:01.722825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:01.722825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:01.722825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:01.722825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:01.722825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:01.732501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:01.732501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:01.732501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:01.732501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:01.732501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:01.732501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:01.732501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:01.732501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:01.732501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:01.732501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:01.732501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:01.732501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:01.732501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:01.732501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:01.732501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:01.732501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:01.733431 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:01.733431 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:01.733431 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:01.733431 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:01.733431 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:01.733431 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:01.733431 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:01.733431 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:01.733431 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:01.733431 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:01.733431 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:01.733431 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:01.733431 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 22/50] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:01:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:01.733431 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33da8b-3c13-4c43-9b8c-59e52067c2bf None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:01.779219 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:01.854258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33da8b-3c13-4c43-9b8c-59e52067c2bf None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:01.891323 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c779e-93b4-4500-be8f-2b8f39f8dadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:01.891969 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c779e-93b4-4500-be8f-2b8f39f8dadf None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:01.892287 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c779e-93b4-4500-be8f-2b8f39f8dadf None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:01.892567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c779e-93b4-4500-be8f-2b8f39f8dadf None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:01.893250 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c779e-93b4-4500-be8f-2b8f39f8dadf None admin] RBAC: Adding query filter params (name=admin) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:01.893556 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c779e-93b4-4500-be8f-2b8f39f8dadf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:01.895012 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c779e-93b4-4500-be8f-2b8f39f8dadf None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:01.897448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 29/51] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:01:01.904428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 23/52] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:01.910135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b25579-bab9-4124-9a31-fa97a0e24640 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:02.011363 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b25579-bab9-4124-9a31-fa97a0e24640 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:02.012838 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:02.045535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff6e9f-8fae-40b1-89e5-62fe30fe7c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:02.046205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff6e9f-8fae-40b1-89e5-62fe30fe7c4e None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:02.046491 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff6e9f-8fae-40b1-89e5-62fe30fe7c4e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:02.046775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff6e9f-8fae-40b1-89e5-62fe30fe7c4e None admin] PATH_INFO: `/v3/users/ce385e879bed47f191e967e0c64d0d17` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:02.047933 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff6e9f-8fae-40b1-89e5-62fe30fe7c4e None admin] RBAC: Authorizing `identity:get_user(user_id=ce385e879bed47f191e967e0c64d0d17)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:02.049383 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff6e9f-8fae-40b1-89e5-62fe30fe7c4e None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:02.050998 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 30/53] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:01 2022] GET /identity/v3/users/ce385e879bed47f191e967e0c64d0d17 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:02.057548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c779e-93b4-4500-be8f-2b8f39f8dadf None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:02.214204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c779e-93b4-4500-be8f-2b8f39f8dadf None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:02.216725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:02.247796 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff6e9f-8fae-40b1-89e5-62fe30fe7c4e None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:02.268122 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ee66c-5fde-4f9d-945f-fad07002fa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:02.268682 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ee66c-5fde-4f9d-945f-fad07002fa95 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:02.268968 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ee66c-5fde-4f9d-945f-fad07002fa95 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:02.269248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ee66c-5fde-4f9d-945f-fad07002fa95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:02.270395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ee66c-5fde-4f9d-945f-fad07002fa95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:02.272993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ee66c-5fde-4f9d-945f-fad07002fa95 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:02.274685 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 24/54] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:02.280453 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ee66c-5fde-4f9d-945f-fad07002fa95 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:02.350674 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff6e9f-8fae-40b1-89e5-62fe30fe7c4e None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:02.384235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ee66c-5fde-4f9d-945f-fad07002fa95 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:02.387037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037cbef-3135-4a81-ae87-d78caf79dac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:02.387676 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037cbef-3135-4a81-ae87-d78caf79dac4 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:02.387956 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037cbef-3135-4a81-ae87-d78caf79dac4 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:02.388231 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037cbef-3135-4a81-ae87-d78caf79dac4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:02.389389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e037cbef-3135-4a81-ae87-d78caf79dac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:02.390882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e037cbef-3135-4a81-ae87-d78caf79dac4 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:02.392454 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 31/55] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:02.398585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037cbef-3135-4a81-ae87-d78caf79dac4 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:02.420007 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca7e82-8bea-41ea-8a22-f736d52c5c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:02.420670 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca7e82-8bea-41ea-8a22-f736d52c5c5d None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:02.421039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca7e82-8bea-41ea-8a22-f736d52c5c5d None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:02.421244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca7e82-8bea-41ea-8a22-f736d52c5c5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:02.422009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca7e82-8bea-41ea-8a22-f736d52c5c5d None admin] RBAC: Adding query filter params (role.id=32e6a7f83b444d1ca9e5891a2b175f9a, scope.domain.id=default, user.id=ce385e879bed47f191e967e0c64d0d17) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:02.422326 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca7e82-8bea-41ea-8a22-f736d52c5c5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:02.423797 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca7e82-8bea-41ea-8a22-f736d52c5c5d None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:02.429681 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 25/56] 10.222.0.79 () {56 vars in 1322 bytes} [Fri Sep 2 21:01:02 2022] GET /identity/v3/role_assignments?user.id=ce385e879bed47f191e967e0c64d0d17&scope.domain.id=default&role.id=32e6a7f83b444d1ca9e5891a2b175f9a => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:02.439559 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:02.511485 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037cbef-3135-4a81-ae87-d78caf79dac4 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:02.548893 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a052f-e5bb-48e4-82c3-740018fc3d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:02.549423 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a052f-e5bb-48e4-82c3-740018fc3d3c None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:02.549712 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a052f-e5bb-48e4-82c3-740018fc3d3c None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:02.550025 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a052f-e5bb-48e4-82c3-740018fc3d3c None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:02.550696 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a052f-e5bb-48e4-82c3-740018fc3d3c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:02.552152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a052f-e5bb-48e4-82c3-740018fc3d3c None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:02.657964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 32/57] 10.222.0.79 () {60 vars in 1140 bytes} [Fri Sep 2 21:01:02 2022] POST /identity/v3/projects => generated 298 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:01:04.564007 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964f95b-06b2-4970-91b0-8f270454095b None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:04.564532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964f95b-06b2-4970-91b0-8f270454095b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:04.564620 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964f95b-06b2-4970-91b0-8f270454095b None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:04.565905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 26/58] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:04.571871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a8d57-9f46-472a-9b93-ea100416643f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:04.572258 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a8d57-9f46-472a-9b93-ea100416643f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:04.572436 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a8d57-9f46-472a-9b93-ea100416643f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:04.590708 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-955a8d57-9f46-472a-9b93-ea100416643f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:04.591912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-955a8d57-9f46-472a-9b93-ea100416643f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:04.658530 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 33/59] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:04.939175 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964f95b-06b2-4970-91b0-8f270454095b None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:04.975583 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:05.041389 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964f95b-06b2-4970-91b0-8f270454095b None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:05.075285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555fe7f-bd25-4505-93df-52298ec40fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:05.075911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555fe7f-bd25-4505-93df-52298ec40fe8 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:05.076201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555fe7f-bd25-4505-93df-52298ec40fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:05.076485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555fe7f-bd25-4505-93df-52298ec40fe8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:05.077614 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555fe7f-bd25-4505-93df-52298ec40fe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:05.079104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555fe7f-bd25-4505-93df-52298ec40fe8 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:05.080983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 27/60] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:05.086646 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a8d57-9f46-472a-9b93-ea100416643f None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:05.108296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:05.186154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a8d57-9f46-472a-9b93-ea100416643f None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:05.221084 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8af46-e823-4aa8-99ac-bb477a19990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:05.221621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8af46-e823-4aa8-99ac-bb477a19990d None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:05.221932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8af46-e823-4aa8-99ac-bb477a19990d None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:05.222213 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8af46-e823-4aa8-99ac-bb477a19990d None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:05.222886 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8af46-e823-4aa8-99ac-bb477a19990d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:05.224333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8af46-e823-4aa8-99ac-bb477a19990d None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:05.345149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 34/61] 10.222.0.79 () {60 vars in 1132 bytes} [Fri Sep 2 21:01:05 2022] POST /identity/v3/users => generated 275 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:01:08.446998 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865826f2-0564-4b53-805d-5350d27a2b4d None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:08.448005 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865826f2-0564-4b53-805d-5350d27a2b4d None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:08.448549 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865826f2-0564-4b53-805d-5350d27a2b4d None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:08.450449 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 28/62] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:08.456328 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708ecc1-0de7-4ad0-881b-4d5d26931625 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:08.457190 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708ecc1-0de7-4ad0-881b-4d5d26931625 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:08.457668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708ecc1-0de7-4ad0-881b-4d5d26931625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:08.487223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-8708ecc1-0de7-4ad0-881b-4d5d26931625 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:08.488754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8708ecc1-0de7-4ad0-881b-4d5d26931625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:08.505185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cae082-ca3a-4ea8-b985-eb55d97ddc8c None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:08.505845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cae082-ca3a-4ea8-b985-eb55d97ddc8c None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:08.506351 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cae082-ca3a-4ea8-b985-eb55d97ddc8c None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:08.509296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 29/63] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:08.513614 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92516cb-9f40-4da9-a136-64bf9e505a1b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:08.514149 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92516cb-9f40-4da9-a136-64bf9e505a1b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:08.514630 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92516cb-9f40-4da9-a136-64bf9e505a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:08.546439 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-a92516cb-9f40-4da9-a136-64bf9e505a1b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:08.548389 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-a92516cb-9f40-4da9-a136-64bf9e505a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:08.604713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 35/64] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:08.610949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f48e9-2fe6-4b07-8559-c802b4572c1d None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:08.611242 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f48e9-2fe6-4b07-8559-c802b4572c1d None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:08.611526 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f48e9-2fe6-4b07-8559-c802b4572c1d None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:08.613000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 36/65] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:08.625279 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d78dd-290a-4a52-ad74-0f3c05a81e20 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:08.625574 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d78dd-290a-4a52-ad74-0f3c05a81e20 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:08.625879 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d78dd-290a-4a52-ad74-0f3c05a81e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:08.646206 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:08.656592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-c96d78dd-290a-4a52-ad74-0f3c05a81e20 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:08.659222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-c96d78dd-290a-4a52-ad74-0f3c05a81e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:08.668230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 30/66] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:01:08.735992 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 37/67] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:08.901042 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33741b6-51e7-4814-9186-d6cb9d279931 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:08.901782 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33741b6-51e7-4814-9186-d6cb9d279931 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:08.902301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33741b6-51e7-4814-9186-d6cb9d279931 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:08.903869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 31/68] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:08.909353 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a5ba7-caab-42ef-8f2f-1ecdf1921641 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:08.909915 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a5ba7-caab-42ef-8f2f-1ecdf1921641 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:08.910402 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a5ba7-caab-42ef-8f2f-1ecdf1921641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:08.939888 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-f13a5ba7-caab-42ef-8f2f-1ecdf1921641 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:08.941414 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f13a5ba7-caab-42ef-8f2f-1ecdf1921641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:09.000414 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33741b6-51e7-4814-9186-d6cb9d279931 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:09.045607 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:09.053135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 38/69] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:09.053135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a5ba7-caab-42ef-8f2f-1ecdf1921641 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:09.126581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33741b6-51e7-4814-9186-d6cb9d279931 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:09.141508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:09.167432 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53bdc0-7418-472b-8d9d-84894d7e8fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:09.168183 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53bdc0-7418-472b-8d9d-84894d7e8fb2 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:09.168546 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53bdc0-7418-472b-8d9d-84894d7e8fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:09.168901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53bdc0-7418-472b-8d9d-84894d7e8fb2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:09.182082 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53bdc0-7418-472b-8d9d-84894d7e8fb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:09.187688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-ae53bdc0-7418-472b-8d9d-84894d7e8fb2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:09.187688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:09.187688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:09.187688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:09.187688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:09.187688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:09.187688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:09.187688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:09.187688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:09.187688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:09.187688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:09.187688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:09.187688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:09.187688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:09.187688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:09.187688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:09.188558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:09.188558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:09.188558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:09.188558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:09.188558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:09.188558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:09.188558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:09.188558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:09.188558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:09.188558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:09.188558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:09.188558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:09.188558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:09.188558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:09.188558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:09.188558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:09.189465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:09.189465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:09.189465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:09.189465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:09.189465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:09.189465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:09.189465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:09.189465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:09.189465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:09.189465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:09.189465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:09.189465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:09.189465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 32/70] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:01:09.190111 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53bdc0-7418-472b-8d9d-84894d7e8fb2 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:09.212896 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a5ba7-caab-42ef-8f2f-1ecdf1921641 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:09.267904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e86469-2262-4dea-a04f-3cdd7e2dea35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:09.268535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e86469-2262-4dea-a04f-3cdd7e2dea35 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:09.268827 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e86469-2262-4dea-a04f-3cdd7e2dea35 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:09.269111 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e86469-2262-4dea-a04f-3cdd7e2dea35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:09.281747 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e86469-2262-4dea-a04f-3cdd7e2dea35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:09.288015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-90e86469-2262-4dea-a04f-3cdd7e2dea35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:09.288015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:09.288015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:09.288015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:09.288015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:09.288015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:09.288015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:09.288015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:09.288015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:09.288015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:09.288015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:09.288015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:09.288015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:09.288015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:09.288015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:09.288015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:09.290079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:09.290079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:09.290079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:09.290079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:09.290079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:09.290079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:09.290079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:09.290079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:09.290079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:09.290079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:09.290079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:09.290079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:09.290079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:09.290079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:09.290079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:09.290079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:09.292046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:09.292046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:09.292046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:09.292046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:09.292046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:09.292046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:09.292046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:09.292046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:09.292046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:09.292046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:09.292046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:09.292046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:09.297947 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 39/71] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:01:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:09.297947 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e86469-2262-4dea-a04f-3cdd7e2dea35 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:09.307440 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:09.320076 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53bdc0-7418-472b-8d9d-84894d7e8fb2 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:09.362874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6ad41-b3d7-45ad-a525-25f2452c67cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:09.363503 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6ad41-b3d7-45ad-a525-25f2452c67cd None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:09.363783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6ad41-b3d7-45ad-a525-25f2452c67cd None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:09.364059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6ad41-b3d7-45ad-a525-25f2452c67cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:09.375892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6ad41-b3d7-45ad-a525-25f2452c67cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:09.381412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-5db6ad41-b3d7-45ad-a525-25f2452c67cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:09.381412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:09.381412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:09.381412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:09.381412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:09.381412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:09.381412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:09.381412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:09.381412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:09.381412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:09.381412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:09.381412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:09.381412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:09.381412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:09.381412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:09.381412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:09.382601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:09.382601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:09.382601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:09.382601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:09.382601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:09.382601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:09.382601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:09.382601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:09.382601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:09.382601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:09.382601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:09.382601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:09.382601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:09.382601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:09.382601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:09.382601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:09.383343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:09.383343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:09.383343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:09.383343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:09.383343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:09.383343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:09.383343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:09.383343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:09.383343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:09.383343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:09.383343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:09.383343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:09.383343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 33/72] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Sep 2 21:01:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:09.383983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6ad41-b3d7-45ad-a525-25f2452c67cd None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:09.417969 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e86469-2262-4dea-a04f-3cdd7e2dea35 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:09.445368 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:09.454300 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa831c07-1f35-40d4-9c0f-a14bbc312132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:09.458736 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa831c07-1f35-40d4-9c0f-a14bbc312132 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:09.458736 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa831c07-1f35-40d4-9c0f-a14bbc312132 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:09.458736 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa831c07-1f35-40d4-9c0f-a14bbc312132 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:09.458736 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa831c07-1f35-40d4-9c0f-a14bbc312132 None admin] RBAC: Adding query filter params (name=member) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:09.458736 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa831c07-1f35-40d4-9c0f-a14bbc312132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:09.458736 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa831c07-1f35-40d4-9c0f-a14bbc312132 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:09.466871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 40/73] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:09.468162 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d247f5d-811d-4232-aa7b-c803f8c88000 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:09.468517 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d247f5d-811d-4232-aa7b-c803f8c88000 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:09.468986 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d247f5d-811d-4232-aa7b-c803f8c88000 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:09.470031 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 41/74] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:09.470715 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d247f5d-811d-4232-aa7b-c803f8c88000 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:09.490998 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6ad41-b3d7-45ad-a525-25f2452c67cd None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:09.529246 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ee100-2313-4c3d-97fb-6b89a0fc0ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:09.529776 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ee100-2313-4c3d-97fb-6b89a0fc0ba9 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:09.530102 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ee100-2313-4c3d-97fb-6b89a0fc0ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:09.530387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ee100-2313-4c3d-97fb-6b89a0fc0ba9 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:09.531058 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ee100-2313-4c3d-97fb-6b89a0fc0ba9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:09.531369 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ee100-2313-4c3d-97fb-6b89a0fc0ba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:09.532804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ee100-2313-4c3d-97fb-6b89a0fc0ba9 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:09.550013 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 34/75] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:09.551478 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ee100-2313-4c3d-97fb-6b89a0fc0ba9 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:09.568243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:09.595862 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d247f5d-811d-4232-aa7b-c803f8c88000 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:09.630011 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2915f-caca-424d-9621-467ea918273c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:09.630667 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2915f-caca-424d-9621-467ea918273c None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:09.630948 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2915f-caca-424d-9621-467ea918273c None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:09.631368 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2915f-caca-424d-9621-467ea918273c None admin] PATH_INFO: `/v3/roles/member` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:09.641945 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2915f-caca-424d-9621-467ea918273c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:09.647493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-4ad2915f-caca-424d-9621-467ea918273c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:09.647493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:09.647493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:09.647493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:09.647493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:09.647493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:09.647493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:09.647493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:09.647493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:09.647493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:09.647493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:09.647493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:09.647493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:09.647493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:09.647493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:09.647493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:09.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:09.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:09.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:09.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:09.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:09.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:09.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:09.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:09.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:09.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:09.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:09.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:09.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:09.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:09.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:09.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:09.649129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:09.649129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:09.649129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:09.649129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:09.649129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:09.649129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:09.649129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:09.649129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:09.649129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:09.649129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:09.649129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:09.649129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:09.649129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 42/76] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:09.649758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2915f-caca-424d-9621-467ea918273c None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:09.658817 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ee100-2313-4c3d-97fb-6b89a0fc0ba9 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:09.695902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5af5f2-a598-4921-aa35-8ddae00f012e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:09.696522 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5af5f2-a598-4921-aa35-8ddae00f012e None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:09.696814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5af5f2-a598-4921-aa35-8ddae00f012e None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:09.697097 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5af5f2-a598-4921-aa35-8ddae00f012e None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:09.697774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5af5f2-a598-4921-aa35-8ddae00f012e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:09.698118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5af5f2-a598-4921-aa35-8ddae00f012e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:09.699527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5af5f2-a598-4921-aa35-8ddae00f012e None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:09.700889 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:09.709307 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 35/77] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:09.711126 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fede6fd-9ec1-4915-aa92-01541122ea80 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:09.711401 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fede6fd-9ec1-4915-aa92-01541122ea80 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:09.711682 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fede6fd-9ec1-4915-aa92-01541122ea80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:09.730258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-3fede6fd-9ec1-4915-aa92-01541122ea80 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:09.731473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-3fede6fd-9ec1-4915-aa92-01541122ea80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:09.753244 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2915f-caca-424d-9621-467ea918273c None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:09.788510 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758ae67-8181-41a1-afd3-b5a55234e489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:09.789062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758ae67-8181-41a1-afd3-b5a55234e489 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:09.789343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758ae67-8181-41a1-afd3-b5a55234e489 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:09.789621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758ae67-8181-41a1-afd3-b5a55234e489 None admin] PATH_INFO: `/v3/users/3ce3d1957ee348a49c430d91e7e49b73` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:09.800533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 36/78] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:09.801395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fede6fd-9ec1-4915-aa92-01541122ea80 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:09.806873 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758ae67-8181-41a1-afd3-b5a55234e489 None admin] RBAC: Authorizing `identity:get_user(user_id=3ce3d1957ee348a49c430d91e7e49b73)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:09.808325 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758ae67-8181-41a1-afd3-b5a55234e489 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:09.810298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 43/79] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:09 2022] GET /identity/v3/users/3ce3d1957ee348a49c430d91e7e49b73 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:09.811075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758ae67-8181-41a1-afd3-b5a55234e489 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:09.825357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:09.926016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fede6fd-9ec1-4915-aa92-01541122ea80 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:09.926515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758ae67-8181-41a1-afd3-b5a55234e489 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:09.934873 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:09.964224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e094b-b2aa-4220-bac5-d3386eba28d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:09.964971 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e094b-b2aa-4220-bac5-d3386eba28d0 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:09.965076 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e514da5-c35f-4d52-ad98-7c47d6325a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:09.965280 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e094b-b2aa-4220-bac5-d3386eba28d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:09.965534 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e094b-b2aa-4220-bac5-d3386eba28d0 None admin] PATH_INFO: `/v3/users/ce385e879bed47f191e967e0c64d0d17` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:09.965706 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e514da5-c35f-4d52-ad98-7c47d6325a70 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:09.965960 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e514da5-c35f-4d52-ad98-7c47d6325a70 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:09.966256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e514da5-c35f-4d52-ad98-7c47d6325a70 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:09.966759 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e094b-b2aa-4220-bac5-d3386eba28d0 None admin] RBAC: Authorizing `identity:get_user(user_id=ce385e879bed47f191e967e0c64d0d17)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:09.966918 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e514da5-c35f-4d52-ad98-7c47d6325a70 None admin] RBAC: Adding query filter params (name=member) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:09.967242 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e514da5-c35f-4d52-ad98-7c47d6325a70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:09.968226 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e094b-b2aa-4220-bac5-d3386eba28d0 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:09.968626 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e514da5-c35f-4d52-ad98-7c47d6325a70 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:09.975445 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 37/80] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:09 2022] GET /identity/v3/users/ce385e879bed47f191e967e0c64d0d17 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:09.975445 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e094b-b2aa-4220-bac5-d3386eba28d0 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:09.989882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 44/81] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:09.989882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e514da5-c35f-4d52-ad98-7c47d6325a70 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:10.054747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:10.087990 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e094b-b2aa-4220-bac5-d3386eba28d0 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:10.102748 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e514da5-c35f-4d52-ad98-7c47d6325a70 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:10.126098 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b77ce5-46d3-4952-80f6-181a39f7934e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:10.126735 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b77ce5-46d3-4952-80f6-181a39f7934e None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:10.127022 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b77ce5-46d3-4952-80f6-181a39f7934e None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:10.127292 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b77ce5-46d3-4952-80f6-181a39f7934e None admin] PATH_INFO: `/v3/users/3ce3d1957ee348a49c430d91e7e49b73` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:10.128420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b77ce5-46d3-4952-80f6-181a39f7934e None admin] RBAC: Authorizing `identity:get_user(user_id=3ce3d1957ee348a49c430d91e7e49b73)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:10.129912 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b77ce5-46d3-4952-80f6-181a39f7934e None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:10.132082 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 38/82] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:09 2022] GET /identity/v3/users/3ce3d1957ee348a49c430d91e7e49b73 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:10.132855 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b77ce5-46d3-4952-80f6-181a39f7934e None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:10.142450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab82c05-678e-46f4-ab40-2d239dd4536f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:10.143078 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab82c05-678e-46f4-ab40-2d239dd4536f None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:10.143367 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab82c05-678e-46f4-ab40-2d239dd4536f None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:10.143651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab82c05-678e-46f4-ab40-2d239dd4536f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:10.180134 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:10.214496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab82c05-678e-46f4-ab40-2d239dd4536f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:10.215993 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab82c05-678e-46f4-ab40-2d239dd4536f None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:10.234032 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b77ce5-46d3-4952-80f6-181a39f7934e None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:10.269362 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e4e32-06f2-45b2-97f1-c8cac16df266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:10.269997 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e4e32-06f2-45b2-97f1-c8cac16df266 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:10.270283 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e4e32-06f2-45b2-97f1-c8cac16df266 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:10.270559 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e4e32-06f2-45b2-97f1-c8cac16df266 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:10.282665 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:10.319034 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 45/83] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:10.319822 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab82c05-678e-46f4-ab40-2d239dd4536f None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:10.339504 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e4e32-06f2-45b2-97f1-c8cac16df266 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:10.341008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e4e32-06f2-45b2-97f1-c8cac16df266 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:10.391017 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:10.432923 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab82c05-678e-46f4-ab40-2d239dd4536f None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:10.445451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 39/84] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:10.446349 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e4e32-06f2-45b2-97f1-c8cac16df266 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:10.473639 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885ca08-05ac-4126-b879-15df7dd1cd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:10.474456 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885ca08-05ac-4126-b879-15df7dd1cd1f None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:10.474745 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885ca08-05ac-4126-b879-15df7dd1cd1f None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:10.475024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885ca08-05ac-4126-b879-15df7dd1cd1f None admin] PATH_INFO: `/v3/users/3ce3d1957ee348a49c430d91e7e49b73` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:10.476177 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885ca08-05ac-4126-b879-15df7dd1cd1f None admin] RBAC: Authorizing `identity:get_user(user_id=3ce3d1957ee348a49c430d91e7e49b73)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:10.477612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885ca08-05ac-4126-b879-15df7dd1cd1f None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:10.479235 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 46/85] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:10 2022] GET /identity/v3/users/3ce3d1957ee348a49c430d91e7e49b73 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:10.480005 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885ca08-05ac-4126-b879-15df7dd1cd1f None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:10.490080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:10.546744 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e4e32-06f2-45b2-97f1-c8cac16df266 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:10.584422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885ca08-05ac-4126-b879-15df7dd1cd1f None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:10.587316 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc06b4-1305-4f36-a256-bc0b31a34d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:10.587977 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc06b4-1305-4f36-a256-bc0b31a34d93 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:10.588262 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc06b4-1305-4f36-a256-bc0b31a34d93 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:10.588545 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc06b4-1305-4f36-a256-bc0b31a34d93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:10.589700 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc06b4-1305-4f36-a256-bc0b31a34d93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:10.591204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc06b4-1305-4f36-a256-bc0b31a34d93 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:10.592800 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 40/86] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:10.593740 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc06b4-1305-4f36-a256-bc0b31a34d93 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:10.635932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09ea8b-61b0-4155-a052-f4ad383fdb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:10.636934 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09ea8b-61b0-4155-a052-f4ad383fdb20 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:10.637394 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09ea8b-61b0-4155-a052-f4ad383fdb20 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:10.637798 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09ea8b-61b0-4155-a052-f4ad383fdb20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:10.642292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:10.715545 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc06b4-1305-4f36-a256-bc0b31a34d93 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:10.719619 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09ea8b-61b0-4155-a052-f4ad383fdb20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:10.721090 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09ea8b-61b0-4155-a052-f4ad383fdb20 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:10.727150 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:10.751013 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195cab1-d408-491a-af97-90b919588dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:10.751666 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195cab1-d408-491a-af97-90b919588dbd None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:10.751951 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195cab1-d408-491a-af97-90b919588dbd None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:10.752232 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195cab1-d408-491a-af97-90b919588dbd None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:10.753392 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195cab1-d408-491a-af97-90b919588dbd None admin] RBAC: Authorizing `identity:get_project(project_id=8ede2fe0b38f4061965d7dbc9aef29a9)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:10.754900 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195cab1-d408-491a-af97-90b919588dbd None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:10.757209 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 41/87] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:10 2022] GET /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:10.758054 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195cab1-d408-491a-af97-90b919588dbd None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:10.839939 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 47/88] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:10.840802 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09ea8b-61b0-4155-a052-f4ad383fdb20 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:10.865558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195cab1-d408-491a-af97-90b919588dbd None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:10.878181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:10.900740 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09feb2ba-ec0a-47b7-bdd0-cac31ebfc787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:10.901375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feb2ba-ec0a-47b7-bdd0-cac31ebfc787 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:10.901661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feb2ba-ec0a-47b7-bdd0-cac31ebfc787 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:10.901971 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feb2ba-ec0a-47b7-bdd0-cac31ebfc787 None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:10.903205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09feb2ba-ec0a-47b7-bdd0-cac31ebfc787 None admin] RBAC: Authorizing `identity:get_project(project_id=8ede2fe0b38f4061965d7dbc9aef29a9)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:10.904741 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09feb2ba-ec0a-47b7-bdd0-cac31ebfc787 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:10.906631 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 42/89] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:10 2022] GET /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:10.907225 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09feb2ba-ec0a-47b7-bdd0-cac31ebfc787 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:10.944045 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09ea8b-61b0-4155-a052-f4ad383fdb20 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:10.954474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:10.979345 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37975b-e2f6-4ef3-b220-450603604273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:10.979961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37975b-e2f6-4ef3-b220-450603604273 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:10.980251 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37975b-e2f6-4ef3-b220-450603604273 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:10.980542 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37975b-e2f6-4ef3-b220-450603604273 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:11.007423 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09feb2ba-ec0a-47b7-bdd0-cac31ebfc787 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:11.042281 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4ddfe-9b39-4c8f-a2d6-31d20aedece6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:11.042886 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4ddfe-9b39-4c8f-a2d6-31d20aedece6 None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:11.043171 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4ddfe-9b39-4c8f-a2d6-31d20aedece6 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:11.043446 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4ddfe-9b39-4c8f-a2d6-31d20aedece6 None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:11.044096 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c4ddfe-9b39-4c8f-a2d6-31d20aedece6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:11.045542 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c4ddfe-9b39-4c8f-a2d6-31d20aedece6 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:11.048316 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37975b-e2f6-4ef3-b220-450603604273 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:11.049782 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37975b-e2f6-4ef3-b220-450603604273 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:11.086424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:11.136693 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 43/90] 10.222.0.79 () {60 vars in 1132 bytes} [Fri Sep 2 21:01:10 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:01:11.137331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4ddfe-9b39-4c8f-a2d6-31d20aedece6 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:11.152771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 48/91] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:11.153678 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37975b-e2f6-4ef3-b220-450603604273 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:11.267661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4ddfe-9b39-4c8f-a2d6-31d20aedece6 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:11.269675 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:11.270775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37975b-e2f6-4ef3-b220-450603604273 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:11.309881 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d7baf-c25f-4248-83a9-a4999f236569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:11.310755 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d7baf-c25f-4248-83a9-a4999f236569 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:11.311040 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d7baf-c25f-4248-83a9-a4999f236569 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:11.311323 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d7baf-c25f-4248-83a9-a4999f236569 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:11.312067 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d7baf-c25f-4248-83a9-a4999f236569 None admin] RBAC: Adding query filter params (role.id=17200f478f4f42afb0a4d42b5da2183d, scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9, user.id=3ce3d1957ee348a49c430d91e7e49b73) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:11.312533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d7baf-c25f-4248-83a9-a4999f236569 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:11.314491 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d7baf-c25f-4248-83a9-a4999f236569 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:11.315357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7095f-a150-4df0-a5b2-4645a1788870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:11.316006 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7095f-a150-4df0-a5b2-4645a1788870 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:11.316292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7095f-a150-4df0-a5b2-4645a1788870 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:11.316573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7095f-a150-4df0-a5b2-4645a1788870 None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:11.317765 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7095f-a150-4df0-a5b2-4645a1788870 None admin] RBAC: Authorizing `identity:get_project(project_id=8ede2fe0b38f4061965d7dbc9aef29a9)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:11.319897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7095f-a150-4df0-a5b2-4645a1788870 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:11.321587 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 49/92] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:11 2022] GET /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:11.322150 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 44/93] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:11 2022] GET /identity/v3/role_assignments?user.id=3ce3d1957ee348a49c430d91e7e49b73&scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9&role.id=17200f478f4f42afb0a4d42b5da2183d => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:11.323177 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d7baf-c25f-4248-83a9-a4999f236569 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:11.323606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7095f-a150-4df0-a5b2-4645a1788870 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:11.330206 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:11.478313 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7095f-a150-4df0-a5b2-4645a1788870 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:11.490202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d7baf-c25f-4248-83a9-a4999f236569 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:11.528882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae01cfe-4e7d-41bc-98aa-bb00a3f52427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:11.529505 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae01cfe-4e7d-41bc-98aa-bb00a3f52427 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:11.529788 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae01cfe-4e7d-41bc-98aa-bb00a3f52427 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:11.530118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae01cfe-4e7d-41bc-98aa-bb00a3f52427 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:11.530869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae01cfe-4e7d-41bc-98aa-bb00a3f52427 None admin] RBAC: Adding query filter params (role.id=32e6a7f83b444d1ca9e5891a2b175f9a, scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9, user.id=ce385e879bed47f191e967e0c64d0d17) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:11.531180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae01cfe-4e7d-41bc-98aa-bb00a3f52427 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:11.532631 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae01cfe-4e7d-41bc-98aa-bb00a3f52427 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:11.543008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bb669-97c8-49d8-9741-e6fe283ebcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:11.543669 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bb669-97c8-49d8-9741-e6fe283ebcd8 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:11.543964 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bb669-97c8-49d8-9741-e6fe283ebcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:11.544250 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bb669-97c8-49d8-9741-e6fe283ebcd8 None admin] PATH_INFO: `/v3/projects/4faffe503d36427496bbea27ff5dfa19` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:11.544507 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 50/94] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:11 2022] GET /identity/v3/role_assignments?user.id=ce385e879bed47f191e967e0c64d0d17&scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9&role.id=32e6a7f83b444d1ca9e5891a2b175f9a => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:11.545428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bb669-97c8-49d8-9741-e6fe283ebcd8 None admin] RBAC: Authorizing `identity:get_project(project_id=4faffe503d36427496bbea27ff5dfa19)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:11.545888 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae01cfe-4e7d-41bc-98aa-bb00a3f52427 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:11.547093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bb669-97c8-49d8-9741-e6fe283ebcd8 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:11.548853 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 45/95] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:11 2022] GET /identity/v3/projects/4faffe503d36427496bbea27ff5dfa19 => generated 312 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:11.559662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bb669-97c8-49d8-9741-e6fe283ebcd8 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:11.629283 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:11.631174 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:11.671933 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae01cfe-4e7d-41bc-98aa-bb00a3f52427 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:11.718576 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0305bf5e-2a5e-48b9-8f01-e242c31db149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:11.719745 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305bf5e-2a5e-48b9-8f01-e242c31db149 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:11.720241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305bf5e-2a5e-48b9-8f01-e242c31db149 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:11.720733 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305bf5e-2a5e-48b9-8f01-e242c31db149 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:11.721690 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0305bf5e-2a5e-48b9-8f01-e242c31db149 None admin] RBAC: Adding query filter params (role.id=5feee6c423414badb9c65ac4076a7f45, scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9, user.id=3ce3d1957ee348a49c430d91e7e49b73) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:11.722314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0305bf5e-2a5e-48b9-8f01-e242c31db149 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:11.724171 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0305bf5e-2a5e-48b9-8f01-e242c31db149 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:11.731070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 51/96] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:11 2022] GET /identity/v3/role_assignments?user.id=3ce3d1957ee348a49c430d91e7e49b73&scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9&role.id=5feee6c423414badb9c65ac4076a7f45 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:11.769856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bb669-97c8-49d8-9741-e6fe283ebcd8 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:11.903519 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e9a18-cbaf-45aa-bdc3-ed60e9d232d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:11.904159 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e9a18-cbaf-45aa-bdc3-ed60e9d232d4 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:11.904445 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e9a18-cbaf-45aa-bdc3-ed60e9d232d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:11.904784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e9a18-cbaf-45aa-bdc3-ed60e9d232d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:11.905540 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e9a18-cbaf-45aa-bdc3-ed60e9d232d4 None admin] RBAC: Adding query filter params (role.id=17200f478f4f42afb0a4d42b5da2183d, scope.project.id=4faffe503d36427496bbea27ff5dfa19, user.id=3ce3d1957ee348a49c430d91e7e49b73) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:11.905888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e9a18-cbaf-45aa-bdc3-ed60e9d232d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:11.907386 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e9a18-cbaf-45aa-bdc3-ed60e9d232d4 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:11.918792 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 46/97] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:11 2022] GET /identity/v3/role_assignments?user.id=3ce3d1957ee348a49c430d91e7e49b73&scope.project.id=4faffe503d36427496bbea27ff5dfa19&role.id=17200f478f4f42afb0a4d42b5da2183d => generated 259 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:13.916330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790acf8-9962-47ea-87c7-c02fe0fcb822 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:13.916869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790acf8-9962-47ea-87c7-c02fe0fcb822 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:13.916950 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790acf8-9962-47ea-87c7-c02fe0fcb822 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:13.918433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 52/98] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:13.928910 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460ef13-7248-472c-8288-0aced0173324 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:13.929435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460ef13-7248-472c-8288-0aced0173324 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:13.929435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460ef13-7248-472c-8288-0aced0173324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:13.954002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-a460ef13-7248-472c-8288-0aced0173324 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:13.955193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-a460ef13-7248-472c-8288-0aced0173324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:13.976770 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8360864-dcfe-48f2-8147-99a07f68d04b None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:13.977085 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8360864-dcfe-48f2-8147-99a07f68d04b None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:13.977343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8360864-dcfe-48f2-8147-99a07f68d04b None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:13.978713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 53/99] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:13.991726 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677d5ba-f04f-42e0-b0b3-3b704cd0e451 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:13.992007 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677d5ba-f04f-42e0-b0b3-3b704cd0e451 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:13.992291 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677d5ba-f04f-42e0-b0b3-3b704cd0e451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:14.017853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-4677d5ba-f04f-42e0-b0b3-3b704cd0e451 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:14.019077 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-4677d5ba-f04f-42e0-b0b3-3b704cd0e451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:14.107650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 47/100] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:14.109015 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418fb1e-f455-4597-ad2e-63cdd2cf374f None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:14.109310 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418fb1e-f455-4597-ad2e-63cdd2cf374f None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:14.109591 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418fb1e-f455-4597-ad2e-63cdd2cf374f None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:14.111136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 48/101] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:14.116665 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f3c35-f32c-4840-bfe4-5321fcad73ed None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:14.116965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f3c35-f32c-4840-bfe4-5321fcad73ed None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:14.117352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f3c35-f32c-4840-bfe4-5321fcad73ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:14.132254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 54/102] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:01:14.148557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-161f3c35-f32c-4840-bfe4-5321fcad73ed None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:14.149757 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-161f3c35-f32c-4840-bfe4-5321fcad73ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:14.186208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:14.244075 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 49/103] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 02 21:01:14.438576 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006ef92-e6ef-4b47-96a8-9640d2f0917c None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:14.438950 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006ef92-e6ef-4b47-96a8-9640d2f0917c None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:14.439149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006ef92-e6ef-4b47-96a8-9640d2f0917c None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:14.440510 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 55/104] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:14.452388 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bcf05-f39e-44ec-a457-2353f2de5ac0 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:14.452923 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bcf05-f39e-44ec-a457-2353f2de5ac0 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:14.453432 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bcf05-f39e-44ec-a457-2353f2de5ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:14.491261 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-630bcf05-f39e-44ec-a457-2353f2de5ac0 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:14.492477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-630bcf05-f39e-44ec-a457-2353f2de5ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:14.523120 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006ef92-e6ef-4b47-96a8-9640d2f0917c None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:14.575292 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 50/105] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:14.615531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:14.660958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006ef92-e6ef-4b47-96a8-9640d2f0917c None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:14.697146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bcf05-f39e-44ec-a457-2353f2de5ac0 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:14.726695 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8ac30-4447-4472-9fd8-d2dc52e1e8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:14.727366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8ac30-4447-4472-9fd8-d2dc52e1e8fd None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:14.727658 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8ac30-4447-4472-9fd8-d2dc52e1e8fd None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:14.727947 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8ac30-4447-4472-9fd8-d2dc52e1e8fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:14.754179 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8ac30-4447-4472-9fd8-d2dc52e1e8fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:14.765037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-e6b8ac30-4447-4472-9fd8-d2dc52e1e8fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 21:01:14.765037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:14.765037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:14.765037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:14.765037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:14.765037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:14.765037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:14.765037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:14.765037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:14.765037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:14.765037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:14.765037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:14.765037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:14.765037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:14.765037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:14.765037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:14.766164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:14.766164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:14.766164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:14.766164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:14.766164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:14.766164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:14.766164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:14.766164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:14.766164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:14.766164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:14.766164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:14.766164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:14.766164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:14.766164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:14.766164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:14.766164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:14.766954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:14.766954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:14.766954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:14.766954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:14.766954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:14.766954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:14.766954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:14.766954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:14.766954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:14.766954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:14.766954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 21:01:14.766954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:14.766954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 56/106] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:01:14.776606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8ac30-4447-4472-9fd8-d2dc52e1e8fd None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:14.966155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:14.983997 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bcf05-f39e-44ec-a457-2353f2de5ac0 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:15.010958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8ac30-4447-4472-9fd8-d2dc52e1e8fd None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:15.029791 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce672a-abf3-40c1-a0e2-eac3c05ae9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:15.030403 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce672a-abf3-40c1-a0e2-eac3c05ae9f7 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:15.030688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce672a-abf3-40c1-a0e2-eac3c05ae9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:15.030969 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce672a-abf3-40c1-a0e2-eac3c05ae9f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:15.037709 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:15.041950 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce672a-abf3-40c1-a0e2-eac3c05ae9f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:15.047231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-57ce672a-abf3-40c1-a0e2-eac3c05ae9f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:15.047231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:15.047231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:15.047231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:15.047231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:15.047231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:15.047231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:15.047231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:15.047231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:15.047231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:15.047231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:15.047231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:15.047231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:15.047231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:15.047231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:15.047231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:15.053052 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:15.053052 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:15.053052 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:15.053052 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:15.053052 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:15.053052 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:15.053052 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:15.053052 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:15.053052 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:15.053052 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:15.053052 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:15.053052 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:15.053052 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:15.053052 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:15.053052 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:15.053052 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:15.053941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:15.053941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:15.053941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:15.053941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:15.053941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:15.053941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:15.053941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:15.053941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:15.053941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:15.053941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:15.053941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:15.053941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:15.053941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 51/107] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:15.053941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce672a-abf3-40c1-a0e2-eac3c05ae9f7 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:15.054813 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45917e-20f4-4a74-88cd-3b79ea7d41da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:15.055593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45917e-20f4-4a74-88cd-3b79ea7d41da None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:15.056025 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45917e-20f4-4a74-88cd-3b79ea7d41da None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:15.056334 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45917e-20f4-4a74-88cd-3b79ea7d41da None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:15.057156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45917e-20f4-4a74-88cd-3b79ea7d41da None admin] RBAC: Adding query filter params (name=reader) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:15.057472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45917e-20f4-4a74-88cd-3b79ea7d41da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:15.058926 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45917e-20f4-4a74-88cd-3b79ea7d41da None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:15.068263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 57/108] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:15.073306 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45917e-20f4-4a74-88cd-3b79ea7d41da None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:15.165710 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce672a-abf3-40c1-a0e2-eac3c05ae9f7 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:15.184291 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45917e-20f4-4a74-88cd-3b79ea7d41da None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:15.204612 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcefee9-78fc-496e-a44c-2a5b9adf200b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:15.205322 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcefee9-78fc-496e-a44c-2a5b9adf200b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:15.205548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcefee9-78fc-496e-a44c-2a5b9adf200b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:15.205856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcefee9-78fc-496e-a44c-2a5b9adf200b None admin] PATH_INFO: `/v3/domains/default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:15.207021 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcefee9-78fc-496e-a44c-2a5b9adf200b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:15.208770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcefee9-78fc-496e-a44c-2a5b9adf200b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:15.210848 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 52/109] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:15.211824 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6a4b8-26e9-4679-bf53-b66b233c739b None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:15.212114 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6a4b8-26e9-4679-bf53-b66b233c739b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:15.212395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6a4b8-26e9-4679-bf53-b66b233c739b None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:15.213598 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 53/110] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:15.214340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6a4b8-26e9-4679-bf53-b66b233c739b None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:15.225943 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8bf69-f84e-4a64-988e-4b618d3a179a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:15.226595 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8bf69-f84e-4a64-988e-4b618d3a179a None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:15.226879 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8bf69-f84e-4a64-988e-4b618d3a179a None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:15.227159 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8bf69-f84e-4a64-988e-4b618d3a179a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:15.232636 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:15.237576 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8bf69-f84e-4a64-988e-4b618d3a179a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:15.243555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-82f8bf69-f84e-4a64-988e-4b618d3a179a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:15.243555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:15.243555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:15.243555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:15.243555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:15.243555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:15.243555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:15.243555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:15.243555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:15.243555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:15.243555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:15.243555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:15.243555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:15.243555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:15.243555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:15.243555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:15.247191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:15.247191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:15.247191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:15.247191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:15.247191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:15.247191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:15.247191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:15.247191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:15.247191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:15.247191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:15.247191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:15.247191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:15.247191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:15.247191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:15.247191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:15.247191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:15.247945 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:15.247945 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:15.247945 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:15.247945 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:15.247945 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:15.247945 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:15.247945 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:15.247945 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:15.247945 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:15.247945 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:15.247945 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:15.247945 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:15.247945 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 58/111] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:01:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:15.247945 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8bf69-f84e-4a64-988e-4b618d3a179a None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:15.292832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:15.322155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6a4b8-26e9-4679-bf53-b66b233c739b None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:15.349245 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8bf69-f84e-4a64-988e-4b618d3a179a None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:15.356770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce661ab8-6669-4719-8dfb-cdc6e4a809f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:15.357629 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce661ab8-6669-4719-8dfb-cdc6e4a809f4 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:15.357865 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce661ab8-6669-4719-8dfb-cdc6e4a809f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:15.358152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce661ab8-6669-4719-8dfb-cdc6e4a809f4 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:15.358827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce661ab8-6669-4719-8dfb-cdc6e4a809f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:15.359137 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce661ab8-6669-4719-8dfb-cdc6e4a809f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:15.360561 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce661ab8-6669-4719-8dfb-cdc6e4a809f4 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:15.374261 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 54/112] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:15.374261 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37ed11-7eef-480a-9076-a1d937562c98 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:15.374261 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37ed11-7eef-480a-9076-a1d937562c98 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:15.374261 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37ed11-7eef-480a-9076-a1d937562c98 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:15.374261 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 55/113] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:15.374261 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37ed11-7eef-480a-9076-a1d937562c98 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:15.390579 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6885783-8070-43e8-b996-63f0c2fc23a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:15.391229 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6885783-8070-43e8-b996-63f0c2fc23a7 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:15.391514 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6885783-8070-43e8-b996-63f0c2fc23a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:15.391805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6885783-8070-43e8-b996-63f0c2fc23a7 None admin] PATH_INFO: `/v3/users/e117bc5a50954581a1b5f08f02e74823` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:15.406186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6885783-8070-43e8-b996-63f0c2fc23a7 None admin] RBAC: Authorizing `identity:get_user(user_id=e117bc5a50954581a1b5f08f02e74823)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:15.407689 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6885783-8070-43e8-b996-63f0c2fc23a7 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:15.409351 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 59/114] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:15 2022] GET /identity/v3/users/e117bc5a50954581a1b5f08f02e74823 => generated 289 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:15.410562 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880597a-32f1-4b18-8e7f-4a1e8cdf7743 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:15.414970 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880597a-32f1-4b18-8e7f-4a1e8cdf7743 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:15.414970 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880597a-32f1-4b18-8e7f-4a1e8cdf7743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:15.430077 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-3880597a-32f1-4b18-8e7f-4a1e8cdf7743 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:15.431230 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-3880597a-32f1-4b18-8e7f-4a1e8cdf7743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:15.471237 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:15.495230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37ed11-7eef-480a-9076-a1d937562c98 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:15.506605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 60/115] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:15.507467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880597a-32f1-4b18-8e7f-4a1e8cdf7743 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:15.531728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8056cdc-16a5-44f5-9f6d-a4f9c6e5b249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:15.532302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8056cdc-16a5-44f5-9f6d-a4f9c6e5b249 None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:15.532618 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8056cdc-16a5-44f5-9f6d-a4f9c6e5b249 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:15.532895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8056cdc-16a5-44f5-9f6d-a4f9c6e5b249 None admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:15.533549 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8056cdc-16a5-44f5-9f6d-a4f9c6e5b249 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:15.535043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8056cdc-16a5-44f5-9f6d-a4f9c6e5b249 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:15.547821 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:15.619108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880597a-32f1-4b18-8e7f-4a1e8cdf7743 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:15.626390 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 56/116] 10.222.0.79 () {60 vars in 1141 bytes} [Fri Sep 2 21:01:15 2022] POST /identity/v3/projects => generated 302 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:01:15.627179 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8056cdc-16a5-44f5-9f6d-a4f9c6e5b249 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:15.671096 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcbf84-1988-4dd7-8a0b-e1dd96b67532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:15.672382 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcbf84-1988-4dd7-8a0b-e1dd96b67532 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:15.672738 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcbf84-1988-4dd7-8a0b-e1dd96b67532 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:15.673130 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcbf84-1988-4dd7-8a0b-e1dd96b67532 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:15.673973 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcbf84-1988-4dd7-8a0b-e1dd96b67532 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:15.674357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcbf84-1988-4dd7-8a0b-e1dd96b67532 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:15.675996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcbf84-1988-4dd7-8a0b-e1dd96b67532 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:15.692106 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 61/117] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:15.692106 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90399a89-95ca-40cd-9723-fdb82f1aa2c1 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:15.692106 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90399a89-95ca-40cd-9723-fdb82f1aa2c1 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:15.692106 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90399a89-95ca-40cd-9723-fdb82f1aa2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:15.713301 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-90399a89-95ca-40cd-9723-fdb82f1aa2c1 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:15.714966 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-90399a89-95ca-40cd-9723-fdb82f1aa2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:15.787834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8056cdc-16a5-44f5-9f6d-a4f9c6e5b249 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:15.799610 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 62/118] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:15.800947 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90399a89-95ca-40cd-9723-fdb82f1aa2c1 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:15.826794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:15.832592 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb6c70-8a84-42a5-8784-38c4efd58cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:15.834088 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb6c70-8a84-42a5-8784-38c4efd58cbd None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:15.834563 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb6c70-8a84-42a5-8784-38c4efd58cbd None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:15.834847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb6c70-8a84-42a5-8784-38c4efd58cbd None admin] PATH_INFO: `/v3/users/3ce3d1957ee348a49c430d91e7e49b73` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:15.836039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb6c70-8a84-42a5-8784-38c4efd58cbd None admin] RBAC: Authorizing `identity:get_user(user_id=3ce3d1957ee348a49c430d91e7e49b73)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:15.837543 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb6c70-8a84-42a5-8784-38c4efd58cbd None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:15.837655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:15.839474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 57/119] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:15 2022] GET /identity/v3/users/3ce3d1957ee348a49c430d91e7e49b73 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:15.840267 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb6c70-8a84-42a5-8784-38c4efd58cbd None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:15.940235 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90399a89-95ca-40cd-9723-fdb82f1aa2c1 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:15.971039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb6c70-8a84-42a5-8784-38c4efd58cbd None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:15.991436 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccce67a-b672-4617-b829-d9be74947aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:15.992172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccce67a-b672-4617-b829-d9be74947aa5 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:15.992467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccce67a-b672-4617-b829-d9be74947aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:15.992752 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccce67a-b672-4617-b829-d9be74947aa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:16.011944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503db917-1878-49d9-9d89-907e5c63a93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:16.012907 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503db917-1878-49d9-9d89-907e5c63a93a None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:16.013342 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503db917-1878-49d9-9d89-907e5c63a93a None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:16.013837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503db917-1878-49d9-9d89-907e5c63a93a None admin] PATH_INFO: `/v3/users/ce385e879bed47f191e967e0c64d0d17` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:16.015392 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503db917-1878-49d9-9d89-907e5c63a93a None admin] RBAC: Authorizing `identity:get_user(user_id=ce385e879bed47f191e967e0c64d0d17)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:16.017082 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503db917-1878-49d9-9d89-907e5c63a93a None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:16.019235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 58/120] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:15 2022] GET /identity/v3/users/ce385e879bed47f191e967e0c64d0d17 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:16.020191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503db917-1878-49d9-9d89-907e5c63a93a None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:16.076692 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccce67a-b672-4617-b829-d9be74947aa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:16.078429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccce67a-b672-4617-b829-d9be74947aa5 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:16.092519 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:16.107790 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:16.130956 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503db917-1878-49d9-9d89-907e5c63a93a None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:16.168442 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364c970-2bd7-408b-91b3-df459255819c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:16.169270 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364c970-2bd7-408b-91b3-df459255819c None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:16.169566 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364c970-2bd7-408b-91b3-df459255819c None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:16.169876 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364c970-2bd7-408b-91b3-df459255819c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:16.181983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364c970-2bd7-408b-91b3-df459255819c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:16.187404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-b364c970-2bd7-408b-91b3-df459255819c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:16.187404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:16.187404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:16.187404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:16.187404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:16.187404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:16.187404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:16.187404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:16.187404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:16.187404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:16.187404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:16.187404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:16.187404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:16.187404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:16.187404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:16.187404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:16.188302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:16.188302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:16.188302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:16.188302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:16.188302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:16.188302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:16.188302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:16.188302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:16.188302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:16.188302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:16.188302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:16.188302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:16.188302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:16.188302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:16.188302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:16.188302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:16.189073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:16.189073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:16.189073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:16.189073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:16.189073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:16.189073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:16.189073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:16.189073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:16.189073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:16.189073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:16.189073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:16.189073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:16.189073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 59/121] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Sep 2 21:01:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:16.189692 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364c970-2bd7-408b-91b3-df459255819c None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:16.194786 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 63/122] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:16.200160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccce67a-b672-4617-b829-d9be74947aa5 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:16.309671 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccce67a-b672-4617-b829-d9be74947aa5 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:16.310506 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364c970-2bd7-408b-91b3-df459255819c None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:16.334865 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:16.341404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:16.345906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebdd43-7533-4379-8067-3c6ef16c0887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:16.346560 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebdd43-7533-4379-8067-3c6ef16c0887 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:16.346853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebdd43-7533-4379-8067-3c6ef16c0887 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:16.347137 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebdd43-7533-4379-8067-3c6ef16c0887 None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:16.348279 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ebdd43-7533-4379-8067-3c6ef16c0887 None admin] RBAC: Authorizing `identity:get_project(project_id=8ede2fe0b38f4061965d7dbc9aef29a9)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:16.350410 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ebdd43-7533-4379-8067-3c6ef16c0887 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:16.351925 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef044e8-eb8e-48c5-abef-db6eeed2344a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:16.352139 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 64/123] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:16 2022] GET /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:16.352565 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef044e8-eb8e-48c5-abef-db6eeed2344a None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:16.352850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef044e8-eb8e-48c5-abef-db6eeed2344a None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:16.353126 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef044e8-eb8e-48c5-abef-db6eeed2344a None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:16.354302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef044e8-eb8e-48c5-abef-db6eeed2344a None admin] RBAC: Authorizing `identity:get_project(project_id=8ede2fe0b38f4061965d7dbc9aef29a9)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:16.355789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef044e8-eb8e-48c5-abef-db6eeed2344a None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:16.357555 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 60/124] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:16 2022] GET /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:16.357665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebdd43-7533-4379-8067-3c6ef16c0887 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:16.358184 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef044e8-eb8e-48c5-abef-db6eeed2344a None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:16.469406 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef044e8-eb8e-48c5-abef-db6eeed2344a None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:16.475677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebdd43-7533-4379-8067-3c6ef16c0887 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:16.510057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec17dc-826f-48b9-b876-364df842c8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:16.510702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec17dc-826f-48b9-b876-364df842c8d1 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:16.511053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec17dc-826f-48b9-b876-364df842c8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:16.511264 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec17dc-826f-48b9-b876-364df842c8d1 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:16.511955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec17dc-826f-48b9-b876-364df842c8d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:16.512268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec17dc-826f-48b9-b876-364df842c8d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:16.513679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec17dc-826f-48b9-b876-364df842c8d1 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:16.518868 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911d951-3fab-45f2-8f44-0e0c4073f607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:16.519499 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911d951-3fab-45f2-8f44-0e0c4073f607 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:16.519787 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911d951-3fab-45f2-8f44-0e0c4073f607 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:16.520052 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911d951-3fab-45f2-8f44-0e0c4073f607 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:16.523673 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 61/125] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:16.524716 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec17dc-826f-48b9-b876-364df842c8d1 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:16.538739 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911d951-3fab-45f2-8f44-0e0c4073f607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:16.544832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-a911d951-3fab-45f2-8f44-0e0c4073f607 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:16.544832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:16.544832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:16.544832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:16.544832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:16.544832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:16.544832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:16.544832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:16.544832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:16.544832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:16.544832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:16.544832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:16.544832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:16.544832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:16.544832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:16.544832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:16.546630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:16.546630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:16.546630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:16.546630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:16.546630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:16.546630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:16.546630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:16.546630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:16.546630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:16.546630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:16.546630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:16.546630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:16.546630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:16.546630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:16.546630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:16.546630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:16.547416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:16.547416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:16.547416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:16.547416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:16.547416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:16.547416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:16.547416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:16.547416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:16.547416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:16.547416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:16.547416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:16.547416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:16.547416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 65/126] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:16.547416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911d951-3fab-45f2-8f44-0e0c4073f607 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:16.600211 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:16.610680 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:16.647098 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec17dc-826f-48b9-b876-364df842c8d1 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:16.678305 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911d951-3fab-45f2-8f44-0e0c4073f607 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:16.684757 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4f664-4774-4873-901c-45b7be6ae6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:16.685441 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4f664-4774-4873-901c-45b7be6ae6d6 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:16.685733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4f664-4774-4873-901c-45b7be6ae6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:16.688936 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4f664-4774-4873-901c-45b7be6ae6d6 None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:16.690587 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4f664-4774-4873-901c-45b7be6ae6d6 None admin] RBAC: Authorizing `identity:get_project(project_id=8ede2fe0b38f4061965d7dbc9aef29a9)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:16.692453 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4f664-4774-4873-901c-45b7be6ae6d6 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:16.699827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 62/127] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:16 2022] GET /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:16.699827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4f664-4774-4873-901c-45b7be6ae6d6 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:16.728876 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f2563-7a9d-4edf-abbd-db2dbe6fbcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:16.729581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f2563-7a9d-4edf-abbd-db2dbe6fbcb7 None admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:16.729983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f2563-7a9d-4edf-abbd-db2dbe6fbcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:16.730302 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f2563-7a9d-4edf-abbd-db2dbe6fbcb7 None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9/users/ce385e879bed47f191e967e0c64d0d17/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:16.732414 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f2563-7a9d-4edf-abbd-db2dbe6fbcb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ede2fe0b38f4061965d7dbc9aef29a9, user_id=ce385e879bed47f191e967e0c64d0d17, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:16.733910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f2563-7a9d-4edf-abbd-db2dbe6fbcb7 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:16.802481 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4f664-4774-4873-901c-45b7be6ae6d6 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:16.831231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:16.843675 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa838c8-0c39-49ee-9910-30be120df8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:16.843882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 66/128] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:01:16 2022] PUT /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9/users/ce385e879bed47f191e967e0c64d0d17/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:01:16.844515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f2563-7a9d-4edf-abbd-db2dbe6fbcb7 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:16.844819 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa838c8-0c39-49ee-9910-30be120df8bd None admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:16.845270 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa838c8-0c39-49ee-9910-30be120df8bd None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:16.845546 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa838c8-0c39-49ee-9910-30be120df8bd None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9/users/3ce3d1957ee348a49c430d91e7e49b73/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:16.853934 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa838c8-0c39-49ee-9910-30be120df8bd None admin] RBAC: Authorizing `identity:create_grant(project_id=8ede2fe0b38f4061965d7dbc9aef29a9, user_id=3ce3d1957ee348a49c430d91e7e49b73, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:16.856311 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa838c8-0c39-49ee-9910-30be120df8bd None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:16.993185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 63/129] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:01:16 2022] PUT /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9/users/3ce3d1957ee348a49c430d91e7e49b73/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:01:16.993185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa838c8-0c39-49ee-9910-30be120df8bd None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:16.996282 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f2563-7a9d-4edf-abbd-db2dbe6fbcb7 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:17.022043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:17.054291 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f28d88-0fea-4ed2-bb2b-299b22f99571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:17.054987 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f28d88-0fea-4ed2-bb2b-299b22f99571 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:17.055332 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f28d88-0fea-4ed2-bb2b-299b22f99571 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:17.055625 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f28d88-0fea-4ed2-bb2b-299b22f99571 None admin] PATH_INFO: `/v3/users/3ce3d1957ee348a49c430d91e7e49b73` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:17.057252 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f28d88-0fea-4ed2-bb2b-299b22f99571 None admin] RBAC: Authorizing `identity:get_user(user_id=3ce3d1957ee348a49c430d91e7e49b73)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:17.059450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f28d88-0fea-4ed2-bb2b-299b22f99571 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:17.061755 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 67/130] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:16 2022] GET /identity/v3/users/3ce3d1957ee348a49c430d91e7e49b73 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:17.062630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f28d88-0fea-4ed2-bb2b-299b22f99571 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:17.141925 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa838c8-0c39-49ee-9910-30be120df8bd None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:17.188352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72032421-9173-48d4-89a5-fb3e21df6d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:17.188975 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72032421-9173-48d4-89a5-fb3e21df6d0a None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:17.189262 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72032421-9173-48d4-89a5-fb3e21df6d0a None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:17.189545 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72032421-9173-48d4-89a5-fb3e21df6d0a None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:17.190276 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72032421-9173-48d4-89a5-fb3e21df6d0a None admin] RBAC: Adding query filter params (name=member) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:17.190577 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72032421-9173-48d4-89a5-fb3e21df6d0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:17.191995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72032421-9173-48d4-89a5-fb3e21df6d0a None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:17.203261 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 64/131] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:17.204135 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72032421-9173-48d4-89a5-fb3e21df6d0a None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:17.204879 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f28d88-0fea-4ed2-bb2b-299b22f99571 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:17.245798 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931ef5b-cb17-42c9-9c7b-6f5d188ba7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:17.246461 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931ef5b-cb17-42c9-9c7b-6f5d188ba7e6 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:17.246750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931ef5b-cb17-42c9-9c7b-6f5d188ba7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:17.247035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931ef5b-cb17-42c9-9c7b-6f5d188ba7e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:17.247790 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931ef5b-cb17-42c9-9c7b-6f5d188ba7e6 None admin] RBAC: Adding query filter params (role.id=a11acb6c8a3e4c8b8673190a6bb021f7, scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9, user.id=e117bc5a50954581a1b5f08f02e74823) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:17.248105 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931ef5b-cb17-42c9-9c7b-6f5d188ba7e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:17.249782 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931ef5b-cb17-42c9-9c7b-6f5d188ba7e6 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:17.257005 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 68/132] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:17 2022] GET /identity/v3/role_assignments?user.id=e117bc5a50954581a1b5f08f02e74823&scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9&role.id=a11acb6c8a3e4c8b8673190a6bb021f7 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:17.257724 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931ef5b-cb17-42c9-9c7b-6f5d188ba7e6 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:17.267376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:17.313433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:17.376216 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72032421-9173-48d4-89a5-fb3e21df6d0a None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:17.413108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931ef5b-cb17-42c9-9c7b-6f5d188ba7e6 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:17.471888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817e59e-6136-4c98-9a62-8c7653d07725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:17.472536 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817e59e-6136-4c98-9a62-8c7653d07725 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:17.472825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817e59e-6136-4c98-9a62-8c7653d07725 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:17.473102 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817e59e-6136-4c98-9a62-8c7653d07725 None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:17.475192 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817e59e-6136-4c98-9a62-8c7653d07725 None admin] RBAC: Authorizing `identity:get_project(project_id=8ede2fe0b38f4061965d7dbc9aef29a9)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:17.476723 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817e59e-6136-4c98-9a62-8c7653d07725 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:17.478457 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 65/133] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:17 2022] GET /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:17.487722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817e59e-6136-4c98-9a62-8c7653d07725 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:17.494575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81041555-5607-467e-aea7-07de58c9083a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:17.495249 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81041555-5607-467e-aea7-07de58c9083a None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:17.495533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81041555-5607-467e-aea7-07de58c9083a None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:17.495807 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81041555-5607-467e-aea7-07de58c9083a None admin] PATH_INFO: `/v3/users/3ce3d1957ee348a49c430d91e7e49b73` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:17.497090 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81041555-5607-467e-aea7-07de58c9083a None admin] RBAC: Authorizing `identity:get_user(user_id=3ce3d1957ee348a49c430d91e7e49b73)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:17.498697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81041555-5607-467e-aea7-07de58c9083a None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:17.500430 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 69/134] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:17 2022] GET /identity/v3/users/3ce3d1957ee348a49c430d91e7e49b73 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:17.506233 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81041555-5607-467e-aea7-07de58c9083a None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:17.698059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81041555-5607-467e-aea7-07de58c9083a None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:17.699799 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817e59e-6136-4c98-9a62-8c7653d07725 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:17.716609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:17.741376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:17.745277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36664a-3ea3-46d8-b25c-a249cb870b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:17.746046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36664a-3ea3-46d8-b25c-a249cb870b5a None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:17.746405 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36664a-3ea3-46d8-b25c-a249cb870b5a None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:17.746759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36664a-3ea3-46d8-b25c-a249cb870b5a None admin] PATH_INFO: `/v3/projects/4faffe503d36427496bbea27ff5dfa19` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:17.747950 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36664a-3ea3-46d8-b25c-a249cb870b5a None admin] RBAC: Authorizing `identity:get_project(project_id=4faffe503d36427496bbea27ff5dfa19)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:17.749473 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36664a-3ea3-46d8-b25c-a249cb870b5a None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:17.751518 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 70/135] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:17 2022] GET /identity/v3/projects/4faffe503d36427496bbea27ff5dfa19 => generated 312 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:17.757979 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36664a-3ea3-46d8-b25c-a249cb870b5a None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:17.798014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f9fdd-dee7-46ba-8c66-ab215875aa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:17.798700 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f9fdd-dee7-46ba-8c66-ab215875aa48 None admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:17.798990 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f9fdd-dee7-46ba-8c66-ab215875aa48 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:17.799270 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f9fdd-dee7-46ba-8c66-ab215875aa48 None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9/users/3ce3d1957ee348a49c430d91e7e49b73/roles/5feee6c423414badb9c65ac4076a7f45` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:17.809911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f9fdd-dee7-46ba-8c66-ab215875aa48 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ede2fe0b38f4061965d7dbc9aef29a9, user_id=3ce3d1957ee348a49c430d91e7e49b73, role_id=5feee6c423414badb9c65ac4076a7f45)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:17.811871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f9fdd-dee7-46ba-8c66-ab215875aa48 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:17.865384 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36664a-3ea3-46d8-b25c-a249cb870b5a None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:17.901373 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3e394-edf0-41be-b276-2aa093297935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:17.902080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3e394-edf0-41be-b276-2aa093297935 None admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:17.902424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3e394-edf0-41be-b276-2aa093297935 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:17.902714 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3e394-edf0-41be-b276-2aa093297935 None admin] PATH_INFO: `/v3/projects/4faffe503d36427496bbea27ff5dfa19/users/3ce3d1957ee348a49c430d91e7e49b73/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:17.904739 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3e394-edf0-41be-b276-2aa093297935 None admin] RBAC: Authorizing `identity:create_grant(project_id=4faffe503d36427496bbea27ff5dfa19, user_id=3ce3d1957ee348a49c430d91e7e49b73, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:17.906238 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3e394-edf0-41be-b276-2aa093297935 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:17.922103 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 66/136] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:01:17 2022] PUT /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9/users/3ce3d1957ee348a49c430d91e7e49b73/roles/5feee6c423414badb9c65ac4076a7f45 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:01:17.923304 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea41dfb-2abb-4067-b543-aa71bbe8b410 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:17.923599 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea41dfb-2abb-4067-b543-aa71bbe8b410 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:17.923883 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea41dfb-2abb-4067-b543-aa71bbe8b410 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:17.925530 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 67/137] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:17.936085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa9089-4a2b-4be6-ba96-4a9cb7c4b905 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:17.936380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa9089-4a2b-4be6-ba96-4a9cb7c4b905 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:17.936755 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa9089-4a2b-4be6-ba96-4a9cb7c4b905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:17.968376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-cbaa9089-4a2b-4be6-ba96-4a9cb7c4b905 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:17.970370 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-cbaa9089-4a2b-4be6-ba96-4a9cb7c4b905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:18.000790 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 71/138] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:01:17 2022] PUT /identity/v3/projects/4faffe503d36427496bbea27ff5dfa19/users/3ce3d1957ee348a49c430d91e7e49b73/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:01:18.074953 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 68/139] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 02 21:01:18.497583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3e394-edf0-41be-b276-2aa093297935 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:18.566934 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:18.639354 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3e394-edf0-41be-b276-2aa093297935 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:18.688817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fbe1d-00ab-4ad0-8717-b984ab18ceb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:18.688817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fbe1d-00ab-4ad0-8717-b984ab18ceb8 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:18.688817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fbe1d-00ab-4ad0-8717-b984ab18ceb8 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:18.688817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fbe1d-00ab-4ad0-8717-b984ab18ceb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:18.689768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565fbe1d-00ab-4ad0-8717-b984ab18ceb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:18.691250 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565fbe1d-00ab-4ad0-8717-b984ab18ceb8 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:18.697844 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 72/140] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:18.699488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa9089-4a2b-4be6-ba96-4a9cb7c4b905 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:18.846773 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa9089-4a2b-4be6-ba96-4a9cb7c4b905 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:18.850148 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:18.885532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc716fd-bab6-4f9d-bdb0-5842e817bacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:18.886194 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc716fd-bab6-4f9d-bdb0-5842e817bacd None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:18.886486 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc716fd-bab6-4f9d-bdb0-5842e817bacd None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:18.886773 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc716fd-bab6-4f9d-bdb0-5842e817bacd None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:18.887450 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc716fd-bab6-4f9d-bdb0-5842e817bacd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:18.889457 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc716fd-bab6-4f9d-bdb0-5842e817bacd None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:19.033046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 69/141] 10.222.0.79 () {60 vars in 1132 bytes} [Fri Sep 2 21:01:18 2022] POST /identity/v3/users => generated 283 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:01:19.591669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478543c7-a6f9-491b-8a19-9a27e311854c None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:19.592214 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478543c7-a6f9-491b-8a19-9a27e311854c None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:19.592214 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478543c7-a6f9-491b-8a19-9a27e311854c None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:19.593573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 73/142] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:19.599731 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a05055-5708-461b-aa45-035c29cf146c None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:19.600192 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a05055-5708-461b-aa45-035c29cf146c None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:19.600300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a05055-5708-461b-aa45-035c29cf146c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:19.622767 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-d5a05055-5708-461b-aa45-035c29cf146c None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:19.623992 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-d5a05055-5708-461b-aa45-035c29cf146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:19.715205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 70/143] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:20.004334 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478543c7-a6f9-491b-8a19-9a27e311854c None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:20.045080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc09acd-ae6e-4c2d-9c43-a19c83bc7359 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:20.045391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc09acd-ae6e-4c2d-9c43-a19c83bc7359 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:20.045660 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc09acd-ae6e-4c2d-9c43-a19c83bc7359 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:20.047041 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 71/144] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:20.074474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fe697-e4c7-4661-a094-c0b8d75ce7ce None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:20.074792 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fe697-e4c7-4661-a094-c0b8d75ce7ce None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:20.075040 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fe697-e4c7-4661-a094-c0b8d75ce7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:20.113033 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-bf5fe697-e4c7-4661-a094-c0b8d75ce7ce None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:20.114654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-bf5fe697-e4c7-4661-a094-c0b8d75ce7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:20.154314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478543c7-a6f9-491b-8a19-9a27e311854c None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:20.165546 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:20.202667 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4760a0-fac3-437c-8114-421fec5b8c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:20.202992 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4760a0-fac3-437c-8114-421fec5b8c3f None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:20.203396 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4760a0-fac3-437c-8114-421fec5b8c3f None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:20.203783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4760a0-fac3-437c-8114-421fec5b8c3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:20.213600 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 72/145] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:01:20.215331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d0f7a-9895-4f3d-810d-1cb023200e8a None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:20.215762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d0f7a-9895-4f3d-810d-1cb023200e8a None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:20.216176 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d0f7a-9895-4f3d-810d-1cb023200e8a None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:20.217599 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 73/146] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:20.223059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4760a0-fac3-437c-8114-421fec5b8c3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:20.223212 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040b4a9-30a4-4571-9ab4-3136cff40ba6 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:20.224014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040b4a9-30a4-4571-9ab4-3136cff40ba6 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:20.224297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040b4a9-30a4-4571-9ab4-3136cff40ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:20.229829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-ea4760a0-fac3-437c-8114-421fec5b8c3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:20.229829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:20.229829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:20.229829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:20.229829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:20.229829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:20.229829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:20.229829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:20.229829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:20.229829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:20.229829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:20.229829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:20.229829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:20.229829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:20.229829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:20.229829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:20.230688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:20.230688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:20.230688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:20.230688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:20.230688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:20.230688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:20.230688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:20.230688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:20.230688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:20.230688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:20.230688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:20.230688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:20.230688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:20.230688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:20.230688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:20.230688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:20.231443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:20.231443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:20.231443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:20.231443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:20.231443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:20.231443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:20.231443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:20.231443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:20.231443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:20.231443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:20.231443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:20.231443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:20.234495 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 74/147] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:01:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:20.243443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4760a0-fac3-437c-8114-421fec5b8c3f None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:20.248106 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-2040b4a9-30a4-4571-9ab4-3136cff40ba6 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:20.249299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-2040b4a9-30a4-4571-9ab4-3136cff40ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:20.284334 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:20.381171 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 74/148] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:01:20.447944 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4760a0-fac3-437c-8114-421fec5b8c3f None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:20.492404 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd407e5-9db9-4bb7-b07e-38f77a1eb2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:20.493030 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd407e5-9db9-4bb7-b07e-38f77a1eb2c7 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:20.493315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd407e5-9db9-4bb7-b07e-38f77a1eb2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:20.493597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd407e5-9db9-4bb7-b07e-38f77a1eb2c7 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:20.494321 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd407e5-9db9-4bb7-b07e-38f77a1eb2c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:20.494632 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd407e5-9db9-4bb7-b07e-38f77a1eb2c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:20.496022 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd407e5-9db9-4bb7-b07e-38f77a1eb2c7 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:20.510079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 75/149] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:20.516156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040b4a9-30a4-4571-9ab4-3136cff40ba6 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:20.604540 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd407e5-9db9-4bb7-b07e-38f77a1eb2c7 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:20.647333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:20.710972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040b4a9-30a4-4571-9ab4-3136cff40ba6 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:20.774821 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7c5d7-0acb-4533-a0c2-358c51d85857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:20.775480 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7c5d7-0acb-4533-a0c2-358c51d85857 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:20.775765 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7c5d7-0acb-4533-a0c2-358c51d85857 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:20.776040 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7c5d7-0acb-4533-a0c2-358c51d85857 None admin] PATH_INFO: `/v3/users/ce385e879bed47f191e967e0c64d0d17` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:20.777187 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7c5d7-0acb-4533-a0c2-358c51d85857 None admin] RBAC: Authorizing `identity:get_user(user_id=ce385e879bed47f191e967e0c64d0d17)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:20.778827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7c5d7-0acb-4533-a0c2-358c51d85857 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:20.780873 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 75/150] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:20 2022] GET /identity/v3/users/ce385e879bed47f191e967e0c64d0d17 => generated 247 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:20.782001 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd407e5-9db9-4bb7-b07e-38f77a1eb2c7 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:20.787948 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7c5d7-0acb-4533-a0c2-358c51d85857 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:20.819723 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:20.857924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc6b20-1d3a-40fc-a998-ade2731ab0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:20.858510 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc6b20-1d3a-40fc-a998-ade2731ab0c3 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:20.858883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc6b20-1d3a-40fc-a998-ade2731ab0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:20.859249 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc6b20-1d3a-40fc-a998-ade2731ab0c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:20.879353 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc6b20-1d3a-40fc-a998-ade2731ab0c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:20.884897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-53bc6b20-1d3a-40fc-a998-ade2731ab0c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 21:01:20.884897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:20.884897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:20.884897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:20.884897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:20.884897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:20.884897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:20.884897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:20.884897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:20.884897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:20.884897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:20.884897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:20.884897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:20.884897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:20.884897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:20.884897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:20.885763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:20.885763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:20.885763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:20.885763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:20.885763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:20.885763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:20.885763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:20.885763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:20.885763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:20.885763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:20.885763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:20.885763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:20.885763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:20.885763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:20.885763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:20.885763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:20.886556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:20.886556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:20.886556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:20.886556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:20.886556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:20.886556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:20.886556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:20.886556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:20.886556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:20.886556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:20.886556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 21:01:20.886556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:20.886556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 76/151] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:01:20.887191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc6b20-1d3a-40fc-a998-ade2731ab0c3 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:20.991678 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:21.002198 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc6b20-1d3a-40fc-a998-ade2731ab0c3 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:21.028193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7c5d7-0acb-4533-a0c2-358c51d85857 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:21.042398 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2ea03-2a15-4e73-a865-4c3faf4202e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:21.043098 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2ea03-2a15-4e73-a865-4c3faf4202e8 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:21.043383 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2ea03-2a15-4e73-a865-4c3faf4202e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:21.043667 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2ea03-2a15-4e73-a865-4c3faf4202e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:21.057012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2ea03-2a15-4e73-a865-4c3faf4202e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:21.062597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-46d2ea03-2a15-4e73-a865-4c3faf4202e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:21.062597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:21.062597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:21.062597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:21.062597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:21.062597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:21.062597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:21.062597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:21.062597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:21.062597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:21.062597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:21.062597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:21.062597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:21.062597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:21.062597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:21.062597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:21.063817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:21.063817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:21.063817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:21.063817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:21.063817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:21.063817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:21.063817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:21.063817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:21.063817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:21.063817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:21.063817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:21.063817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:21.063817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:21.063817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:21.063817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:21.063817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:21.064853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:21.064853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:21.064853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:21.064853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:21.064853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:21.064853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:21.064853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:21.064853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:21.064853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:21.064853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:21.064853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:21.064853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:21.067066 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 77/152] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:21.069012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2ea03-2a15-4e73-a865-4c3faf4202e8 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:21.130943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7cfdb-b9d2-4260-a2c8-b11461361f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:21.131564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7cfdb-b9d2-4260-a2c8-b11461361f54 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:21.132016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7cfdb-b9d2-4260-a2c8-b11461361f54 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:21.132453 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7cfdb-b9d2-4260-a2c8-b11461361f54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:21.183294 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2ea03-2a15-4e73-a865-4c3faf4202e8 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:21.224496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8278c8-5b46-4222-a14b-6679d4bf06e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:21.225428 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8278c8-5b46-4222-a14b-6679d4bf06e1 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:21.227225 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8278c8-5b46-4222-a14b-6679d4bf06e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:21.228349 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8278c8-5b46-4222-a14b-6679d4bf06e1 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:21.229258 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8278c8-5b46-4222-a14b-6679d4bf06e1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:21.230385 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8278c8-5b46-4222-a14b-6679d4bf06e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:21.232107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8278c8-5b46-4222-a14b-6679d4bf06e1 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:21.248862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7cfdb-b9d2-4260-a2c8-b11461361f54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:21.250598 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7cfdb-b9d2-4260-a2c8-b11461361f54 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:21.251700 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 78/153] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:21.252677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8278c8-5b46-4222-a14b-6679d4bf06e1 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:21.291893 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:21.294663 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:21.421208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8278c8-5b46-4222-a14b-6679d4bf06e1 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:21.456480 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c94f7-b35e-4ef5-994d-7f4757150219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:21.457098 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c94f7-b35e-4ef5-994d-7f4757150219 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:21.457648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c94f7-b35e-4ef5-994d-7f4757150219 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:21.458073 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c94f7-b35e-4ef5-994d-7f4757150219 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:21.458919 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c94f7-b35e-4ef5-994d-7f4757150219 None admin] RBAC: Adding query filter params (name=member) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:21.459226 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c94f7-b35e-4ef5-994d-7f4757150219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:21.460624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c94f7-b35e-4ef5-994d-7f4757150219 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:21.461244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 76/154] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:21.462394 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7cfdb-b9d2-4260-a2c8-b11461361f54 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:21.474819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 79/155] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:21.476292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a889e18-fd7d-464a-a134-56002109ba3c None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:21.476585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a889e18-fd7d-464a-a134-56002109ba3c None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:21.476861 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a889e18-fd7d-464a-a134-56002109ba3c None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:21.479738 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 80/156] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:21.484018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553e648-4bd4-48fa-86d2-2c9a2d4f9eb9 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:21.484018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553e648-4bd4-48fa-86d2-2c9a2d4f9eb9 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:21.484018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553e648-4bd4-48fa-86d2-2c9a2d4f9eb9 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:21.484018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 81/157] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:21.484018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553e648-4bd4-48fa-86d2-2c9a2d4f9eb9 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:21.601835 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:21.646483 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553e648-4bd4-48fa-86d2-2c9a2d4f9eb9 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:21.651747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7cfdb-b9d2-4260-a2c8-b11461361f54 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:21.693705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:21.700457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a58b70-e2ba-4c3a-a78c-5d773ec42faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:21.701150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a58b70-e2ba-4c3a-a78c-5d773ec42faf None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:21.701432 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a58b70-e2ba-4c3a-a78c-5d773ec42faf None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:21.701705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a58b70-e2ba-4c3a-a78c-5d773ec42faf None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:21.703934 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a58b70-e2ba-4c3a-a78c-5d773ec42faf None admin] RBAC: Authorizing `identity:get_project(project_id=8ede2fe0b38f4061965d7dbc9aef29a9)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:21.705379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a58b70-e2ba-4c3a-a78c-5d773ec42faf None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:21.708732 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 82/158] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:21 2022] GET /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:21.709959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5876a-e564-4224-ab3b-8f0d92b39c45 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:21.712449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5876a-e564-4224-ab3b-8f0d92b39c45 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:21.712449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5876a-e564-4224-ab3b-8f0d92b39c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:21.724486 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52442302-810b-4e6a-8981-651db3f73e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:21.725191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52442302-810b-4e6a-8981-651db3f73e3a None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:21.725448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52442302-810b-4e6a-8981-651db3f73e3a None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:21.725732 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52442302-810b-4e6a-8981-651db3f73e3a None admin] PATH_INFO: `/v3/users/e117bc5a50954581a1b5f08f02e74823` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:21.727226 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52442302-810b-4e6a-8981-651db3f73e3a None admin] RBAC: Authorizing `identity:get_user(user_id=e117bc5a50954581a1b5f08f02e74823)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:21.728682 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52442302-810b-4e6a-8981-651db3f73e3a None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:21.735778 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 77/159] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:21 2022] GET /identity/v3/users/e117bc5a50954581a1b5f08f02e74823 => generated 289 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:21.736877 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52442302-810b-4e6a-8981-651db3f73e3a None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:21.754106 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-c5e5876a-e564-4224-ab3b-8f0d92b39c45 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:21.755574 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-c5e5876a-e564-4224-ab3b-8f0d92b39c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:21.895511 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 83/160] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:21.896797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cff91-0c2e-4d9d-aabb-ce8d3e797ffb None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:21.897088 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cff91-0c2e-4d9d-aabb-ce8d3e797ffb None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:21.897368 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cff91-0c2e-4d9d-aabb-ce8d3e797ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:21.944384 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-248cff91-0c2e-4d9d-aabb-ce8d3e797ffb None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:21.945502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-248cff91-0c2e-4d9d-aabb-ce8d3e797ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:21.976754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52442302-810b-4e6a-8981-651db3f73e3a None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:22.053234 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1b9c6-e7b8-48bb-8d26-3961d3436e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:22.054281 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1b9c6-e7b8-48bb-8d26-3961d3436e66 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:22.054783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1b9c6-e7b8-48bb-8d26-3961d3436e66 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:22.055275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1b9c6-e7b8-48bb-8d26-3961d3436e66 None admin] PATH_INFO: `/v3/users/3ce3d1957ee348a49c430d91e7e49b73` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:22.056632 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1b9c6-e7b8-48bb-8d26-3961d3436e66 None admin] RBAC: Authorizing `identity:get_user(user_id=3ce3d1957ee348a49c430d91e7e49b73)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:22.058319 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1b9c6-e7b8-48bb-8d26-3961d3436e66 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:22.060229 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 78/161] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:21 2022] GET /identity/v3/users/3ce3d1957ee348a49c430d91e7e49b73 => generated 275 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:22.061323 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1b9c6-e7b8-48bb-8d26-3961d3436e66 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:22.099172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 84/162] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:22.100419 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cff91-0c2e-4d9d-aabb-ce8d3e797ffb None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:22.104605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:22.171463 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:22.269350 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cff91-0c2e-4d9d-aabb-ce8d3e797ffb None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:22.274422 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1b9c6-e7b8-48bb-8d26-3961d3436e66 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:22.337591 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d23009-1bf8-41c9-a0fc-6cbcaf7a20e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:22.338792 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d23009-1bf8-41c9-a0fc-6cbcaf7a20e4 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:22.339563 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d23009-1bf8-41c9-a0fc-6cbcaf7a20e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:22.340038 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d23009-1bf8-41c9-a0fc-6cbcaf7a20e4 None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:22.341433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d23009-1bf8-41c9-a0fc-6cbcaf7a20e4 None admin] RBAC: Authorizing `identity:get_project(project_id=8ede2fe0b38f4061965d7dbc9aef29a9)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:22.343979 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d23009-1bf8-41c9-a0fc-6cbcaf7a20e4 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:22.346383 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 85/163] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:22 2022] GET /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:22.347616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d23009-1bf8-41c9-a0fc-6cbcaf7a20e4 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:22.351350 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6631602-6dca-4872-aea6-d61ad231a32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:22.351983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6631602-6dca-4872-aea6-d61ad231a32e None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:22.352270 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6631602-6dca-4872-aea6-d61ad231a32e None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:22.352550 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6631602-6dca-4872-aea6-d61ad231a32e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:22.353293 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6631602-6dca-4872-aea6-d61ad231a32e None admin] RBAC: Adding query filter params (role.id=32e6a7f83b444d1ca9e5891a2b175f9a, scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9, user.id=ce385e879bed47f191e967e0c64d0d17) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:22.353608 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6631602-6dca-4872-aea6-d61ad231a32e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:22.355953 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6631602-6dca-4872-aea6-d61ad231a32e None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:22.378236 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 79/164] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:22 2022] GET /identity/v3/role_assignments?user.id=ce385e879bed47f191e967e0c64d0d17&scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9&role.id=32e6a7f83b444d1ca9e5891a2b175f9a => generated 608 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:22.379092 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6631602-6dca-4872-aea6-d61ad231a32e None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:22.457720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:22.500417 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d23009-1bf8-41c9-a0fc-6cbcaf7a20e4 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:22.546275 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640b7b6-3a90-46fa-9baf-733d1cfbf05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:22.547264 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640b7b6-3a90-46fa-9baf-733d1cfbf05d None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:22.547959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640b7b6-3a90-46fa-9baf-733d1cfbf05d None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:22.548437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640b7b6-3a90-46fa-9baf-733d1cfbf05d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:22.632258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6631602-6dca-4872-aea6-d61ad231a32e None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:22.638908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640b7b6-3a90-46fa-9baf-733d1cfbf05d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:22.640966 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640b7b6-3a90-46fa-9baf-733d1cfbf05d None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:22.674376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:22.718198 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcaeb19-b480-4954-843e-ea4cae00554e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:22.718871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaeb19-b480-4954-843e-ea4cae00554e None admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:22.719156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaeb19-b480-4954-843e-ea4cae00554e None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:22.719511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaeb19-b480-4954-843e-ea4cae00554e None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9/users/e117bc5a50954581a1b5f08f02e74823/roles/a11acb6c8a3e4c8b8673190a6bb021f7` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:22.724720 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcaeb19-b480-4954-843e-ea4cae00554e None admin] RBAC: Authorizing `identity:create_grant(project_id=8ede2fe0b38f4061965d7dbc9aef29a9, user_id=e117bc5a50954581a1b5f08f02e74823, role_id=a11acb6c8a3e4c8b8673190a6bb021f7)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:22.726409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcaeb19-b480-4954-843e-ea4cae00554e None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:22.736127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:22.769128 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 86/165] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:22.770800 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640b7b6-3a90-46fa-9baf-733d1cfbf05d None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:22.814174 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 80/166] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:01:22 2022] PUT /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9/users/e117bc5a50954581a1b5f08f02e74823/roles/a11acb6c8a3e4c8b8673190a6bb021f7 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:01:22.815237 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcaeb19-b480-4954-843e-ea4cae00554e None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:22.880802 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640b7b6-3a90-46fa-9baf-733d1cfbf05d None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:22.919946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69ed70-b4d5-4c12-9eb4-f64f1c067833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:22.920981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69ed70-b4d5-4c12-9eb4-f64f1c067833 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:22.921461 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69ed70-b4d5-4c12-9eb4-f64f1c067833 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:22.921972 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69ed70-b4d5-4c12-9eb4-f64f1c067833 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:22.936922 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69ed70-b4d5-4c12-9eb4-f64f1c067833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:22.942912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-fa69ed70-b4d5-4c12-9eb4-f64f1c067833 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:22.942912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:22.942912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:22.942912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:22.942912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:22.942912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:22.942912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:22.942912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:22.942912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:22.942912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:22.942912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:22.942912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:22.942912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:22.942912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:22.942912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:22.942912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:22.943762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:22.943762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:22.943762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:22.943762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:22.943762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:22.943762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:22.943762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:22.943762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:22.943762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:22.943762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:22.943762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:22.943762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:22.943762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:22.943762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:22.943762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:22.943762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:22.944734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:22.944734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:22.944734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:22.944734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:22.944734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:22.944734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:22.944734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:22.944734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:22.944734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:22.944734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:22.944734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:22.944734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:22.947096 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 87/167] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Sep 2 21:01:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:22.948143 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69ed70-b4d5-4c12-9eb4-f64f1c067833 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:22.999055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:23.019735 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcaeb19-b480-4954-843e-ea4cae00554e None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:23.086875 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1cc09-c9d3-43ad-b6e3-df5dcfd55d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:23.087230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1cc09-c9d3-43ad-b6e3-df5dcfd55d25 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:23.087698 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1cc09-c9d3-43ad-b6e3-df5dcfd55d25 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:23.088172 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1cc09-c9d3-43ad-b6e3-df5dcfd55d25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:23.109262 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1cc09-c9d3-43ad-b6e3-df5dcfd55d25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:23.115553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-4dc1cc09-c9d3-43ad-b6e3-df5dcfd55d25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:23.115553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:23.115553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:23.115553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:23.115553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:23.115553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:23.115553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:23.115553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:23.115553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:23.115553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:23.115553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:23.115553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:23.115553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:23.115553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:23.115553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:23.115553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:23.116498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:23.116498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:23.116498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:23.116498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:23.116498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:23.116498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:23.116498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:23.116498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:23.116498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:23.116498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:23.116498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:23.116498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:23.116498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:23.116498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:23.116498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:23.116498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:23.117297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:23.117297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:23.117297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:23.117297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:23.117297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:23.117297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:23.117297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:23.117297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:23.117297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:23.117297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:23.117297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:23.117297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:23.121532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69ed70-b4d5-4c12-9eb4-f64f1c067833 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:23.122250 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 81/168] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:23.123242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1cc09-c9d3-43ad-b6e3-df5dcfd55d25 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:23.191544 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677a4b4-f333-4f33-ae2c-dd25fa6a9c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:23.193850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677a4b4-f333-4f33-ae2c-dd25fa6a9c65 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:23.194516 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677a4b4-f333-4f33-ae2c-dd25fa6a9c65 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:23.195004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677a4b4-f333-4f33-ae2c-dd25fa6a9c65 None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:23.198869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677a4b4-f333-4f33-ae2c-dd25fa6a9c65 None admin] RBAC: Authorizing `identity:get_project(project_id=8ede2fe0b38f4061965d7dbc9aef29a9)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:23.200917 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677a4b4-f333-4f33-ae2c-dd25fa6a9c65 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:23.203846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 88/169] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:22 2022] GET /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:23.204974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677a4b4-f333-4f33-ae2c-dd25fa6a9c65 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:23.216927 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:23.353120 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1cc09-c9d3-43ad-b6e3-df5dcfd55d25 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:23.374244 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:23.380328 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677a4b4-f333-4f33-ae2c-dd25fa6a9c65 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:23.393378 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c9e42-5e0a-4d6c-a65b-1dcb306bd24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:23.394079 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c9e42-5e0a-4d6c-a65b-1dcb306bd24a None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:23.394692 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c9e42-5e0a-4d6c-a65b-1dcb306bd24a None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:23.394692 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c9e42-5e0a-4d6c-a65b-1dcb306bd24a None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:23.395412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c9e42-5e0a-4d6c-a65b-1dcb306bd24a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:23.395715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c9e42-5e0a-4d6c-a65b-1dcb306bd24a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:23.397114 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c9e42-5e0a-4d6c-a65b-1dcb306bd24a None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:23.407123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 82/170] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:23.408118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c9e42-5e0a-4d6c-a65b-1dcb306bd24a None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:23.428118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17c7f0-51b2-43d2-af54-0d0b9b0b0254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:23.429162 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17c7f0-51b2-43d2-af54-0d0b9b0b0254 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:23.429959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17c7f0-51b2-43d2-af54-0d0b9b0b0254 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:23.430421 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17c7f0-51b2-43d2-af54-0d0b9b0b0254 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:23.431285 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17c7f0-51b2-43d2-af54-0d0b9b0b0254 None admin] RBAC: Adding query filter params (name=member) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:23.431766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17c7f0-51b2-43d2-af54-0d0b9b0b0254 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:23.433840 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17c7f0-51b2-43d2-af54-0d0b9b0b0254 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:23.446099 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 89/171] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:23.447642 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba42ea-d2a4-4546-9608-80875c75edf3 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:23.448275 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba42ea-d2a4-4546-9608-80875c75edf3 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:23.448729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba42ea-d2a4-4546-9608-80875c75edf3 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:23.451044 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 90/172] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:23.452052 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba42ea-d2a4-4546-9608-80875c75edf3 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:23.569466 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba42ea-d2a4-4546-9608-80875c75edf3 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:23.602113 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c9e42-5e0a-4d6c-a65b-1dcb306bd24a None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:23.606191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:23.608959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd20c30-3122-4769-b544-1cd373e7bf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:23.609605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd20c30-3122-4769-b544-1cd373e7bf0a None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:23.609921 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd20c30-3122-4769-b544-1cd373e7bf0a None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:23.610202 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd20c30-3122-4769-b544-1cd373e7bf0a None admin] PATH_INFO: `/v3/users/3ce3d1957ee348a49c430d91e7e49b73` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:23.611354 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd20c30-3122-4769-b544-1cd373e7bf0a None admin] RBAC: Authorizing `identity:get_user(user_id=3ce3d1957ee348a49c430d91e7e49b73)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:23.613313 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd20c30-3122-4769-b544-1cd373e7bf0a None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:23.616447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 91/173] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:23 2022] GET /identity/v3/users/3ce3d1957ee348a49c430d91e7e49b73 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:23.617704 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd20c30-3122-4769-b544-1cd373e7bf0a None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:23.647951 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68aff9-9499-4395-a6b5-3da51ae513db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:23.648941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68aff9-9499-4395-a6b5-3da51ae513db None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:23.649429 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68aff9-9499-4395-a6b5-3da51ae513db None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:23.649957 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68aff9-9499-4395-a6b5-3da51ae513db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:23.651030 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68aff9-9499-4395-a6b5-3da51ae513db None admin] RBAC: Adding query filter params (role.id=17200f478f4f42afb0a4d42b5da2183d, scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9, user.id=3ce3d1957ee348a49c430d91e7e49b73) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:23.651805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68aff9-9499-4395-a6b5-3da51ae513db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:23.654426 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68aff9-9499-4395-a6b5-3da51ae513db None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:23.656684 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:23.661712 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 83/174] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:23 2022] GET /identity/v3/role_assignments?user.id=3ce3d1957ee348a49c430d91e7e49b73&scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9&role.id=17200f478f4f42afb0a4d42b5da2183d => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:23.663498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc8a2d-45a4-40a0-b394-06de2c13997b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:23.663990 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc8a2d-45a4-40a0-b394-06de2c13997b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:23.664471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc8a2d-45a4-40a0-b394-06de2c13997b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:23.692265 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-d9fc8a2d-45a4-40a0-b394-06de2c13997b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:23.694318 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-d9fc8a2d-45a4-40a0-b394-06de2c13997b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:23.757122 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd20c30-3122-4769-b544-1cd373e7bf0a None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:23.805287 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 84/175] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:23.806671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2147d1e-882e-42d9-9221-dd6a65ecfbd3 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:23.806963 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2147d1e-882e-42d9-9221-dd6a65ecfbd3 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:23.807237 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2147d1e-882e-42d9-9221-dd6a65ecfbd3 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:23.808951 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 85/176] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:23.813929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2147d1e-882e-42d9-9221-dd6a65ecfbd3 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:23.819763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c654f58-6f67-4e0d-a2ce-9e67df0c98cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:23.820430 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c654f58-6f67-4e0d-a2ce-9e67df0c98cf None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:23.821696 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c654f58-6f67-4e0d-a2ce-9e67df0c98cf None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:23.821696 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c654f58-6f67-4e0d-a2ce-9e67df0c98cf None admin] PATH_INFO: `/v3/users/3ce3d1957ee348a49c430d91e7e49b73` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:23.823765 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c654f58-6f67-4e0d-a2ce-9e67df0c98cf None admin] RBAC: Authorizing `identity:get_user(user_id=3ce3d1957ee348a49c430d91e7e49b73)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:23.825678 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c654f58-6f67-4e0d-a2ce-9e67df0c98cf None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:23.827636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 92/177] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:23 2022] GET /identity/v3/users/3ce3d1957ee348a49c430d91e7e49b73 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:23.829080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d994f57-f4ac-4aca-9264-5eb003ec304c None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:23.829560 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d994f57-f4ac-4aca-9264-5eb003ec304c None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:23.830010 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d994f57-f4ac-4aca-9264-5eb003ec304c None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:23.831722 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 93/178] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:23.833632 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce31f00-855b-4ebd-844f-f73ee55b794f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:23.834180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce31f00-855b-4ebd-844f-f73ee55b794f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:23.835321 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce31f00-855b-4ebd-844f-f73ee55b794f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:23.866456 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-4ce31f00-855b-4ebd-844f-f73ee55b794f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:23.869000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-4ce31f00-855b-4ebd-844f-f73ee55b794f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:23.960067 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:23.969147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2147d1e-882e-42d9-9221-dd6a65ecfbd3 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:23.972689 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 94/179] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:23.972689 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce31f00-855b-4ebd-844f-f73ee55b794f None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:24.001883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:24.010418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f0812-db32-4c0c-adb2-92dc39ecdc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:24.011100 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f0812-db32-4c0c-adb2-92dc39ecdc2c None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:24.012768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f0812-db32-4c0c-adb2-92dc39ecdc2c None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:24.012768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f0812-db32-4c0c-adb2-92dc39ecdc2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:24.091680 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce31f00-855b-4ebd-844f-f73ee55b794f None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:24.106569 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f0812-db32-4c0c-adb2-92dc39ecdc2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:24.108080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f0812-db32-4c0c-adb2-92dc39ecdc2c None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:24.131744 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144ce7d-c197-44ee-8cb6-4c240a3650a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:24.132283 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144ce7d-c197-44ee-8cb6-4c240a3650a5 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:24.132564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144ce7d-c197-44ee-8cb6-4c240a3650a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:24.132845 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144ce7d-c197-44ee-8cb6-4c240a3650a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:24.211532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144ce7d-c197-44ee-8cb6-4c240a3650a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:24.213192 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144ce7d-c197-44ee-8cb6-4c240a3650a5 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:24.225488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:24.236847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 86/180] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:24.238200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91132de-df4f-4558-9cb5-a334458f2001 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:24.239000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91132de-df4f-4558-9cb5-a334458f2001 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:24.239366 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91132de-df4f-4558-9cb5-a334458f2001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:24.244611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:24.261553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-c91132de-df4f-4558-9cb5-a334458f2001 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:24.262862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-c91132de-df4f-4558-9cb5-a334458f2001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:24.334852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 95/181] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:24.336289 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144ce7d-c197-44ee-8cb6-4c240a3650a5 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:24.366623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 87/182] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:24.367386 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91132de-df4f-4558-9cb5-a334458f2001 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:24.521723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144ce7d-c197-44ee-8cb6-4c240a3650a5 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:24.539986 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91132de-df4f-4558-9cb5-a334458f2001 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:24.551279 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:24.560357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c6842-4b92-4e20-ad0e-9f3d7bad1499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:24.561932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c6842-4b92-4e20-ad0e-9f3d7bad1499 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:24.561932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c6842-4b92-4e20-ad0e-9f3d7bad1499 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:24.562278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c6842-4b92-4e20-ad0e-9f3d7bad1499 None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:24.563760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c6842-4b92-4e20-ad0e-9f3d7bad1499 None admin] RBAC: Authorizing `identity:get_project(project_id=8ede2fe0b38f4061965d7dbc9aef29a9)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:24.565441 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c6842-4b92-4e20-ad0e-9f3d7bad1499 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:24.567804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:24.569626 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 96/183] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:24 2022] GET /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:24.570688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c6842-4b92-4e20-ad0e-9f3d7bad1499 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:24.579720 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b291e-fe65-4822-84d0-884ccda21880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:24.580365 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b291e-fe65-4822-84d0-884ccda21880 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:24.580712 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b291e-fe65-4822-84d0-884ccda21880 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:24.580950 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b291e-fe65-4822-84d0-884ccda21880 None admin] PATH_INFO: `/v3/projects/4faffe503d36427496bbea27ff5dfa19` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:24.582085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b291e-fe65-4822-84d0-884ccda21880 None admin] RBAC: Authorizing `identity:get_project(project_id=4faffe503d36427496bbea27ff5dfa19)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:24.585569 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b291e-fe65-4822-84d0-884ccda21880 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:24.590496 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 88/184] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:24 2022] GET /identity/v3/projects/4faffe503d36427496bbea27ff5dfa19 => generated 312 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:24.590496 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b291e-fe65-4822-84d0-884ccda21880 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:24.712681 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b291e-fe65-4822-84d0-884ccda21880 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:24.722114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c6842-4b92-4e20-ad0e-9f3d7bad1499 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:24.752540 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b35fe-5979-49e9-a16c-bfc96240c796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:24.753285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b35fe-5979-49e9-a16c-bfc96240c796 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:24.753564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b35fe-5979-49e9-a16c-bfc96240c796 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:24.753854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b35fe-5979-49e9-a16c-bfc96240c796 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:24.759085 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a91a0-f4fd-4f93-bb6a-3a682c7b92e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:24.759727 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a91a0-f4fd-4f93-bb6a-3a682c7b92e0 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:24.760018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a91a0-f4fd-4f93-bb6a-3a682c7b92e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:24.760282 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a91a0-f4fd-4f93-bb6a-3a682c7b92e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:24.766329 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b35fe-5979-49e9-a16c-bfc96240c796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:24.772662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-4e3b35fe-5979-49e9-a16c-bfc96240c796 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:24.772662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:24.772662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:24.772662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:24.772662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:24.772662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:24.772662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:24.772662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:24.772662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:24.772662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:24.772662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:24.772662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:24.772662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:24.772662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:24.772662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:24.772662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:24.773798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:24.773798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:24.773798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:24.773798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:24.773798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:24.773798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:24.773798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:24.773798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:24.773798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:24.773798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:24.773798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:24.773798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:24.773798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:24.773798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:24.773798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:24.773798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:24.775357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:24.775357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:24.775357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:24.775357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:24.775357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:24.775357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:24.775357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:24.775357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:24.775357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:24.775357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:24.775357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:24.775357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:24.775957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a91a0-f4fd-4f93-bb6a-3a682c7b92e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:24.776028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 89/185] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Sep 2 21:01:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:24.776028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b35fe-5979-49e9-a16c-bfc96240c796 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:24.783677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-0b1a91a0-f4fd-4f93-bb6a-3a682c7b92e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:24.783677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:24.783677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:24.783677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:24.783677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:24.783677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:24.783677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:24.783677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:24.783677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:24.783677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:24.783677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:24.783677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:24.783677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:24.783677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:24.783677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:24.783677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:24.784906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:24.784906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:24.784906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:24.784906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:24.784906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:24.784906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:24.784906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:24.784906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:24.784906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:24.784906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:24.784906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:24.784906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:24.784906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:24.784906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:24.784906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:24.784906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:24.787062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:24.787062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:24.787062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:24.787062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:24.787062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:24.787062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:24.787062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:24.787062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:24.787062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:24.787062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:24.787062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:24.787062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:24.787062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 97/186] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:01:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:24.791100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a91a0-f4fd-4f93-bb6a-3a682c7b92e0 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:24.845933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:24.858881 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:24.914538 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b35fe-5979-49e9-a16c-bfc96240c796 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:24.915058 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a91a0-f4fd-4f93-bb6a-3a682c7b92e0 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:24.950905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c187b3a-3adc-429c-8f77-30cfa4146034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:24.951781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c187b3a-3adc-429c-8f77-30cfa4146034 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:24.952066 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c187b3a-3adc-429c-8f77-30cfa4146034 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:24.952342 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c187b3a-3adc-429c-8f77-30cfa4146034 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:24.953174 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c187b3a-3adc-429c-8f77-30cfa4146034 None admin] RBAC: Adding query filter params (role.id=5feee6c423414badb9c65ac4076a7f45, scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9, user.id=3ce3d1957ee348a49c430d91e7e49b73) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:24.953485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c187b3a-3adc-429c-8f77-30cfa4146034 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:24.954468 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c185d-c5b0-4b82-978f-6d9a40228ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:24.954977 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c187b3a-3adc-429c-8f77-30cfa4146034 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:24.955272 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c185d-c5b0-4b82-978f-6d9a40228ddc None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:24.955650 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c185d-c5b0-4b82-978f-6d9a40228ddc None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:24.956023 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c185d-c5b0-4b82-978f-6d9a40228ddc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:24.956889 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c185d-c5b0-4b82-978f-6d9a40228ddc None admin] RBAC: Adding query filter params (role.id=17200f478f4f42afb0a4d42b5da2183d, scope.project.id=4faffe503d36427496bbea27ff5dfa19, user.id=3ce3d1957ee348a49c430d91e7e49b73) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:24.958108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c185d-c5b0-4b82-978f-6d9a40228ddc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:24.960026 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c185d-c5b0-4b82-978f-6d9a40228ddc None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:24.962301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 90/187] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:24 2022] GET /identity/v3/role_assignments?user.id=3ce3d1957ee348a49c430d91e7e49b73&scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9&role.id=5feee6c423414badb9c65ac4076a7f45 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:24.963172 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c187b3a-3adc-429c-8f77-30cfa4146034 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:24.977859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 98/188] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:24 2022] GET /identity/v3/role_assignments?user.id=3ce3d1957ee348a49c430d91e7e49b73&scope.project.id=4faffe503d36427496bbea27ff5dfa19&role.id=17200f478f4f42afb0a4d42b5da2183d => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:24.986744 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c185d-c5b0-4b82-978f-6d9a40228ddc None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:25.111009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c187b3a-3adc-429c-8f77-30cfa4146034 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:25.137627 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:25.172367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c090d-80f2-4b99-bbf1-00c6b7c43c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:25.173297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c090d-80f2-4b99-bbf1-00c6b7c43c1e None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:25.173728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c090d-80f2-4b99-bbf1-00c6b7c43c1e None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:25.174166 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c090d-80f2-4b99-bbf1-00c6b7c43c1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:25.175869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c090d-80f2-4b99-bbf1-00c6b7c43c1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:25.177580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c090d-80f2-4b99-bbf1-00c6b7c43c1e None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:25.189531 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 91/189] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:25.190833 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c090d-80f2-4b99-bbf1-00c6b7c43c1e None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:25.241300 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c185d-c5b0-4b82-978f-6d9a40228ddc None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:25.266381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:25.297752 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75fd99-540d-4d45-a941-f129f94f913d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:25.298759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75fd99-540d-4d45-a941-f129f94f913d None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:25.299046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75fd99-540d-4d45-a941-f129f94f913d None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:25.299323 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75fd99-540d-4d45-a941-f129f94f913d None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:25.300008 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75fd99-540d-4d45-a941-f129f94f913d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:25.300318 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75fd99-540d-4d45-a941-f129f94f913d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:25.302197 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75fd99-540d-4d45-a941-f129f94f913d None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:25.314243 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 99/190] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:25.315523 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75fd99-540d-4d45-a941-f129f94f913d None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:25.342510 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c090d-80f2-4b99-bbf1-00c6b7c43c1e None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:25.393261 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e50445-c864-456f-9bce-508fb913023a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:25.394148 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e50445-c864-456f-9bce-508fb913023a None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:25.394428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e50445-c864-456f-9bce-508fb913023a None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:25.395788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e50445-c864-456f-9bce-508fb913023a None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:25.396480 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e50445-c864-456f-9bce-508fb913023a None admin] RBAC: Adding query filter params (name=admin) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:25.396861 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e50445-c864-456f-9bce-508fb913023a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:25.398332 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e50445-c864-456f-9bce-508fb913023a None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:25.407029 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 92/191] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:25.407864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e50445-c864-456f-9bce-508fb913023a None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:25.437522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75fd99-540d-4d45-a941-f129f94f913d None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:25.455437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:25.472495 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26508a6e-a410-492c-915e-ee6e3e3a66f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:25.473338 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26508a6e-a410-492c-915e-ee6e3e3a66f8 None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:25.473625 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26508a6e-a410-492c-915e-ee6e3e3a66f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:25.474215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26508a6e-a410-492c-915e-ee6e3e3a66f8 None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:25.474653 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26508a6e-a410-492c-915e-ee6e3e3a66f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:25.476105 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26508a6e-a410-492c-915e-ee6e3e3a66f8 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:25.510698 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e50445-c864-456f-9bce-508fb913023a None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:25.544495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b427535-c3d0-4f95-a299-ed6d5c872dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:25.545122 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b427535-c3d0-4f95-a299-ed6d5c872dc7 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:25.545404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b427535-c3d0-4f95-a299-ed6d5c872dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:25.545679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b427535-c3d0-4f95-a299-ed6d5c872dc7 None admin] PATH_INFO: `/v3/users/a8acc723385a4baab3fcd86888df699d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:25.559664 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b427535-c3d0-4f95-a299-ed6d5c872dc7 None admin] RBAC: Authorizing `identity:get_user(user_id=a8acc723385a4baab3fcd86888df699d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:25.561134 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b427535-c3d0-4f95-a299-ed6d5c872dc7 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:25.562796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 93/192] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:25 2022] GET /identity/v3/users/a8acc723385a4baab3fcd86888df699d => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:25.563937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae51e1-ad27-447a-8227-7293bc46b8bf None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:25.564222 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae51e1-ad27-447a-8227-7293bc46b8bf None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:25.564499 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae51e1-ad27-447a-8227-7293bc46b8bf None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:25.565690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 94/193] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:25.566416 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae51e1-ad27-447a-8227-7293bc46b8bf None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:25.574561 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 100/194] 10.222.0.79 () {60 vars in 1132 bytes} [Fri Sep 2 21:01:25 2022] POST /identity/v3/users => generated 297 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:01:25.575679 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26508a6e-a410-492c-915e-ee6e3e3a66f8 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:25.634449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:25.689058 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae51e1-ad27-447a-8227-7293bc46b8bf None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:25.693118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:25.720622 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26508a6e-a410-492c-915e-ee6e3e3a66f8 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:25.735586 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef51412-5fe6-4516-a11f-3f371d3b8986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:25.736044 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef51412-5fe6-4516-a11f-3f371d3b8986 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:25.736334 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef51412-5fe6-4516-a11f-3f371d3b8986 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:25.736608 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef51412-5fe6-4516-a11f-3f371d3b8986 None admin] PATH_INFO: `/v3/users/a8acc723385a4baab3fcd86888df699d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:25.737976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef51412-5fe6-4516-a11f-3f371d3b8986 None admin] RBAC: Authorizing `identity:get_user(user_id=a8acc723385a4baab3fcd86888df699d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:25.740574 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef51412-5fe6-4516-a11f-3f371d3b8986 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:25.745897 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 95/195] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:25 2022] GET /identity/v3/users/a8acc723385a4baab3fcd86888df699d => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:25.745897 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb09c3-b522-4d3e-ae3b-047c8285eb67 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:25.745897 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb09c3-b522-4d3e-ae3b-047c8285eb67 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:25.745897 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb09c3-b522-4d3e-ae3b-047c8285eb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:25.766064 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27c80b-8f72-4e9c-87b1-a6359d21e635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:25.766685 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27c80b-8f72-4e9c-87b1-a6359d21e635 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:25.766963 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27c80b-8f72-4e9c-87b1-a6359d21e635 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:25.767238 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27c80b-8f72-4e9c-87b1-a6359d21e635 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:25.768849 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-57cb09c3-b522-4d3e-ae3b-047c8285eb67 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:25.770833 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-57cb09c3-b522-4d3e-ae3b-047c8285eb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:25.858343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 96/196] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:25.858941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27c80b-8f72-4e9c-87b1-a6359d21e635 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:25.859033 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb09c3-b522-4d3e-ae3b-047c8285eb67 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:25.859774 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27c80b-8f72-4e9c-87b1-a6359d21e635 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:25.907658 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:25.990296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 101/197] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:25.996380 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27c80b-8f72-4e9c-87b1-a6359d21e635 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:26.005110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb09c3-b522-4d3e-ae3b-047c8285eb67 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:26.006819 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:26.043839 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abb771-2c6a-4245-a79d-e8eed302525f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:26.044733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abb771-2c6a-4245-a79d-e8eed302525f None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:26.045088 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abb771-2c6a-4245-a79d-e8eed302525f None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:26.045462 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abb771-2c6a-4245-a79d-e8eed302525f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:26.117983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27c80b-8f72-4e9c-87b1-a6359d21e635 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:26.121395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abb771-2c6a-4245-a79d-e8eed302525f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:26.123042 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abb771-2c6a-4245-a79d-e8eed302525f None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:26.158403 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada88ca-914a-4093-b652-aa53da31984e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:26.159290 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada88ca-914a-4093-b652-aa53da31984e None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:26.159745 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada88ca-914a-4093-b652-aa53da31984e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:26.160227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada88ca-914a-4093-b652-aa53da31984e None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:26.161679 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada88ca-914a-4093-b652-aa53da31984e None admin] RBAC: Authorizing `identity:get_project(project_id=b3d0577467b84edf9244abafa997d81b)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:26.163341 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada88ca-914a-4093-b652-aa53da31984e None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:26.165210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 102/198] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:25 2022] GET /identity/v3/projects/b3d0577467b84edf9244abafa997d81b => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:26.169878 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada88ca-914a-4093-b652-aa53da31984e None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:26.186949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:26.249156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 97/199] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:26.249961 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abb771-2c6a-4245-a79d-e8eed302525f None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:26.252302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:26.297589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada88ca-914a-4093-b652-aa53da31984e None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:26.340838 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc328d84-c90b-4320-adb2-609b21f77fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:26.341507 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc328d84-c90b-4320-adb2-609b21f77fd3 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:26.341786 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc328d84-c90b-4320-adb2-609b21f77fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:26.342084 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc328d84-c90b-4320-adb2-609b21f77fd3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:26.354837 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc328d84-c90b-4320-adb2-609b21f77fd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:26.359907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-cc328d84-c90b-4320-adb2-609b21f77fd3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 21:01:26.359907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:26.359907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:26.359907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:26.359907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:26.359907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:26.359907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:26.359907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:26.359907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:26.359907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:26.359907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:26.359907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:26.359907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:26.359907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:26.359907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:26.359907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:26.360776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:26.360776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:26.360776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:26.360776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:26.360776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:26.360776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:26.360776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:26.360776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:26.360776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:26.360776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:26.360776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:26.360776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:26.360776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:26.360776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:26.360776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:26.360776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:26.361589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:26.361589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:26.361589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:26.361589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:26.361589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:26.361589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:26.361589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:26.361589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:26.361589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:26.361589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:26.361589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 21:01:26.361589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:26.361589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 103/200] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:01:26.362802 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc328d84-c90b-4320-adb2-609b21f77fd3 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:26.380562 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abb771-2c6a-4245-a79d-e8eed302525f None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:26.417766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbff58-df63-455d-bb1c-87f5455b6f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:26.418752 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbff58-df63-455d-bb1c-87f5455b6f34 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:26.419226 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbff58-df63-455d-bb1c-87f5455b6f34 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:26.419689 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbff58-df63-455d-bb1c-87f5455b6f34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:26.420598 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbff58-df63-455d-bb1c-87f5455b6f34 None admin] RBAC: Adding query filter params (role.id=5feee6c423414badb9c65ac4076a7f45, scope.project.id=b3d0577467b84edf9244abafa997d81b, user.id=a8acc723385a4baab3fcd86888df699d) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:26.421125 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbff58-df63-455d-bb1c-87f5455b6f34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:26.422777 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbff58-df63-455d-bb1c-87f5455b6f34 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:26.428737 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 98/201] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:26 2022] GET /identity/v3/role_assignments?user.id=a8acc723385a4baab3fcd86888df699d&scope.project.id=b3d0577467b84edf9244abafa997d81b&role.id=5feee6c423414badb9c65ac4076a7f45 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:26.429969 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbff58-df63-455d-bb1c-87f5455b6f34 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:26.439687 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:26.481758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc328d84-c90b-4320-adb2-609b21f77fd3 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:26.521448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:26.523683 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14595b4-8225-4926-aed4-a89653dd6f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:26.524595 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14595b4-8225-4926-aed4-a89653dd6f88 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:26.525012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14595b4-8225-4926-aed4-a89653dd6f88 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:26.525412 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14595b4-8225-4926-aed4-a89653dd6f88 None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:26.527003 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14595b4-8225-4926-aed4-a89653dd6f88 None admin] RBAC: Authorizing `identity:get_project(project_id=b3d0577467b84edf9244abafa997d81b)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:26.528639 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14595b4-8225-4926-aed4-a89653dd6f88 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:26.530575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 104/202] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:26 2022] GET /identity/v3/projects/b3d0577467b84edf9244abafa997d81b => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:26.539345 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14595b4-8225-4926-aed4-a89653dd6f88 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:26.608612 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbff58-df63-455d-bb1c-87f5455b6f34 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:26.665553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04046a1d-d47d-42e0-bf64-54f02cfb76fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:26.666502 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04046a1d-d47d-42e0-bf64-54f02cfb76fc None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:26.666783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04046a1d-d47d-42e0-bf64-54f02cfb76fc None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:26.667058 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04046a1d-d47d-42e0-bf64-54f02cfb76fc None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:26.667932 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04046a1d-d47d-42e0-bf64-54f02cfb76fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:26.668240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04046a1d-d47d-42e0-bf64-54f02cfb76fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:26.670529 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04046a1d-d47d-42e0-bf64-54f02cfb76fc None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:26.684437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 99/203] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:26.691097 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04046a1d-d47d-42e0-bf64-54f02cfb76fc None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:26.735396 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14595b4-8225-4926-aed4-a89653dd6f88 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:26.801560 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:26.811069 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158095cb-90e7-45af-aadb-b233e80bfa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:26.811683 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158095cb-90e7-45af-aadb-b233e80bfa5f None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:26.811961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158095cb-90e7-45af-aadb-b233e80bfa5f None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:26.812428 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158095cb-90e7-45af-aadb-b233e80bfa5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:26.812957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158095cb-90e7-45af-aadb-b233e80bfa5f None admin] RBAC: Adding query filter params (role.id=32e6a7f83b444d1ca9e5891a2b175f9a, scope.project.id=b3d0577467b84edf9244abafa997d81b, user.id=a8acc723385a4baab3fcd86888df699d) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:26.813265 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158095cb-90e7-45af-aadb-b233e80bfa5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:26.816294 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158095cb-90e7-45af-aadb-b233e80bfa5f None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:26.827925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 105/204] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:26 2022] GET /identity/v3/role_assignments?user.id=a8acc723385a4baab3fcd86888df699d&scope.project.id=b3d0577467b84edf9244abafa997d81b&role.id=32e6a7f83b444d1ca9e5891a2b175f9a => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:26.849574 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04046a1d-d47d-42e0-bf64-54f02cfb76fc None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:26.895219 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:26.905676 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fbee4-0c20-4c8b-b7cf-99da3dd62ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:26.906415 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fbee4-0c20-4c8b-b7cf-99da3dd62ae1 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:26.906700 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fbee4-0c20-4c8b-b7cf-99da3dd62ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:26.907026 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fbee4-0c20-4c8b-b7cf-99da3dd62ae1 None admin] PATH_INFO: `/v3/users/e117bc5a50954581a1b5f08f02e74823` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:26.914946 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fbee4-0c20-4c8b-b7cf-99da3dd62ae1 None admin] RBAC: Authorizing `identity:get_user(user_id=e117bc5a50954581a1b5f08f02e74823)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:26.916515 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fbee4-0c20-4c8b-b7cf-99da3dd62ae1 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:26.918282 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 100/205] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:26 2022] GET /identity/v3/users/e117bc5a50954581a1b5f08f02e74823 => generated 289 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:26.924376 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158095cb-90e7-45af-aadb-b233e80bfa5f None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:27.037681 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158095cb-90e7-45af-aadb-b233e80bfa5f None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:27.074917 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fdfff-24b2-4f80-a44a-bb2275e173fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:27.075452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fdfff-24b2-4f80-a44a-bb2275e173fc None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:27.075737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fdfff-24b2-4f80-a44a-bb2275e173fc None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:27.076038 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fdfff-24b2-4f80-a44a-bb2275e173fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:27.144717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:27.151781 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fdfff-24b2-4f80-a44a-bb2275e173fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:27.153249 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fdfff-24b2-4f80-a44a-bb2275e173fc None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:27.261787 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 106/206] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:27.271615 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fbee4-0c20-4c8b-b7cf-99da3dd62ae1 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:27.388373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fbee4-0c20-4c8b-b7cf-99da3dd62ae1 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:27.424221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebba5a-d587-40f1-9989-865109111b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:27.425228 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebba5a-d587-40f1-9989-865109111b40 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:27.425746 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebba5a-d587-40f1-9989-865109111b40 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:27.426409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebba5a-d587-40f1-9989-865109111b40 None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:27.427988 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebba5a-d587-40f1-9989-865109111b40 None admin] RBAC: Authorizing `identity:get_project(project_id=8ede2fe0b38f4061965d7dbc9aef29a9)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:27.429632 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebba5a-d587-40f1-9989-865109111b40 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:27.431488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 101/207] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:27 2022] GET /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:27.437304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fdfff-24b2-4f80-a44a-bb2275e173fc None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:27.549072 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:27.556490 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fdfff-24b2-4f80-a44a-bb2275e173fc None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:27.591365 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449037db-7139-47d8-88b2-7d45175bdd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:27.591991 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449037db-7139-47d8-88b2-7d45175bdd83 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:27.592278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449037db-7139-47d8-88b2-7d45175bdd83 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:27.592626 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449037db-7139-47d8-88b2-7d45175bdd83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:27.593379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449037db-7139-47d8-88b2-7d45175bdd83 None admin] RBAC: Adding query filter params (role.id=a11acb6c8a3e4c8b8673190a6bb021f7, scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9, user.id=e117bc5a50954581a1b5f08f02e74823) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:27.593704 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449037db-7139-47d8-88b2-7d45175bdd83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:27.595203 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449037db-7139-47d8-88b2-7d45175bdd83 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:27.603480 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 107/208] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:27 2022] GET /identity/v3/role_assignments?user.id=e117bc5a50954581a1b5f08f02e74823&scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9&role.id=a11acb6c8a3e4c8b8673190a6bb021f7 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:28.123252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad90421-b7c3-4bc7-a0e8-a630a1e57419 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:28.123749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad90421-b7c3-4bc7-a0e8-a630a1e57419 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:28.123826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad90421-b7c3-4bc7-a0e8-a630a1e57419 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:28.125745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 102/209] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:28.132464 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6f0b1-66b6-4c12-a159-8400a8591721 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:28.132956 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6f0b1-66b6-4c12-a159-8400a8591721 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:28.133063 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6f0b1-66b6-4c12-a159-8400a8591721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:28.156520 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-c2f6f0b1-66b6-4c12-a159-8400a8591721 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:28.159064 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-c2f6f0b1-66b6-4c12-a159-8400a8591721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:28.243199 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 108/210] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:28.319807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02068419-7712-486e-9e4a-9add5d31244d None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:28.320147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02068419-7712-486e-9e4a-9add5d31244d None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:28.320355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02068419-7712-486e-9e4a-9add5d31244d None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:28.321922 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 103/211] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:28.327742 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe79c4-7a9b-4f9e-ad70-3073b6a61cfb None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:28.328056 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe79c4-7a9b-4f9e-ad70-3073b6a61cfb None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:28.328300 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe79c4-7a9b-4f9e-ad70-3073b6a61cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:28.347706 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-a8fe79c4-7a9b-4f9e-ad70-3073b6a61cfb None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:28.349957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-a8fe79c4-7a9b-4f9e-ad70-3073b6a61cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:28.426191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 109/212] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:28.527530 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02068419-7712-486e-9e4a-9add5d31244d None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:28.598252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:28.641525 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02068419-7712-486e-9e4a-9add5d31244d None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:28.679376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa19023-bdca-43cb-9acb-94f382f82d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:28.679933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa19023-bdca-43cb-9acb-94f382f82d9b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:28.680212 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa19023-bdca-43cb-9acb-94f382f82d9b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:28.680485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa19023-bdca-43cb-9acb-94f382f82d9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:28.695149 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa19023-bdca-43cb-9acb-94f382f82d9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:28.702359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-bfa19023-bdca-43cb-9acb-94f382f82d9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:28.702359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:28.702359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:28.702359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:28.702359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:28.702359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:28.702359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:28.702359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:28.702359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:28.702359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:28.702359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:28.702359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:28.702359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:28.702359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:28.702359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:28.702359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:28.704812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:28.704812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:28.704812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:28.704812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:28.704812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:28.704812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:28.704812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:28.704812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:28.704812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:28.704812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:28.704812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:28.704812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:28.704812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:28.704812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:28.704812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:28.704812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:28.706766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:28.706766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:28.706766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:28.706766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:28.706766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:28.706766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:28.706766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:28.706766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:28.706766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:28.706766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:28.706766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:28.706766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:28.706766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 104/213] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:28.713911 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe79c4-7a9b-4f9e-ad70-3073b6a61cfb None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:28.721854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa19023-bdca-43cb-9acb-94f382f82d9b None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:28.737513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:28.838959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa19023-bdca-43cb-9acb-94f382f82d9b None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:28.845684 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe79c4-7a9b-4f9e-ad70-3073b6a61cfb None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:28.866785 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:28.879497 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001eefc-c9e5-4684-a4d6-c580b2af5cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:28.880832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001eefc-c9e5-4684-a4d6-c580b2af5cec None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:28.881383 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001eefc-c9e5-4684-a4d6-c580b2af5cec None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:28.881896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001eefc-c9e5-4684-a4d6-c580b2af5cec None admin] PATH_INFO: `/v3/domains/default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:28.883209 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001eefc-c9e5-4684-a4d6-c580b2af5cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:28.891296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001eefc-c9e5-4684-a4d6-c580b2af5cec None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:28.891296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 105/214] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:28.891471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40623e-e2c2-46c1-a3ca-1ca6025f5c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:28.891471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40623e-e2c2-46c1-a3ca-1ca6025f5c2c None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:28.891471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40623e-e2c2-46c1-a3ca-1ca6025f5c2c None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:28.891471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40623e-e2c2-46c1-a3ca-1ca6025f5c2c None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:28.891730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c40623e-e2c2-46c1-a3ca-1ca6025f5c2c None admin] RBAC: Adding query filter params (name=member) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:28.891793 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c40623e-e2c2-46c1-a3ca-1ca6025f5c2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:28.892858 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001eefc-c9e5-4684-a4d6-c580b2af5cec None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:28.893347 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c40623e-e2c2-46c1-a3ca-1ca6025f5c2c None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:28.905851 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 110/215] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:28.912088 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40623e-e2c2-46c1-a3ca-1ca6025f5c2c None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:29.001121 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:29.010407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001eefc-c9e5-4684-a4d6-c580b2af5cec None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:29.024137 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40623e-e2c2-46c1-a3ca-1ca6025f5c2c None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:29.047749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e408ed-c064-47d6-a5d2-6c66932bedc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:29.048362 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e408ed-c064-47d6-a5d2-6c66932bedc1 None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:29.048648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e408ed-c064-47d6-a5d2-6c66932bedc1 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:29.048924 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e408ed-c064-47d6-a5d2-6c66932bedc1 None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:29.049593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e408ed-c064-47d6-a5d2-6c66932bedc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:29.051149 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e408ed-c064-47d6-a5d2-6c66932bedc1 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:29.061886 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c58454-5e94-41cc-a3e9-f6a740722231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:29.062750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c58454-5e94-41cc-a3e9-f6a740722231 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:29.062859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c58454-5e94-41cc-a3e9-f6a740722231 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:29.063208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c58454-5e94-41cc-a3e9-f6a740722231 None admin] PATH_INFO: `/v3/users/9f12eb7e3b8b497a81ac57d96d3edcc7` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:29.081601 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c58454-5e94-41cc-a3e9-f6a740722231 None admin] RBAC: Authorizing `identity:get_user(user_id=9f12eb7e3b8b497a81ac57d96d3edcc7)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:29.084889 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c58454-5e94-41cc-a3e9-f6a740722231 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:29.086654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 111/216] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:28 2022] GET /identity/v3/users/9f12eb7e3b8b497a81ac57d96d3edcc7 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:29.087942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e366177-77e2-4be2-9091-ed460c88aa6b None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:29.088238 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e366177-77e2-4be2-9091-ed460c88aa6b None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:29.088513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e366177-77e2-4be2-9091-ed460c88aa6b None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:29.089941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 112/217] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:29.092229 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e366177-77e2-4be2-9091-ed460c88aa6b None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:29.205837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 106/218] 10.222.0.79 () {60 vars in 1132 bytes} [Fri Sep 2 21:01:28 2022] POST /identity/v3/users => generated 297 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:01:29.205837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ebcb5-995f-42fc-9ea4-86f55750d21e None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:29.205837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ebcb5-995f-42fc-9ea4-86f55750d21e None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:29.205837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ebcb5-995f-42fc-9ea4-86f55750d21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:29.210048 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e366177-77e2-4be2-9091-ed460c88aa6b None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:29.225622 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-761ebcb5-995f-42fc-9ea4-86f55750d21e None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:29.227208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-761ebcb5-995f-42fc-9ea4-86f55750d21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:29.252761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54861d9-af40-4ac0-9d43-ed6877b92610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:29.253304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54861d9-af40-4ac0-9d43-ed6877b92610 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:29.253583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54861d9-af40-4ac0-9d43-ed6877b92610 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:29.254463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54861d9-af40-4ac0-9d43-ed6877b92610 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:29.269217 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:29.294367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:29.331358 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 107/219] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:29.334319 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea578f-2699-48e2-95fe-edeffb9fa443 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:29.334855 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea578f-2699-48e2-95fe-edeffb9fa443 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:29.335373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea578f-2699-48e2-95fe-edeffb9fa443 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:29.339877 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 108/220] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:29.345077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0ba7e-90bd-4cc8-97e6-76c57662a7c9 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:29.345407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0ba7e-90bd-4cc8-97e6-76c57662a7c9 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:29.345645 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0ba7e-90bd-4cc8-97e6-76c57662a7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:29.354741 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54861d9-af40-4ac0-9d43-ed6877b92610 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:29.356330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54861d9-af40-4ac0-9d43-ed6877b92610 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:29.371760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-ecc0ba7e-90bd-4cc8-97e6-76c57662a7c9 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:29.372834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ecc0ba7e-90bd-4cc8-97e6-76c57662a7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:29.473444 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 109/221] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:01:29.511098 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 113/222] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:29.516638 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0ba7e-90bd-4cc8-97e6-76c57662a7c9 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:29.626530 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54861d9-af40-4ac0-9d43-ed6877b92610 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:29.635936 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0ba7e-90bd-4cc8-97e6-76c57662a7c9 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:29.650461 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:29.684644 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a4a25-3d0e-44d1-8caf-d81c4f0231fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:29.685529 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a4a25-3d0e-44d1-8caf-d81c4f0231fc None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:29.689629 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a4a25-3d0e-44d1-8caf-d81c4f0231fc None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:29.690194 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a4a25-3d0e-44d1-8caf-d81c4f0231fc None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:29.692468 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a4a25-3d0e-44d1-8caf-d81c4f0231fc None admin] RBAC: Authorizing `identity:get_project(project_id=b3d0577467b84edf9244abafa997d81b)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:29.694542 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:29.695697 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a4a25-3d0e-44d1-8caf-d81c4f0231fc None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:29.698574 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 110/223] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:29 2022] GET /identity/v3/projects/b3d0577467b84edf9244abafa997d81b => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:29.710427 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a4a25-3d0e-44d1-8caf-d81c4f0231fc None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:29.775841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54861d9-af40-4ac0-9d43-ed6877b92610 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:29.826639 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b7daa-b217-4d3a-9ee9-0dd38f476f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:29.827536 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b7daa-b217-4d3a-9ee9-0dd38f476f77 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:29.827991 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b7daa-b217-4d3a-9ee9-0dd38f476f77 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:29.828424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b7daa-b217-4d3a-9ee9-0dd38f476f77 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:29.842080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b7daa-b217-4d3a-9ee9-0dd38f476f77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:29.847208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-a01b7daa-b217-4d3a-9ee9-0dd38f476f77 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:29.847208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:29.847208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:29.847208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:29.847208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:29.847208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:29.847208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:29.847208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:29.847208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:29.847208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:29.847208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:29.847208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:29.847208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:29.847208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:29.847208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:29.847208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:29.848609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:29.848609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:29.848609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:29.848609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:29.848609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:29.848609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:29.848609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:29.848609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:29.848609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:29.848609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:29.848609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:29.848609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:29.848609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:29.848609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:29.848609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:29.848609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:29.849592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:29.849592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:29.849592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:29.849592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:29.849592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:29.849592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:29.849592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:29.849592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:29.849592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:29.849592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:29.849592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:29.849592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:29.851928 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 114/224] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Sep 2 21:01:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:29.852903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b7daa-b217-4d3a-9ee9-0dd38f476f77 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:29.890123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a4a25-3d0e-44d1-8caf-d81c4f0231fc None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:29.933398 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f85832-ced0-49f0-a7b6-454d5a99f281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:29.934148 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f85832-ced0-49f0-a7b6-454d5a99f281 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:29.934433 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f85832-ced0-49f0-a7b6-454d5a99f281 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:29.934704 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f85832-ced0-49f0-a7b6-454d5a99f281 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:29.935554 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f85832-ced0-49f0-a7b6-454d5a99f281 None admin] RBAC: Adding query filter params (role.id=17200f478f4f42afb0a4d42b5da2183d, scope.project.id=b3d0577467b84edf9244abafa997d81b, user.id=9f12eb7e3b8b497a81ac57d96d3edcc7) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:29.935868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f85832-ced0-49f0-a7b6-454d5a99f281 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:29.937323 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f85832-ced0-49f0-a7b6-454d5a99f281 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:29.944242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 111/225] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:29 2022] GET /identity/v3/role_assignments?user.id=9f12eb7e3b8b497a81ac57d96d3edcc7&scope.project.id=b3d0577467b84edf9244abafa997d81b&role.id=17200f478f4f42afb0a4d42b5da2183d => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:29.945220 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f85832-ced0-49f0-a7b6-454d5a99f281 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:29.993295 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:30.000080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:30.009122 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b7daa-b217-4d3a-9ee9-0dd38f476f77 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:30.063878 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f85832-ced0-49f0-a7b6-454d5a99f281 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:30.082827 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bdbcb-20c9-4717-b307-5b6544b02a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:30.083671 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bdbcb-20c9-4717-b307-5b6544b02a8b None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:30.084023 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bdbcb-20c9-4717-b307-5b6544b02a8b None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:30.084377 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bdbcb-20c9-4717-b307-5b6544b02a8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:30.106812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12395c98-fa63-4aed-b7c5-af153de19b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:30.107773 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12395c98-fa63-4aed-b7c5-af153de19b14 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:30.108380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12395c98-fa63-4aed-b7c5-af153de19b14 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:30.108856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12395c98-fa63-4aed-b7c5-af153de19b14 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:30.109753 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12395c98-fa63-4aed-b7c5-af153de19b14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:30.110300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12395c98-fa63-4aed-b7c5-af153de19b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:30.111936 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12395c98-fa63-4aed-b7c5-af153de19b14 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:30.112850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bdbcb-20c9-4717-b307-5b6544b02a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:30.118564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-a47bdbcb-20c9-4717-b307-5b6544b02a8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:30.118564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:30.118564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:30.118564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:30.118564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:30.118564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:30.118564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:30.118564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:30.118564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:30.118564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:30.118564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:30.118564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:30.118564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:30.118564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:30.118564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:30.118564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:30.119452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:30.119452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:30.119452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:30.119452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:30.119452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:30.119452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:30.119452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:30.119452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:30.119452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:30.119452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:30.119452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:30.119452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:30.119452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:30.119452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:30.119452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:30.119452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:30.120222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:30.120222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:30.120222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:30.120222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:30.120222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:30.120222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:30.120222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:30.120222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:30.120222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:30.120222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:30.120222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:30.120222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:30.120222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 115/226] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:01:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:30.130143 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bdbcb-20c9-4717-b307-5b6544b02a8b None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:30.131580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 112/227] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:30.143892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12395c98-fa63-4aed-b7c5-af153de19b14 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:30.319097 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bdbcb-20c9-4717-b307-5b6544b02a8b None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:30.336693 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12395c98-fa63-4aed-b7c5-af153de19b14 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:30.354095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:30.356384 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c30147-d409-4ff8-beaa-9a4d123154bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:30.356998 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c30147-d409-4ff8-beaa-9a4d123154bb None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:30.357278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c30147-d409-4ff8-beaa-9a4d123154bb None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:30.357554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c30147-d409-4ff8-beaa-9a4d123154bb None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:30.358612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c30147-d409-4ff8-beaa-9a4d123154bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:30.359113 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c30147-d409-4ff8-beaa-9a4d123154bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:30.360618 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c30147-d409-4ff8-beaa-9a4d123154bb None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:30.370728 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 116/228] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:30.378289 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c30147-d409-4ff8-beaa-9a4d123154bb None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:30.409288 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:30.436004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9c5ed-4760-4ecb-94cf-09ba8b247ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:30.436644 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9c5ed-4760-4ecb-94cf-09ba8b247ed0 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:30.436932 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9c5ed-4760-4ecb-94cf-09ba8b247ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:30.437215 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9c5ed-4760-4ecb-94cf-09ba8b247ed0 None admin] PATH_INFO: `/v3/users/a8acc723385a4baab3fcd86888df699d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:30.441666 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9c5ed-4760-4ecb-94cf-09ba8b247ed0 None admin] RBAC: Authorizing `identity:get_user(user_id=a8acc723385a4baab3fcd86888df699d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:30.443219 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9c5ed-4760-4ecb-94cf-09ba8b247ed0 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:30.445182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 113/229] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:30 2022] GET /identity/v3/users/a8acc723385a4baab3fcd86888df699d => generated 283 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:30.452366 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9c5ed-4760-4ecb-94cf-09ba8b247ed0 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:30.495405 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c30147-d409-4ff8-beaa-9a4d123154bb None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:30.562059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3005b-ddfc-4f54-824e-196e6b87cdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:30.563415 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3005b-ddfc-4f54-824e-196e6b87cdb6 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:30.563845 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3005b-ddfc-4f54-824e-196e6b87cdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:30.564139 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3005b-ddfc-4f54-824e-196e6b87cdb6 None admin] PATH_INFO: `/v3/users/a8acc723385a4baab3fcd86888df699d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:30.569966 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3005b-ddfc-4f54-824e-196e6b87cdb6 None admin] RBAC: Authorizing `identity:get_user(user_id=a8acc723385a4baab3fcd86888df699d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:30.569966 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3005b-ddfc-4f54-824e-196e6b87cdb6 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:30.570392 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 117/230] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:30 2022] GET /identity/v3/users/a8acc723385a4baab3fcd86888df699d => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:30.579476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3005b-ddfc-4f54-824e-196e6b87cdb6 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:30.687705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9c5ed-4760-4ecb-94cf-09ba8b247ed0 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:30.763382 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152b468-179f-452b-9161-ee8e7239c043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:30.764035 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152b468-179f-452b-9161-ee8e7239c043 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:30.764380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152b468-179f-452b-9161-ee8e7239c043 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:30.764669 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152b468-179f-452b-9161-ee8e7239c043 None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:30.767113 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152b468-179f-452b-9161-ee8e7239c043 None admin] RBAC: Authorizing `identity:get_project(project_id=b3d0577467b84edf9244abafa997d81b)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:30.768601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152b468-179f-452b-9161-ee8e7239c043 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:30.772636 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 114/231] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:30 2022] GET /identity/v3/projects/b3d0577467b84edf9244abafa997d81b => generated 302 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:30.780866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152b468-179f-452b-9161-ee8e7239c043 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:30.816950 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:30.833622 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3005b-ddfc-4f54-824e-196e6b87cdb6 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:30.861777 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:30.918318 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a653a-005e-41ef-ad2d-a7b4b27c080f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:30.918970 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a653a-005e-41ef-ad2d-a7b4b27c080f None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:30.919256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a653a-005e-41ef-ad2d-a7b4b27c080f None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:30.919539 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a653a-005e-41ef-ad2d-a7b4b27c080f None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:30.920909 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a653a-005e-41ef-ad2d-a7b4b27c080f None admin] RBAC: Authorizing `identity:get_project(project_id=b3d0577467b84edf9244abafa997d81b)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:30.923507 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a653a-005e-41ef-ad2d-a7b4b27c080f None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:30.935923 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 118/232] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:30 2022] GET /identity/v3/projects/b3d0577467b84edf9244abafa997d81b => generated 302 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:30.946978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a653a-005e-41ef-ad2d-a7b4b27c080f None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:30.993257 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152b468-179f-452b-9161-ee8e7239c043 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:31.045893 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd94d99-1c11-44eb-a1ce-bff35ead5f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:31.046570 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd94d99-1c11-44eb-a1ce-bff35ead5f9b None admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:31.048393 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd94d99-1c11-44eb-a1ce-bff35ead5f9b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:31.048677 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd94d99-1c11-44eb-a1ce-bff35ead5f9b None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b/users/a8acc723385a4baab3fcd86888df699d/roles/5feee6c423414badb9c65ac4076a7f45` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:31.052972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd94d99-1c11-44eb-a1ce-bff35ead5f9b None admin] RBAC: Authorizing `identity:create_grant(project_id=b3d0577467b84edf9244abafa997d81b, user_id=a8acc723385a4baab3fcd86888df699d, role_id=5feee6c423414badb9c65ac4076a7f45)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:31.054486 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd94d99-1c11-44eb-a1ce-bff35ead5f9b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:31.108535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a653a-005e-41ef-ad2d-a7b4b27c080f None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:31.138069 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 115/233] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:01:30 2022] PUT /identity/v3/projects/b3d0577467b84edf9244abafa997d81b/users/a8acc723385a4baab3fcd86888df699d/roles/5feee6c423414badb9c65ac4076a7f45 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:01:31.153200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c829307-631c-468e-aff2-95cf8a462f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:31.153922 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c829307-631c-468e-aff2-95cf8a462f22 None admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:31.154209 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c829307-631c-468e-aff2-95cf8a462f22 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:31.154488 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c829307-631c-468e-aff2-95cf8a462f22 None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b/users/a8acc723385a4baab3fcd86888df699d/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:31.156516 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c829307-631c-468e-aff2-95cf8a462f22 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3d0577467b84edf9244abafa997d81b, user_id=a8acc723385a4baab3fcd86888df699d, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:31.158089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c829307-631c-468e-aff2-95cf8a462f22 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:31.225254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 119/234] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:01:30 2022] PUT /identity/v3/projects/b3d0577467b84edf9244abafa997d81b/users/a8acc723385a4baab3fcd86888df699d/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:01:31.781391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb172709-50d0-44db-aa10-895df9aa6088 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:31.782381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb172709-50d0-44db-aa10-895df9aa6088 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:31.782876 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb172709-50d0-44db-aa10-895df9aa6088 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:31.784715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 116/235] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:31.791083 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8972d8a-7a29-4858-972f-4a11d4c54408 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:31.792007 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8972d8a-7a29-4858-972f-4a11d4c54408 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:31.792554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8972d8a-7a29-4858-972f-4a11d4c54408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:31.811836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-e8972d8a-7a29-4858-972f-4a11d4c54408 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:31.814114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e8972d8a-7a29-4858-972f-4a11d4c54408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:31.830268 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:31.931571 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 120/236] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:31.934148 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9323f0f-453d-4146-ae86-b258ce384b4a None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:31.934648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9323f0f-453d-4146-ae86-b258ce384b4a None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:31.935122 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9323f0f-453d-4146-ae86-b258ce384b4a None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:31.936846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 117/237] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:31.943423 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cef885-48bf-41de-ab9a-ded2d3697921 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:31.943677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cef885-48bf-41de-ab9a-ded2d3697921 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:31.943909 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cef885-48bf-41de-ab9a-ded2d3697921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:31.978832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-11cef885-48bf-41de-ab9a-ded2d3697921 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:31.980044 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-11cef885-48bf-41de-ab9a-ded2d3697921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:32.069553 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 121/238] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:01:32.255232 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9323f0f-453d-4146-ae86-b258ce384b4a None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:32.365548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:32.371296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9323f0f-453d-4146-ae86-b258ce384b4a None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:32.409553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f275fea-9f80-4983-9b03-bd6887e53f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:32.411261 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f275fea-9f80-4983-9b03-bd6887e53f63 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:32.411829 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f275fea-9f80-4983-9b03-bd6887e53f63 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:32.412298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f275fea-9f80-4983-9b03-bd6887e53f63 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:32.415071 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cef885-48bf-41de-ab9a-ded2d3697921 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:32.425517 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f275fea-9f80-4983-9b03-bd6887e53f63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:32.432511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-0f275fea-9f80-4983-9b03-bd6887e53f63 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 21:01:32.432511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:32.432511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:32.432511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:32.432511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:32.432511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:32.432511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:32.432511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:32.432511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:32.432511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:32.432511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:32.432511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:32.432511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:32.432511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:32.432511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:32.432511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:32.433418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:32.433418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:32.433418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:32.433418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:32.433418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:32.433418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:32.433418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:32.433418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:32.433418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:32.433418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:32.433418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:32.433418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:32.433418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:32.433418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:32.433418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:32.433418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:32.434230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:32.434230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:32.434230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:32.434230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:32.434230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:32.434230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:32.434230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:32.434230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:32.434230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:32.434230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:32.434230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 21:01:32.434230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:32.437029 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 118/239] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:32.443033 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f275fea-9f80-4983-9b03-bd6887e53f63 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:32.512090 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:32.536122 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cef885-48bf-41de-ab9a-ded2d3697921 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:32.589186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0a023-d8fa-422c-9063-257415a4c8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:32.589878 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0a023-d8fa-422c-9063-257415a4c8e7 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:32.590472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0a023-d8fa-422c-9063-257415a4c8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:32.590472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0a023-d8fa-422c-9063-257415a4c8e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:32.593781 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0a023-d8fa-422c-9063-257415a4c8e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:32.595277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0a023-d8fa-422c-9063-257415a4c8e7 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:32.596896 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 122/240] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:32.603290 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0a023-d8fa-422c-9063-257415a4c8e7 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:32.617735 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f275fea-9f80-4983-9b03-bd6887e53f63 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:32.657786 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed95143-4284-4b48-96e7-faf8e9e803ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:32.658824 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed95143-4284-4b48-96e7-faf8e9e803ed None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:32.659332 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed95143-4284-4b48-96e7-faf8e9e803ed None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:32.660421 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed95143-4284-4b48-96e7-faf8e9e803ed None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:32.661407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed95143-4284-4b48-96e7-faf8e9e803ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:32.662034 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed95143-4284-4b48-96e7-faf8e9e803ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:32.663871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed95143-4284-4b48-96e7-faf8e9e803ed None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:32.674047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 119/241] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:32.675909 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0de53-fcf9-4f35-b0e3-597bc34e852b None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:32.676561 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0de53-fcf9-4f35-b0e3-597bc34e852b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:32.677041 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0de53-fcf9-4f35-b0e3-597bc34e852b None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:32.678608 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 120/242] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:32.679677 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0de53-fcf9-4f35-b0e3-597bc34e852b None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:32.718156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:32.728686 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0a023-d8fa-422c-9063-257415a4c8e7 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:32.765663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2361c80-2e52-45bb-93be-7d8b0abc1629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:32.766665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2361c80-2e52-45bb-93be-7d8b0abc1629 None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:32.767189 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2361c80-2e52-45bb-93be-7d8b0abc1629 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:32.767676 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2361c80-2e52-45bb-93be-7d8b0abc1629 None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:32.768628 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2361c80-2e52-45bb-93be-7d8b0abc1629 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:32.771245 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2361c80-2e52-45bb-93be-7d8b0abc1629 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:32.809584 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0de53-fcf9-4f35-b0e3-597bc34e852b None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:32.846731 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc77ceb-e095-4164-b7ed-bc5ec53de16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:32.847937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc77ceb-e095-4164-b7ed-bc5ec53de16d None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:32.848198 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc77ceb-e095-4164-b7ed-bc5ec53de16d None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:32.848465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc77ceb-e095-4164-b7ed-bc5ec53de16d None admin] PATH_INFO: `/v3/users/0f04769042194faab8058ad4b27af890` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:32.862654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc77ceb-e095-4164-b7ed-bc5ec53de16d None admin] RBAC: Authorizing `identity:get_user(user_id=0f04769042194faab8058ad4b27af890)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:32.864793 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc77ceb-e095-4164-b7ed-bc5ec53de16d None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:32.866697 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 121/243] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:32 2022] GET /identity/v3/users/0f04769042194faab8058ad4b27af890 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:32.867708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4583fdf-5206-43f0-998d-92edaf64f9df None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:32.867992 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4583fdf-5206-43f0-998d-92edaf64f9df None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:32.868267 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4583fdf-5206-43f0-998d-92edaf64f9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:32.883574 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 123/244] 10.222.0.79 () {60 vars in 1132 bytes} [Fri Sep 2 21:01:32 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:01:32.884706 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2361c80-2e52-45bb-93be-7d8b0abc1629 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:32.888140 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:32.892578 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-d4583fdf-5206-43f0-998d-92edaf64f9df None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:32.894374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-d4583fdf-5206-43f0-998d-92edaf64f9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:32.995018 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 122/245] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:33.083099 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2361c80-2e52-45bb-93be-7d8b0abc1629 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:33.121148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309bddd-94ba-41dd-89ed-44964b259340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:33.122072 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309bddd-94ba-41dd-89ed-44964b259340 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:33.122494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309bddd-94ba-41dd-89ed-44964b259340 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:33.122930 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309bddd-94ba-41dd-89ed-44964b259340 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:33.201432 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309bddd-94ba-41dd-89ed-44964b259340 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:33.203170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309bddd-94ba-41dd-89ed-44964b259340 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:33.205551 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:33.313134 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 124/246] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:33.322158 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4583fdf-5206-43f0-998d-92edaf64f9df None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:33.334099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:33.355484 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309bddd-94ba-41dd-89ed-44964b259340 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:33.445264 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4583fdf-5206-43f0-998d-92edaf64f9df None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:33.468201 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309bddd-94ba-41dd-89ed-44964b259340 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:33.471375 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:33.485625 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f20f45-cd6d-4f59-b4b8-051226089052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:33.486307 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f20f45-cd6d-4f59-b4b8-051226089052 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:33.486588 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f20f45-cd6d-4f59-b4b8-051226089052 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:33.486863 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f20f45-cd6d-4f59-b4b8-051226089052 None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:33.488215 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f20f45-cd6d-4f59-b4b8-051226089052 None admin] RBAC: Authorizing `identity:get_project(project_id=b3d0577467b84edf9244abafa997d81b)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:33.489785 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f20f45-cd6d-4f59-b4b8-051226089052 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:33.491778 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 123/247] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:33 2022] GET /identity/v3/projects/b3d0577467b84edf9244abafa997d81b => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:33.498682 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f20f45-cd6d-4f59-b4b8-051226089052 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:33.512089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb53525-c924-4ebb-9c02-7a9829eee544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:33.513089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb53525-c924-4ebb-9c02-7a9829eee544 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:33.513589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb53525-c924-4ebb-9c02-7a9829eee544 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:33.514241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb53525-c924-4ebb-9c02-7a9829eee544 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:33.526863 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb53525-c924-4ebb-9c02-7a9829eee544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:33.532205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-4eb53525-c924-4ebb-9c02-7a9829eee544 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:33.532205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:33.532205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:33.532205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:33.532205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:33.532205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:33.532205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:33.532205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:33.532205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:33.532205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:33.532205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:33.532205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:33.532205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:33.532205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:33.532205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:33.532205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:33.533168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:33.533168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:33.533168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:33.533168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:33.533168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:33.533168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:33.533168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:33.533168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:33.533168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:33.533168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:33.533168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:33.533168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:33.533168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:33.533168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:33.533168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:33.533168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:33.533981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:33.533981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:33.533981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:33.533981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:33.533981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:33.533981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:33.533981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:33.533981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:33.533981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:33.533981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:33.533981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:33.533981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:33.536830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 125/248] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:01:33.542833 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb53525-c924-4ebb-9c02-7a9829eee544 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:33.594537 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:33.626375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f20f45-cd6d-4f59-b4b8-051226089052 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:33.671648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d968aad-6f87-481f-bf32-7cb8c4a5771d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:33.672264 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d968aad-6f87-481f-bf32-7cb8c4a5771d None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:33.672548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d968aad-6f87-481f-bf32-7cb8c4a5771d None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:33.672830 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d968aad-6f87-481f-bf32-7cb8c4a5771d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:33.673511 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb53525-c924-4ebb-9c02-7a9829eee544 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:33.673615 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d968aad-6f87-481f-bf32-7cb8c4a5771d None admin] RBAC: Adding query filter params (role.id=a11acb6c8a3e4c8b8673190a6bb021f7, scope.project.id=b3d0577467b84edf9244abafa997d81b, user.id=0f04769042194faab8058ad4b27af890) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:33.673906 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d968aad-6f87-481f-bf32-7cb8c4a5771d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:33.675551 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d968aad-6f87-481f-bf32-7cb8c4a5771d None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:33.681864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 124/249] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:33 2022] GET /identity/v3/role_assignments?user.id=0f04769042194faab8058ad4b27af890&scope.project.id=b3d0577467b84edf9244abafa997d81b&role.id=a11acb6c8a3e4c8b8673190a6bb021f7 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:33.683583 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0427604-a1f2-4e38-926e-385b1f43642a None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:33.683583 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0427604-a1f2-4e38-926e-385b1f43642a None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:33.683773 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0427604-a1f2-4e38-926e-385b1f43642a None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:33.686325 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 125/250] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:33.693733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22f052-0c13-4590-bb7c-1857488b515d None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:33.693973 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22f052-0c13-4590-bb7c-1857488b515d None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:33.694230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22f052-0c13-4590-bb7c-1857488b515d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:33.718959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-0f22f052-0c13-4590-bb7c-1857488b515d None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:33.720180 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-0f22f052-0c13-4590-bb7c-1857488b515d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:33.758088 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b73088-7fb0-42cb-bd8e-c3e5b8ac41cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:33.758721 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b73088-7fb0-42cb-bd8e-c3e5b8ac41cc None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:33.759071 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b73088-7fb0-42cb-bd8e-c3e5b8ac41cc None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:33.759272 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b73088-7fb0-42cb-bd8e-c3e5b8ac41cc None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:33.759951 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b73088-7fb0-42cb-bd8e-c3e5b8ac41cc None admin] RBAC: Adding query filter params (name=member) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:33.760258 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b73088-7fb0-42cb-bd8e-c3e5b8ac41cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:33.761629 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b73088-7fb0-42cb-bd8e-c3e5b8ac41cc None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:33.782598 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 126/251] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:33.788942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b73088-7fb0-42cb-bd8e-c3e5b8ac41cc None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:33.800802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 126/252] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:01:33.848399 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:33.888341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878ebfd-949c-41e3-8304-2cefaffc40a8 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:33.888856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878ebfd-949c-41e3-8304-2cefaffc40a8 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:33.888969 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878ebfd-949c-41e3-8304-2cefaffc40a8 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:33.890521 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 127/253] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:33.897476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13936c8-4a7a-4efe-af1c-c8df1f159151 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:33.897973 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13936c8-4a7a-4efe-af1c-c8df1f159151 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:33.898256 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13936c8-4a7a-4efe-af1c-c8df1f159151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:33.935126 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-d13936c8-4a7a-4efe-af1c-c8df1f159151 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:33.936539 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-d13936c8-4a7a-4efe-af1c-c8df1f159151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:33.981761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b73088-7fb0-42cb-bd8e-c3e5b8ac41cc None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:34.058751 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a8906-086f-4cf6-bda7-3dbacd252d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:34.059768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a8906-086f-4cf6-bda7-3dbacd252d74 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:34.060339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a8906-086f-4cf6-bda7-3dbacd252d74 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:34.061059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:34.061343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a8906-086f-4cf6-bda7-3dbacd252d74 None admin] PATH_INFO: `/v3/users/9f12eb7e3b8b497a81ac57d96d3edcc7` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:34.066094 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 128/254] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:34.067184 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a8906-086f-4cf6-bda7-3dbacd252d74 None admin] RBAC: Authorizing `identity:get_user(user_id=9f12eb7e3b8b497a81ac57d96d3edcc7)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:34.068678 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a8906-086f-4cf6-bda7-3dbacd252d74 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:34.070751 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 127/255] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:33 2022] GET /identity/v3/users/9f12eb7e3b8b497a81ac57d96d3edcc7 => generated 297 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:34.076264 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13936c8-4a7a-4efe-af1c-c8df1f159151 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:34.211319 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13936c8-4a7a-4efe-af1c-c8df1f159151 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:34.260762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8feb70-25c2-42fb-99ea-454b1772f530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:34.261411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8feb70-25c2-42fb-99ea-454b1772f530 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:34.261696 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8feb70-25c2-42fb-99ea-454b1772f530 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:34.262001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8feb70-25c2-42fb-99ea-454b1772f530 None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:34.263130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8feb70-25c2-42fb-99ea-454b1772f530 None admin] RBAC: Authorizing `identity:get_project(project_id=b3d0577467b84edf9244abafa997d81b)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:34.264602 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8feb70-25c2-42fb-99ea-454b1772f530 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:34.266709 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 129/256] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:34 2022] GET /identity/v3/projects/b3d0577467b84edf9244abafa997d81b => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:34.275091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a8906-086f-4cf6-bda7-3dbacd252d74 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:34.370275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8feb70-25c2-42fb-99ea-454b1772f530 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:34.429026 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:34.443735 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a8906-086f-4cf6-bda7-3dbacd252d74 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:34.502260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:34.527278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459f31a-b702-4984-8f58-d6d578aa0446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:34.528008 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459f31a-b702-4984-8f58-d6d578aa0446 None admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:34.528296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459f31a-b702-4984-8f58-d6d578aa0446 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:34.528569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459f31a-b702-4984-8f58-d6d578aa0446 None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b/users/9f12eb7e3b8b497a81ac57d96d3edcc7/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:34.533981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459f31a-b702-4984-8f58-d6d578aa0446 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3d0577467b84edf9244abafa997d81b, user_id=9f12eb7e3b8b497a81ac57d96d3edcc7, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:34.535688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459f31a-b702-4984-8f58-d6d578aa0446 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:34.566708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8feb70-25c2-42fb-99ea-454b1772f530 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:34.606200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7df199-fbd7-4aa9-b6be-321658455577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:34.606838 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7df199-fbd7-4aa9-b6be-321658455577 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:34.607120 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7df199-fbd7-4aa9-b6be-321658455577 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:34.607392 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7df199-fbd7-4aa9-b6be-321658455577 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:34.629375 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 128/257] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:01:34 2022] PUT /identity/v3/projects/b3d0577467b84edf9244abafa997d81b/users/9f12eb7e3b8b497a81ac57d96d3edcc7/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:01:34.633255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459f31a-b702-4984-8f58-d6d578aa0446 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:34.636857 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7df199-fbd7-4aa9-b6be-321658455577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:34.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-ab7df199-fbd7-4aa9-b6be-321658455577 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:34.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:34.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:34.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:34.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:34.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:34.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:34.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:34.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:34.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:34.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:34.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:34.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:34.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:34.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:34.648352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:34.649285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:34.649285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:34.649285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:34.649285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:34.649285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:34.649285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:34.649285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:34.649285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:34.649285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:34.649285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:34.649285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:34.649285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:34.649285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:34.649285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:34.649285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:34.649285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:34.650157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:34.650157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:34.650157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:34.650157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:34.650157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:34.650157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:34.650157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:34.650157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:34.650157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:34.650157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:34.650157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:34.650157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:34.651252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 130/258] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:01:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:34.658928 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7df199-fbd7-4aa9-b6be-321658455577 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:34.870322 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459f31a-b702-4984-8f58-d6d578aa0446 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:34.875800 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7df199-fbd7-4aa9-b6be-321658455577 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:34.915447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088c903-4d06-41d9-b53c-849271624174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:34.916097 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088c903-4d06-41d9-b53c-849271624174 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:34.916383 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088c903-4d06-41d9-b53c-849271624174 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:34.916660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088c903-4d06-41d9-b53c-849271624174 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:34.930182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088c903-4d06-41d9-b53c-849271624174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:34.935439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-9088c903-4d06-41d9-b53c-849271624174 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:34.935439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:34.935439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:34.935439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:34.935439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:34.935439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:34.935439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:34.935439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:34.935439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:34.935439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:34.935439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:34.935439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:34.935439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:34.935439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:34.935439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:34.935439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:34.936379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:34.936379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:34.936379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:34.936379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:34.936379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:34.936379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:34.936379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:34.936379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:34.936379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:34.936379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:34.936379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:34.936379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:34.936379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:34.936379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:34.936379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:34.936379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:34.938089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:34.938089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:34.938089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:34.938089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:34.938089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:34.938089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:34.938089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:34.938089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:34.938089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:34.938089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:34.938089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:34.938089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:34.938089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 129/259] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Sep 2 21:01:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:01:34.949730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088c903-4d06-41d9-b53c-849271624174 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:34.971237 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:34.974616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:34.986852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62785f70-aedc-4cf8-ae1d-4eeaea37bb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:34.987458 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62785f70-aedc-4cf8-ae1d-4eeaea37bb4e None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:34.987773 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62785f70-aedc-4cf8-ae1d-4eeaea37bb4e None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:34.988207 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62785f70-aedc-4cf8-ae1d-4eeaea37bb4e None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:34.988911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62785f70-aedc-4cf8-ae1d-4eeaea37bb4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:34.989280 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62785f70-aedc-4cf8-ae1d-4eeaea37bb4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:34.990700 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62785f70-aedc-4cf8-ae1d-4eeaea37bb4e None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:35.002650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 131/260] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:35.011984 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62785f70-aedc-4cf8-ae1d-4eeaea37bb4e None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:35.143446 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088c903-4d06-41d9-b53c-849271624174 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:35.206622 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756d4b1-9d68-4b47-b392-7eb1489ee8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:35.208896 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756d4b1-9d68-4b47-b392-7eb1489ee8e7 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:35.209176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756d4b1-9d68-4b47-b392-7eb1489ee8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:35.209447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756d4b1-9d68-4b47-b392-7eb1489ee8e7 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:35.210919 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756d4b1-9d68-4b47-b392-7eb1489ee8e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:35.211230 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756d4b1-9d68-4b47-b392-7eb1489ee8e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:35.213211 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756d4b1-9d68-4b47-b392-7eb1489ee8e7 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:35.217303 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62785f70-aedc-4cf8-ae1d-4eeaea37bb4e None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:35.232761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 130/261] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:35.243060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756d4b1-9d68-4b47-b392-7eb1489ee8e7 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:35.303197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f045f7a-b37d-4d60-b298-34f61b180a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:35.303841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f045f7a-b37d-4d60-b298-34f61b180a9a None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:35.304121 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f045f7a-b37d-4d60-b298-34f61b180a9a None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:35.304394 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f045f7a-b37d-4d60-b298-34f61b180a9a None admin] PATH_INFO: `/v3/users/a8acc723385a4baab3fcd86888df699d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:35.306370 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f045f7a-b37d-4d60-b298-34f61b180a9a None admin] RBAC: Authorizing `identity:get_user(user_id=a8acc723385a4baab3fcd86888df699d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:35.307855 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f045f7a-b37d-4d60-b298-34f61b180a9a None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:35.309680 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 132/262] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:35 2022] GET /identity/v3/users/a8acc723385a4baab3fcd86888df699d => generated 283 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:35.317344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f045f7a-b37d-4d60-b298-34f61b180a9a None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:35.407154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:35.452933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:35.468014 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756d4b1-9d68-4b47-b392-7eb1489ee8e7 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:35.550923 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f045f7a-b37d-4d60-b298-34f61b180a9a None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:35.561208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ead8cf-f8de-4f32-9bad-1286c0b7fd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:35.561948 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ead8cf-f8de-4f32-9bad-1286c0b7fd0d None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:35.562229 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ead8cf-f8de-4f32-9bad-1286c0b7fd0d None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:35.562549 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ead8cf-f8de-4f32-9bad-1286c0b7fd0d None admin] PATH_INFO: `/v3/users/a8acc723385a4baab3fcd86888df699d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:35.563744 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ead8cf-f8de-4f32-9bad-1286c0b7fd0d None admin] RBAC: Authorizing `identity:get_user(user_id=a8acc723385a4baab3fcd86888df699d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:35.569846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ead8cf-f8de-4f32-9bad-1286c0b7fd0d None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:35.569846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 131/263] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:35 2022] GET /identity/v3/users/a8acc723385a4baab3fcd86888df699d => generated 283 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:35.578879 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ead8cf-f8de-4f32-9bad-1286c0b7fd0d None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:35.670581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3cdb0-1d97-4975-911a-4b5e48fbe6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:35.671586 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3cdb0-1d97-4975-911a-4b5e48fbe6bb None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:35.672167 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3cdb0-1d97-4975-911a-4b5e48fbe6bb None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:35.672671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3cdb0-1d97-4975-911a-4b5e48fbe6bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:35.757716 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ead8cf-f8de-4f32-9bad-1286c0b7fd0d None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:35.824982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3cdb0-1d97-4975-911a-4b5e48fbe6bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:35.832668 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3cdb0-1d97-4975-911a-4b5e48fbe6bb None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:35.842537 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47ca7c-4aea-4be0-85bf-d4e83babaf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:35.843536 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47ca7c-4aea-4be0-85bf-d4e83babaf27 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:35.844016 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47ca7c-4aea-4be0-85bf-d4e83babaf27 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:35.844486 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47ca7c-4aea-4be0-85bf-d4e83babaf27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:35.875412 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:35.947035 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:35.987517 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 133/264] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:35.988956 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f4dc9-9a56-4097-8437-47607b5d8b83 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:35.989325 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f4dc9-9a56-4097-8437-47607b5d8b83 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:35.989603 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f4dc9-9a56-4097-8437-47607b5d8b83 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:35.991263 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 134/265] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:35.999117 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41ab57-2cae-49f3-8acc-b8c96552abae None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:35.999426 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41ab57-2cae-49f3-8acc-b8c96552abae None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:35.999680 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41ab57-2cae-49f3-8acc-b8c96552abae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:36.020007 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-dd41ab57-2cae-49f3-8acc-b8c96552abae None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:36.021217 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-dd41ab57-2cae-49f3-8acc-b8c96552abae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:36.021667 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47ca7c-4aea-4be0-85bf-d4e83babaf27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:36.023486 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47ca7c-4aea-4be0-85bf-d4e83babaf27 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:36.095369 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 135/266] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:36.096311 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41ab57-2cae-49f3-8acc-b8c96552abae None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:36.186035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 132/267] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:36.192352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47ca7c-4aea-4be0-85bf-d4e83babaf27 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:36.266240 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:36.287209 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:36.307715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41ab57-2cae-49f3-8acc-b8c96552abae None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:36.376505 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f138fb8-52f3-4bbf-9947-315e6df5916c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:36.378762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f138fb8-52f3-4bbf-9947-315e6df5916c None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:36.379051 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f138fb8-52f3-4bbf-9947-315e6df5916c None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:36.379330 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f138fb8-52f3-4bbf-9947-315e6df5916c None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:36.381322 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f138fb8-52f3-4bbf-9947-315e6df5916c None admin] RBAC: Authorizing `identity:get_project(project_id=b3d0577467b84edf9244abafa997d81b)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:36.383563 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f138fb8-52f3-4bbf-9947-315e6df5916c None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:36.385393 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 136/268] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:36 2022] GET /identity/v3/projects/b3d0577467b84edf9244abafa997d81b => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:36.387588 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47ca7c-4aea-4be0-85bf-d4e83babaf27 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:36.391522 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce529d3-1737-4d27-a88e-09c0e365fe77 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:36.391812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce529d3-1737-4d27-a88e-09c0e365fe77 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:36.392094 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce529d3-1737-4d27-a88e-09c0e365fe77 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:36.393515 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 137/269] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:36.398228 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce529d3-1737-4d27-a88e-09c0e365fe77 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:36.452527 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b9603-9791-4cc0-9add-6d1b9680197b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:36.453176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b9603-9791-4cc0-9add-6d1b9680197b None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:36.453459 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b9603-9791-4cc0-9add-6d1b9680197b None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:36.453738 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b9603-9791-4cc0-9add-6d1b9680197b None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:36.454918 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b9603-9791-4cc0-9add-6d1b9680197b None admin] RBAC: Authorizing `identity:get_project(project_id=b3d0577467b84edf9244abafa997d81b)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:36.456962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b9603-9791-4cc0-9add-6d1b9680197b None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:36.463876 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 133/270] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:36 2022] GET /identity/v3/projects/b3d0577467b84edf9244abafa997d81b => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:36.465235 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfc0e6-84c2-4d46-91ce-4411d07e2ef5 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:36.465531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfc0e6-84c2-4d46-91ce-4411d07e2ef5 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:36.465833 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfc0e6-84c2-4d46-91ce-4411d07e2ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:36.486780 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-dbcfc0e6-84c2-4d46-91ce-4411d07e2ef5 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:36.489009 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-dbcfc0e6-84c2-4d46-91ce-4411d07e2ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:36.588927 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce529d3-1737-4d27-a88e-09c0e365fe77 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:36.595484 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 134/271] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:36.598036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfc0e6-84c2-4d46-91ce-4411d07e2ef5 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:36.630646 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa51247-4aeb-4493-89e2-44220420aa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:36.631365 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa51247-4aeb-4493-89e2-44220420aa3c None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:36.631649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa51247-4aeb-4493-89e2-44220420aa3c None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:36.631926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa51247-4aeb-4493-89e2-44220420aa3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:36.632658 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa51247-4aeb-4493-89e2-44220420aa3c None admin] RBAC: Adding query filter params (role.id=32e6a7f83b444d1ca9e5891a2b175f9a, scope.project.id=b3d0577467b84edf9244abafa997d81b, user.id=a8acc723385a4baab3fcd86888df699d) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:36.632968 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa51247-4aeb-4493-89e2-44220420aa3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:36.634457 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa51247-4aeb-4493-89e2-44220420aa3c None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:36.641255 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 138/272] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:36 2022] GET /identity/v3/role_assignments?user.id=a8acc723385a4baab3fcd86888df699d&scope.project.id=b3d0577467b84edf9244abafa997d81b&role.id=32e6a7f83b444d1ca9e5891a2b175f9a => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:36.642240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa51247-4aeb-4493-89e2-44220420aa3c None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:36.658408 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:36.670587 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:36.755535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfc0e6-84c2-4d46-91ce-4411d07e2ef5 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:36.782506 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa51247-4aeb-4493-89e2-44220420aa3c None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:36.807121 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f395f7d-1ea7-47dc-ad0f-6881fc60feb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:36.807758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f395f7d-1ea7-47dc-ad0f-6881fc60feb5 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:36.808042 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f395f7d-1ea7-47dc-ad0f-6881fc60feb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:36.808319 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f395f7d-1ea7-47dc-ad0f-6881fc60feb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:36.809105 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f395f7d-1ea7-47dc-ad0f-6881fc60feb5 None admin] RBAC: Adding query filter params (role.id=5feee6c423414badb9c65ac4076a7f45, scope.project.id=b3d0577467b84edf9244abafa997d81b, user.id=a8acc723385a4baab3fcd86888df699d) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:36.809419 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f395f7d-1ea7-47dc-ad0f-6881fc60feb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:36.810896 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f395f7d-1ea7-47dc-ad0f-6881fc60feb5 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:36.820209 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 135/273] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:36 2022] GET /identity/v3/role_assignments?user.id=a8acc723385a4baab3fcd86888df699d&scope.project.id=b3d0577467b84edf9244abafa997d81b&role.id=5feee6c423414badb9c65ac4076a7f45 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:36.821874 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a7dca-f331-412f-9a2e-49982d2ed9c6 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:36.822168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a7dca-f331-412f-9a2e-49982d2ed9c6 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:36.822747 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a7dca-f331-412f-9a2e-49982d2ed9c6 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:36.824341 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 136/274] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:36.830539 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17415031-5f8e-4b1c-9ee5-c494c790a89e None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:36.830859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17415031-5f8e-4b1c-9ee5-c494c790a89e None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:36.831346 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17415031-5f8e-4b1c-9ee5-c494c790a89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:36.842873 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0efa6-4f9d-4429-95c5-92dd23de599e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:36.843454 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0efa6-4f9d-4429-95c5-92dd23de599e None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:36.843742 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0efa6-4f9d-4429-95c5-92dd23de599e None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:36.844017 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0efa6-4f9d-4429-95c5-92dd23de599e None admin] PATH_INFO: `/v3/roles/member` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:36.870725 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-17415031-5f8e-4b1c-9ee5-c494c790a89e None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:36.871972 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-17415031-5f8e-4b1c-9ee5-c494c790a89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:36.875017 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0efa6-4f9d-4429-95c5-92dd23de599e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:36.880650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-29f0efa6-4f9d-4429-95c5-92dd23de599e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:36.880650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:36.880650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:36.880650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:36.880650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:36.880650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:36.880650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:36.880650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:36.880650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:36.880650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:36.880650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:36.880650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:36.880650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:36.880650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:36.880650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:36.880650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:36.881606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:36.881606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:36.881606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:36.881606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:36.881606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:36.881606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:36.881606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:36.881606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:36.881606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:36.881606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:36.881606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:36.881606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:36.881606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:36.881606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:36.881606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:36.881606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:36.882524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:36.882524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:36.882524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:36.882524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:36.882524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:36.882524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:36.882524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:36.882524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:36.882524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:36.882524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:36.882524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:36.882524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:36.882524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 139/275] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:36.896238 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0efa6-4f9d-4429-95c5-92dd23de599e None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:36.978533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 137/276] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:37.023461 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17415031-5f8e-4b1c-9ee5-c494c790a89e None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:37.052456 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:37.078157 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:37.085755 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0efa6-4f9d-4429-95c5-92dd23de599e None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:37.132194 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da0de2-1400-4bfc-9c21-d1173746ae53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:37.132731 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da0de2-1400-4bfc-9c21-d1173746ae53 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:37.133689 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da0de2-1400-4bfc-9c21-d1173746ae53 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:37.133996 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da0de2-1400-4bfc-9c21-d1173746ae53 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:37.134677 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da0de2-1400-4bfc-9c21-d1173746ae53 None admin] RBAC: Adding query filter params (name=member) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:37.135255 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da0de2-1400-4bfc-9c21-d1173746ae53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:37.136917 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da0de2-1400-4bfc-9c21-d1173746ae53 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:37.148363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 140/277] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:37.154874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da0de2-1400-4bfc-9c21-d1173746ae53 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:37.193241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17415031-5f8e-4b1c-9ee5-c494c790a89e None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:37.240133 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e0da7-3af3-4ce5-bd5c-b73ecb191c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:37.241126 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e0da7-3af3-4ce5-bd5c-b73ecb191c83 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:37.241646 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e0da7-3af3-4ce5-bd5c-b73ecb191c83 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:37.242159 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e0da7-3af3-4ce5-bd5c-b73ecb191c83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:37.243502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e0da7-3af3-4ce5-bd5c-b73ecb191c83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:37.245140 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e0da7-3af3-4ce5-bd5c-b73ecb191c83 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:37.247003 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 138/278] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:37.252757 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e0da7-3af3-4ce5-bd5c-b73ecb191c83 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:37.289550 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da0de2-1400-4bfc-9c21-d1173746ae53 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:37.341869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba738a-52ac-4658-bb7b-236d99fb5f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:37.342504 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba738a-52ac-4658-bb7b-236d99fb5f38 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:37.342794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba738a-52ac-4658-bb7b-236d99fb5f38 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:37.343075 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba738a-52ac-4658-bb7b-236d99fb5f38 None admin] PATH_INFO: `/v3/users/0b0685d3016d4287a25e8dc98ca9b3d4` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:37.356932 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:37.359255 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba738a-52ac-4658-bb7b-236d99fb5f38 None admin] RBAC: Authorizing `identity:get_user(user_id=0b0685d3016d4287a25e8dc98ca9b3d4)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:37.360762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba738a-52ac-4658-bb7b-236d99fb5f38 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:37.362600 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 141/279] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:37 2022] GET /identity/v3/users/0b0685d3016d4287a25e8dc98ca9b3d4 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:37.363524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba738a-52ac-4658-bb7b-236d99fb5f38 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:37.381694 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e0da7-3af3-4ce5-bd5c-b73ecb191c83 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:37.384269 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:37.423726 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c242634-368c-4676-8306-6cd8f2018ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:37.424356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c242634-368c-4676-8306-6cd8f2018ffa None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:37.424640 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c242634-368c-4676-8306-6cd8f2018ffa None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:37.425081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c242634-368c-4676-8306-6cd8f2018ffa None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:37.425771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c242634-368c-4676-8306-6cd8f2018ffa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:37.427292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c242634-368c-4676-8306-6cd8f2018ffa None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:37.474919 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba738a-52ac-4658-bb7b-236d99fb5f38 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:37.512979 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b224c2-6352-4e64-b877-ad4dca070e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:37.513613 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b224c2-6352-4e64-b877-ad4dca070e95 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:37.513923 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b224c2-6352-4e64-b877-ad4dca070e95 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:37.514200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b224c2-6352-4e64-b877-ad4dca070e95 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:37.525792 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b224c2-6352-4e64-b877-ad4dca070e95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:37.530722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-93b224c2-6352-4e64-b877-ad4dca070e95 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 21:01:37.530722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:37.530722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:37.530722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:37.530722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:37.530722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:37.530722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:37.530722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:37.530722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:37.530722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:37.530722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:37.530722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:37.530722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:37.530722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:37.530722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:37.530722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:37.531805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:37.531805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:37.531805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:37.531805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:37.531805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:37.531805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:37.531805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:37.531805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:37.531805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:37.531805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:37.531805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:37.531805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:37.531805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:37.531805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:37.531805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:37.531805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:37.532661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:37.532661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:37.532661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:37.532661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:37.532661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:37.532661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:37.532661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:37.532661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:37.532661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:37.532661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:37.532661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 21:01:37.532661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:37.532661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 142/280] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:37.533312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b224c2-6352-4e64-b877-ad4dca070e95 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:37.556539 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 139/281] 10.222.0.79 () {60 vars in 1132 bytes} [Fri Sep 2 21:01:37 2022] POST /identity/v3/users => generated 293 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:01:37.556539 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c242634-368c-4676-8306-6cd8f2018ffa None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:37.608107 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:37.658204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b224c2-6352-4e64-b877-ad4dca070e95 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:37.684110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c242634-368c-4676-8306-6cd8f2018ffa None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:37.700703 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96f346-63f9-463b-807b-759e9a9623cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:37.701330 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96f346-63f9-463b-807b-759e9a9623cf None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:37.701615 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96f346-63f9-463b-807b-759e9a9623cf None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:37.701941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96f346-63f9-463b-807b-759e9a9623cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:37.705041 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96f346-63f9-463b-807b-759e9a9623cf None admin] RBAC: Adding query filter params (role.id=17200f478f4f42afb0a4d42b5da2183d, user.id=0b0685d3016d4287a25e8dc98ca9b3d4, scope.system=all) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:37.705041 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96f346-63f9-463b-807b-759e9a9623cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:37.705041 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96f346-63f9-463b-807b-759e9a9623cf None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:37.711498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 143/282] 10.222.0.79 () {56 vars in 1308 bytes} [Fri Sep 2 21:01:37 2022] GET /identity/v3/role_assignments?user.id=0b0685d3016d4287a25e8dc98ca9b3d4&scope.system=all&role.id=17200f478f4f42afb0a4d42b5da2183d => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:37.711498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290b088-b42a-4416-819f-18708ea79502 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:37.711498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290b088-b42a-4416-819f-18708ea79502 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:37.711498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290b088-b42a-4416-819f-18708ea79502 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:37.714844 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 144/283] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:37.720716 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d372359-13fb-4545-a006-f77e09aed795 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:37.721002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d372359-13fb-4545-a006-f77e09aed795 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:37.721282 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d372359-13fb-4545-a006-f77e09aed795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:37.745004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-1d372359-13fb-4545-a006-f77e09aed795 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:37.746152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108cee8-e9b1-4e1b-8539-b61042760dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:37.746290 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-1d372359-13fb-4545-a006-f77e09aed795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:37.747123 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108cee8-e9b1-4e1b-8539-b61042760dff None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:37.747566 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108cee8-e9b1-4e1b-8539-b61042760dff None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:37.748029 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108cee8-e9b1-4e1b-8539-b61042760dff None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:37.749387 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108cee8-e9b1-4e1b-8539-b61042760dff None admin] RBAC: Adding query filter params (name=reader) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:37.750977 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108cee8-e9b1-4e1b-8539-b61042760dff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:37.752584 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108cee8-e9b1-4e1b-8539-b61042760dff None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:37.766849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 140/284] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:37.774173 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108cee8-e9b1-4e1b-8539-b61042760dff None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:37.806943 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:37.839455 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 145/285] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:37.905781 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108cee8-e9b1-4e1b-8539-b61042760dff None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:37.945546 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcaca3-c541-48d7-8907-a2ed4240497a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:37.946282 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcaca3-c541-48d7-8907-a2ed4240497a None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:37.946560 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcaca3-c541-48d7-8907-a2ed4240497a None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:37.946834 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcaca3-c541-48d7-8907-a2ed4240497a None admin] PATH_INFO: `/v3/users/0f04769042194faab8058ad4b27af890` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:37.947983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcaca3-c541-48d7-8907-a2ed4240497a None admin] RBAC: Authorizing `identity:get_user(user_id=0f04769042194faab8058ad4b27af890)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:37.949420 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcaca3-c541-48d7-8907-a2ed4240497a None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:37.951423 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 141/286] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:37 2022] GET /identity/v3/users/0f04769042194faab8058ad4b27af890 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:37.958172 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d372359-13fb-4545-a006-f77e09aed795 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:38.028912 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:38.082849 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d372359-13fb-4545-a006-f77e09aed795 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:38.122768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e437fe-ff4b-4fda-8d5c-20ee3bef5e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:38.123415 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e437fe-ff4b-4fda-8d5c-20ee3bef5e5c None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:38.123695 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e437fe-ff4b-4fda-8d5c-20ee3bef5e5c None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:38.123967 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e437fe-ff4b-4fda-8d5c-20ee3bef5e5c None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:38.126361 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e437fe-ff4b-4fda-8d5c-20ee3bef5e5c None admin] RBAC: Authorizing `identity:get_project(project_id=b3d0577467b84edf9244abafa997d81b)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:38.127816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e437fe-ff4b-4fda-8d5c-20ee3bef5e5c None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:38.131028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 146/287] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:37 2022] GET /identity/v3/projects/b3d0577467b84edf9244abafa997d81b => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:38.137263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcaca3-c541-48d7-8907-a2ed4240497a None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:38.140503 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e437fe-ff4b-4fda-8d5c-20ee3bef5e5c None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:38.241138 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:38.254488 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcaca3-c541-48d7-8907-a2ed4240497a None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:38.254675 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e437fe-ff4b-4fda-8d5c-20ee3bef5e5c None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:38.279782 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:38.299317 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea1f9f-7a71-44b0-bf1d-c05c250cc77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:38.300741 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea1f9f-7a71-44b0-bf1d-c05c250cc77e None admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:38.301079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea1f9f-7a71-44b0-bf1d-c05c250cc77e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:38.301365 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea1f9f-7a71-44b0-bf1d-c05c250cc77e None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b/users/0f04769042194faab8058ad4b27af890/roles/a11acb6c8a3e4c8b8673190a6bb021f7` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:38.302556 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df952232-fcce-4a0e-b837-590fbb774492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:38.303206 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df952232-fcce-4a0e-b837-590fbb774492 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:38.303491 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df952232-fcce-4a0e-b837-590fbb774492 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:38.303768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df952232-fcce-4a0e-b837-590fbb774492 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:38.306094 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea1f9f-7a71-44b0-bf1d-c05c250cc77e None admin] RBAC: Authorizing `identity:create_grant(project_id=b3d0577467b84edf9244abafa997d81b, user_id=0f04769042194faab8058ad4b27af890, role_id=a11acb6c8a3e4c8b8673190a6bb021f7)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:38.308643 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea1f9f-7a71-44b0-bf1d-c05c250cc77e None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:38.321343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df952232-fcce-4a0e-b837-590fbb774492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:38.326699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-df952232-fcce-4a0e-b837-590fbb774492 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:38.326699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:38.326699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:38.326699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:38.326699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:38.326699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:38.326699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:38.326699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:38.326699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:38.326699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:38.326699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:38.326699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:38.326699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:38.326699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:38.326699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:38.326699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:38.328885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:38.328885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:38.328885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:38.328885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:38.328885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:38.328885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:38.328885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:38.328885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:38.328885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:38.328885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:38.328885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:38.328885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:38.328885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:38.328885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:38.328885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:38.328885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:38.330268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:38.330268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:38.330268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:38.330268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:38.330268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:38.330268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:38.330268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:38.330268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:38.330268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:38.330268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:38.330268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:38.330268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:38.330268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 147/288] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:01:38.334992 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df952232-fcce-4a0e-b837-590fbb774492 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:38.427680 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 142/289] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:01:38 2022] PUT /identity/v3/projects/b3d0577467b84edf9244abafa997d81b/users/0f04769042194faab8058ad4b27af890/roles/a11acb6c8a3e4c8b8673190a6bb021f7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:01:38.452967 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df952232-fcce-4a0e-b837-590fbb774492 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:38.501627 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3463f-4a5b-4df5-b6fc-976ab78d85c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:38.502210 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3463f-4a5b-4df5-b6fc-976ab78d85c5 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:38.502497 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3463f-4a5b-4df5-b6fc-976ab78d85c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:38.502773 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3463f-4a5b-4df5-b6fc-976ab78d85c5 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:38.503520 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3463f-4a5b-4df5-b6fc-976ab78d85c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:38.503826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3463f-4a5b-4df5-b6fc-976ab78d85c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:38.505268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3463f-4a5b-4df5-b6fc-976ab78d85c5 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:38.515595 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 148/290] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:38.521986 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea1f9f-7a71-44b0-bf1d-c05c250cc77e None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:38.657863 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea1f9f-7a71-44b0-bf1d-c05c250cc77e None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:38.698086 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc1ce3-91e8-448a-827e-70414198cd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:38.698734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc1ce3-91e8-448a-827e-70414198cd0e None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:38.699018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc1ce3-91e8-448a-827e-70414198cd0e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:38.699295 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc1ce3-91e8-448a-827e-70414198cd0e None admin] PATH_INFO: `/v3/users/9f12eb7e3b8b497a81ac57d96d3edcc7` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:38.700448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc1ce3-91e8-448a-827e-70414198cd0e None admin] RBAC: Authorizing `identity:get_user(user_id=9f12eb7e3b8b497a81ac57d96d3edcc7)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:38.701905 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc1ce3-91e8-448a-827e-70414198cd0e None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:38.703791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 143/291] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:38 2022] GET /identity/v3/users/9f12eb7e3b8b497a81ac57d96d3edcc7 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:38.710968 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3463f-4a5b-4df5-b6fc-976ab78d85c5 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:38.775539 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:38.837857 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3463f-4a5b-4df5-b6fc-976ab78d85c5 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:38.879911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e586f1-39f8-487b-af2d-3b360a543318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:38.880529 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e586f1-39f8-487b-af2d-3b360a543318 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:38.880810 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e586f1-39f8-487b-af2d-3b360a543318 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:38.881085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e586f1-39f8-487b-af2d-3b360a543318 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:38.973323 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e586f1-39f8-487b-af2d-3b360a543318 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:38.975029 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e586f1-39f8-487b-af2d-3b360a543318 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:39.026991 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:39.108542 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 149/292] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:39.118919 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc1ce3-91e8-448a-827e-70414198cd0e None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:39.144014 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:39.274026 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc1ce3-91e8-448a-827e-70414198cd0e None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:39.320602 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680dc50-13c5-44f1-ba95-e85091abccb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:39.321172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680dc50-13c5-44f1-ba95-e85091abccb7 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:39.321455 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680dc50-13c5-44f1-ba95-e85091abccb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:39.321736 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680dc50-13c5-44f1-ba95-e85091abccb7 None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:39.322936 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680dc50-13c5-44f1-ba95-e85091abccb7 None admin] RBAC: Authorizing `identity:get_project(project_id=b3d0577467b84edf9244abafa997d81b)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:39.324371 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680dc50-13c5-44f1-ba95-e85091abccb7 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:39.326039 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 144/293] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:39 2022] GET /identity/v3/projects/b3d0577467b84edf9244abafa997d81b => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:39.333217 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e586f1-39f8-487b-af2d-3b360a543318 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:39.474427 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e586f1-39f8-487b-af2d-3b360a543318 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:39.509512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6650a-82ad-41f8-9179-7385adfd2742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:39.510155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6650a-82ad-41f8-9179-7385adfd2742 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:39.510442 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6650a-82ad-41f8-9179-7385adfd2742 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:39.510718 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6650a-82ad-41f8-9179-7385adfd2742 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:39.511451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6650a-82ad-41f8-9179-7385adfd2742 None admin] RBAC: Adding query filter params (role.id=17200f478f4f42afb0a4d42b5da2183d, scope.project.id=b3d0577467b84edf9244abafa997d81b, user.id=9f12eb7e3b8b497a81ac57d96d3edcc7) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:39.511765 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6650a-82ad-41f8-9179-7385adfd2742 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:39.513202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6650a-82ad-41f8-9179-7385adfd2742 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:39.519767 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 150/294] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:39 2022] GET /identity/v3/role_assignments?user.id=9f12eb7e3b8b497a81ac57d96d3edcc7&scope.project.id=b3d0577467b84edf9244abafa997d81b&role.id=17200f478f4f42afb0a4d42b5da2183d => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:40.133563 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3816e-c274-4327-a912-f5c8099f110c None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:40.134300 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3816e-c274-4327-a912-f5c8099f110c None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:40.134792 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3816e-c274-4327-a912-f5c8099f110c None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:40.136672 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 145/295] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:40.142663 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920ff2f-1ff4-4870-83e8-a5cee969ef23 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:40.143618 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920ff2f-1ff4-4870-83e8-a5cee969ef23 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:40.144408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920ff2f-1ff4-4870-83e8-a5cee969ef23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:40.164547 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8691d9-bf73-48ac-8384-beb921019060 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:40.164547 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8691d9-bf73-48ac-8384-beb921019060 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:40.164547 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8691d9-bf73-48ac-8384-beb921019060 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:40.165197 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 146/296] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:40.167380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-7920ff2f-1ff4-4870-83e8-a5cee969ef23 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:40.168649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-7920ff2f-1ff4-4870-83e8-a5cee969ef23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:40.170768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d7e37-656a-47d1-8e4a-385996752d2d None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:40.170922 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:40.171042 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d7e37-656a-47d1-8e4a-385996752d2d None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:40.171526 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d7e37-656a-47d1-8e4a-385996752d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:40.192745 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-bb7d7e37-656a-47d1-8e4a-385996752d2d None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:40.194409 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-bb7d7e37-656a-47d1-8e4a-385996752d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:40.250873 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 151/297] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:40.252481 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af796d-27fc-4fec-82f6-5eeb5f49be32 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:40.253118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af796d-27fc-4fec-82f6-5eeb5f49be32 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:40.253575 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af796d-27fc-4fec-82f6-5eeb5f49be32 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:40.255782 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 152/298] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:40.262099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c8fe4-553f-4020-97fe-b71ef13c852d None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:40.262571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c8fe4-553f-4020-97fe-b71ef13c852d None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:40.263272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c8fe4-553f-4020-97fe-b71ef13c852d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:40.272925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 147/299] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:01:40.283435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-105c8fe4-553f-4020-97fe-b71ef13c852d None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:40.285351 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-105c8fe4-553f-4020-97fe-b71ef13c852d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:40.361125 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 153/300] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:40.525154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d7e37-656a-47d1-8e4a-385996752d2d None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:40.541502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:40.560672 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c8fe4-553f-4020-97fe-b71ef13c852d None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:40.639326 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:40.648461 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d7e37-656a-47d1-8e4a-385996752d2d None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:40.674423 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c8fe4-553f-4020-97fe-b71ef13c852d None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:40.686154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a01a16-43c1-4135-97db-4ca96a41a163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:40.687036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a01a16-43c1-4135-97db-4ca96a41a163 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:40.687328 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a01a16-43c1-4135-97db-4ca96a41a163 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:40.687611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a01a16-43c1-4135-97db-4ca96a41a163 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:40.699862 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a01a16-43c1-4135-97db-4ca96a41a163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:40.704858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-d1a01a16-43c1-4135-97db-4ca96a41a163 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:40.704858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:40.704858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:40.704858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:40.704858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:40.704858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:40.704858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:40.704858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:40.704858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:40.704858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:40.704858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:40.704858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:40.704858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:40.704858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:40.704858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:40.704858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:40.706339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:40.706339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:40.706339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:40.706339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:40.706339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:40.706339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:40.706339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:40.706339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:40.706339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:40.706339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:40.706339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:40.706339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:40.706339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:40.706339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:40.706339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:40.706339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:40.707450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:40.707450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:40.707450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:40.707450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:40.707450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:40.707450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:40.707450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:40.707450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:40.707450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:40.707450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:40.707450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:40.707450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:40.707450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 148/301] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:40.713976 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a01a16-43c1-4135-97db-4ca96a41a163 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:40.724229 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234d28c-dfed-4a75-b531-4582daf7d9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:40.725144 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234d28c-dfed-4a75-b531-4582daf7d9d5 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:40.725427 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234d28c-dfed-4a75-b531-4582daf7d9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:40.725699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234d28c-dfed-4a75-b531-4582daf7d9d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:40.736493 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234d28c-dfed-4a75-b531-4582daf7d9d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:40.741864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-2234d28c-dfed-4a75-b531-4582daf7d9d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 21:01:40.741864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:40.741864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:40.741864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:40.741864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:40.741864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:40.741864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:40.741864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:40.741864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:40.741864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:40.741864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:40.741864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:40.741864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:40.741864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:40.741864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:40.741864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:40.742734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:40.742734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:40.742734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:40.742734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:40.742734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:40.742734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:40.742734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:40.742734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:40.742734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:40.742734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:40.742734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:40.742734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:40.742734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:40.742734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:40.742734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:40.742734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:40.748471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:40.748471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:40.748471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:40.748471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:40.748471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:40.748471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:40.748471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:40.748471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:40.748471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:40.748471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:40.748471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 21:01:40.748471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:40.748471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 154/302] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:01:40.748471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234d28c-dfed-4a75-b531-4582daf7d9d5 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:40.816239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:40.845869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a01a16-43c1-4135-97db-4ca96a41a163 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:40.859013 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234d28c-dfed-4a75-b531-4582daf7d9d5 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:40.884420 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27168555-5956-41d2-acaf-1c403de4a969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:40.885175 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27168555-5956-41d2-acaf-1c403de4a969 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:40.885464 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27168555-5956-41d2-acaf-1c403de4a969 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:40.885818 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27168555-5956-41d2-acaf-1c403de4a969 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:40.886975 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27168555-5956-41d2-acaf-1c403de4a969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:40.887109 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:40.888434 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27168555-5956-41d2-acaf-1c403de4a969 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:40.890044 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 149/303] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:40.896197 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27168555-5956-41d2-acaf-1c403de4a969 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:40.900639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a24284-c207-4831-b9a7-b847d5f8a2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:40.900639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a24284-c207-4831-b9a7-b847d5f8a2c0 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:40.900639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a24284-c207-4831-b9a7-b847d5f8a2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:40.900639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a24284-c207-4831-b9a7-b847d5f8a2c0 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:40.900949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a24284-c207-4831-b9a7-b847d5f8a2c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:40.900949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a24284-c207-4831-b9a7-b847d5f8a2c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:40.900949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a24284-c207-4831-b9a7-b847d5f8a2c0 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:40.914341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 155/304] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:40.914341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a24284-c207-4831-b9a7-b847d5f8a2c0 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:41.017782 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a24284-c207-4831-b9a7-b847d5f8a2c0 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:41.018379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27168555-5956-41d2-acaf-1c403de4a969 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:41.058639 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097e2dd-3714-4d29-bb21-632b9f8f49d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:41.058859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2e917-3865-4065-90e0-dedaa188a073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:41.059263 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2e917-3865-4065-90e0-dedaa188a073 None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:41.059407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097e2dd-3714-4d29-bb21-632b9f8f49d2 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:41.059540 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097e2dd-3714-4d29-bb21-632b9f8f49d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:41.059632 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2e917-3865-4065-90e0-dedaa188a073 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:41.059810 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2e917-3865-4065-90e0-dedaa188a073 None admin] PATH_INFO: `/v3/groups` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:41.059897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097e2dd-3714-4d29-bb21-632b9f8f49d2 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:41.060448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2e917-3865-4065-90e0-dedaa188a073 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:41.060535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097e2dd-3714-4d29-bb21-632b9f8f49d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:41.060774 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097e2dd-3714-4d29-bb21-632b9f8f49d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:41.061940 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2e917-3865-4065-90e0-dedaa188a073 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:41.062167 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097e2dd-3714-4d29-bb21-632b9f8f49d2 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:41.071700 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 150/305] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:41.072506 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097e2dd-3714-4d29-bb21-632b9f8f49d2 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:41.077447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:41.153521 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 156/306] 10.222.0.79 () {60 vars in 1134 bytes} [Fri Sep 2 21:01:40 2022] POST /identity/v3/groups => generated 229 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:01:41.154850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26818ab4-e437-437d-9de3-93df63408be2 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:41.155140 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26818ab4-e437-437d-9de3-93df63408be2 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:41.155411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26818ab4-e437-437d-9de3-93df63408be2 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:41.157893 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 157/307] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:41.157893 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26818ab4-e437-437d-9de3-93df63408be2 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:41.181800 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097e2dd-3714-4d29-bb21-632b9f8f49d2 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:41.228213 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcf8e8-20a5-41c3-947b-67b12cbcc458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:41.229180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcf8e8-20a5-41c3-947b-67b12cbcc458 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:41.229287 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:41.229364 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcf8e8-20a5-41c3-947b-67b12cbcc458 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:41.229547 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcf8e8-20a5-41c3-947b-67b12cbcc458 None admin] PATH_INFO: `/v3/users/0b0685d3016d4287a25e8dc98ca9b3d4` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:41.230846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcf8e8-20a5-41c3-947b-67b12cbcc458 None admin] RBAC: Authorizing `identity:get_user(user_id=0b0685d3016d4287a25e8dc98ca9b3d4)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:41.232354 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcf8e8-20a5-41c3-947b-67b12cbcc458 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:41.239900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 151/308] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:41 2022] GET /identity/v3/users/0b0685d3016d4287a25e8dc98ca9b3d4 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:41.239900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0ae37-c0ef-4659-b645-b36f1ba31958 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:41.239900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0ae37-c0ef-4659-b645-b36f1ba31958 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:41.239900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0ae37-c0ef-4659-b645-b36f1ba31958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:41.255743 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-ffb0ae37-c0ef-4659-b645-b36f1ba31958 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:41.256971 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ffb0ae37-c0ef-4659-b645-b36f1ba31958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:41.295891 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26818ab4-e437-437d-9de3-93df63408be2 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:41.334948 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 152/309] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:41.335550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0ae37-c0ef-4659-b645-b36f1ba31958 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:41.338080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:41.339774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c749004-97e0-4c9a-b752-50be64ccbb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:41.340648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c749004-97e0-4c9a-b752-50be64ccbb25 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:41.340930 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c749004-97e0-4c9a-b752-50be64ccbb25 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:41.341205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c749004-97e0-4c9a-b752-50be64ccbb25 None admin] PATH_INFO: `/v3/users/86b1602be35246e3b2227d2391cc29a0` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:41.358872 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c749004-97e0-4c9a-b752-50be64ccbb25 None admin] RBAC: Authorizing `identity:get_user(user_id=86b1602be35246e3b2227d2391cc29a0)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:41.361195 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c749004-97e0-4c9a-b752-50be64ccbb25 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:41.363902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 158/310] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:41 2022] GET /identity/v3/users/86b1602be35246e3b2227d2391cc29a0 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:41.370663 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c749004-97e0-4c9a-b752-50be64ccbb25 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:41.451406 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0ae37-c0ef-4659-b645-b36f1ba31958 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:41.491634 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bf2c7-8fca-4710-bd7e-6b3b960749dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:41.492349 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bf2c7-8fca-4710-bd7e-6b3b960749dd None admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:41.492701 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bf2c7-8fca-4710-bd7e-6b3b960749dd None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:41.493046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bf2c7-8fca-4710-bd7e-6b3b960749dd None admin] PATH_INFO: `/v3/system/users/0b0685d3016d4287a25e8dc98ca9b3d4/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:41.494822 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bf2c7-8fca-4710-bd7e-6b3b960749dd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0b0685d3016d4287a25e8dc98ca9b3d4, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:41.496278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bf2c7-8fca-4710-bd7e-6b3b960749dd None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:41.501492 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c749004-97e0-4c9a-b752-50be64ccbb25 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:41.512473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:41.538624 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8c3b8-8f19-43a4-86a8-93f8908498b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:41.539228 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8c3b8-8f19-43a4-86a8-93f8908498b8 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:41.539512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8c3b8-8f19-43a4-86a8-93f8908498b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:41.539789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8c3b8-8f19-43a4-86a8-93f8908498b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:41.540519 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8c3b8-8f19-43a4-86a8-93f8908498b8 None admin] RBAC: Adding query filter params (role.id=a11acb6c8a3e4c8b8673190a6bb021f7, user.id=86b1602be35246e3b2227d2391cc29a0, scope.system=all) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:41.540832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8c3b8-8f19-43a4-86a8-93f8908498b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:41.542330 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8c3b8-8f19-43a4-86a8-93f8908498b8 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:41.548054 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 159/311] 10.222.0.79 () {56 vars in 1308 bytes} [Fri Sep 2 21:01:41 2022] GET /identity/v3/role_assignments?user.id=86b1602be35246e3b2227d2391cc29a0&scope.system=all&role.id=a11acb6c8a3e4c8b8673190a6bb021f7 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:41.614977 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 153/312] 10.222.0.79 () {58 vars in 1334 bytes} [Fri Sep 2 21:01:41 2022] PUT /identity/v3/system/users/0b0685d3016d4287a25e8dc98ca9b3d4/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:01:41.620286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8c3b8-8f19-43a4-86a8-93f8908498b8 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:41.755168 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8c3b8-8f19-43a4-86a8-93f8908498b8 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:41.794228 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951bf97-eb92-448d-97b4-7655f7451f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:41.794896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951bf97-eb92-448d-97b4-7655f7451f47 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:41.795171 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951bf97-eb92-448d-97b4-7655f7451f47 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:41.795440 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951bf97-eb92-448d-97b4-7655f7451f47 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:41.816509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b951bf97-eb92-448d-97b4-7655f7451f47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:41.821866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-b951bf97-eb92-448d-97b4-7655f7451f47 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 21:01:41.821866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:41.821866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:41.821866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:41.821866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:41.821866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:41.821866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:41.821866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:41.821866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:41.821866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:41.821866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:41.821866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:41.821866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:41.821866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:41.821866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:41.821866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:41.822804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:41.822804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:41.822804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:41.822804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:41.822804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:41.822804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:41.822804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:41.822804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:41.822804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:41.822804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:41.822804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:41.822804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:41.822804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:41.822804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:41.822804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:41.822804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:41.823827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:41.823827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:41.823827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:41.823827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:41.823827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:41.823827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:41.823827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:41.823827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:41.823827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:41.823827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:41.823827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 21:01:41.823827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:41.823827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 160/313] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:41.828944 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bf2c7-8fca-4710-bd7e-6b3b960749dd None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:41.906303 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:41.942323 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bf2c7-8fca-4710-bd7e-6b3b960749dd None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:41.979742 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af7ae0-01ae-4c98-922a-c44a5090d8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:41.980748 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af7ae0-01ae-4c98-922a-c44a5090d8d3 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:41.981230 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af7ae0-01ae-4c98-922a-c44a5090d8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:41.981702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af7ae0-01ae-4c98-922a-c44a5090d8d3 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:41.982608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af7ae0-01ae-4c98-922a-c44a5090d8d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:41.983342 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af7ae0-01ae-4c98-922a-c44a5090d8d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:41.985176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af7ae0-01ae-4c98-922a-c44a5090d8d3 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:41.995375 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 154/314] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:42.000553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951bf97-eb92-448d-97b4-7655f7451f47 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:42.034869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:42.112010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951bf97-eb92-448d-97b4-7655f7451f47 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:42.151617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16c5b7-5b63-45b9-845d-d3c3c9028ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:42.152614 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16c5b7-5b63-45b9-845d-d3c3c9028ad3 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:42.153099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16c5b7-5b63-45b9-845d-d3c3c9028ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:42.153573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16c5b7-5b63-45b9-845d-d3c3c9028ad3 None admin] PATH_INFO: `/v3/users/0f04769042194faab8058ad4b27af890` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:42.155502 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16c5b7-5b63-45b9-845d-d3c3c9028ad3 None admin] RBAC: Authorizing `identity:get_user(user_id=0f04769042194faab8058ad4b27af890)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:42.157350 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16c5b7-5b63-45b9-845d-d3c3c9028ad3 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:42.159750 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 161/315] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:41 2022] GET /identity/v3/users/0f04769042194faab8058ad4b27af890 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:42.165708 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af7ae0-01ae-4c98-922a-c44a5090d8d3 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:42.278582 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af7ae0-01ae-4c98-922a-c44a5090d8d3 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:42.308112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:42.316432 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4300d-b5da-4849-b268-5dae3f67d208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:42.317051 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4300d-b5da-4849-b268-5dae3f67d208 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:42.317334 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4300d-b5da-4849-b268-5dae3f67d208 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:42.317614 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4300d-b5da-4849-b268-5dae3f67d208 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:42.407931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4300d-b5da-4849-b268-5dae3f67d208 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:42.410115 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4300d-b5da-4849-b268-5dae3f67d208 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:42.514846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 155/316] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:42.521430 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16c5b7-5b63-45b9-845d-d3c3c9028ad3 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:42.634608 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:42.637684 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16c5b7-5b63-45b9-845d-d3c3c9028ad3 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:42.674947 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2c458-729e-4dd2-a39c-26dcdfb4d053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:42.675596 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2c458-729e-4dd2-a39c-26dcdfb4d053 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:42.675991 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2c458-729e-4dd2-a39c-26dcdfb4d053 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:42.676273 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2c458-729e-4dd2-a39c-26dcdfb4d053 None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:42.677444 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2c458-729e-4dd2-a39c-26dcdfb4d053 None admin] RBAC: Authorizing `identity:get_project(project_id=b3d0577467b84edf9244abafa997d81b)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:42.678924 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2c458-729e-4dd2-a39c-26dcdfb4d053 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:42.680578 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 162/317] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:42 2022] GET /identity/v3/projects/b3d0577467b84edf9244abafa997d81b => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:42.693084 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4300d-b5da-4849-b268-5dae3f67d208 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:42.726221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:42.806309 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4300d-b5da-4849-b268-5dae3f67d208 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:42.844240 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772ea63-7a6a-4212-a94d-47fe689ff82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:42.845218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772ea63-7a6a-4212-a94d-47fe689ff82f None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:42.845731 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772ea63-7a6a-4212-a94d-47fe689ff82f None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:42.846766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772ea63-7a6a-4212-a94d-47fe689ff82f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:42.847764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772ea63-7a6a-4212-a94d-47fe689ff82f None admin] RBAC: Adding query filter params (role.id=a11acb6c8a3e4c8b8673190a6bb021f7, scope.project.id=b3d0577467b84edf9244abafa997d81b, user.id=0f04769042194faab8058ad4b27af890) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:42.848355 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772ea63-7a6a-4212-a94d-47fe689ff82f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:42.850035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772ea63-7a6a-4212-a94d-47fe689ff82f None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:42.856672 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 156/318] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:01:42 2022] GET /identity/v3/role_assignments?user.id=0f04769042194faab8058ad4b27af890&scope.project.id=b3d0577467b84edf9244abafa997d81b&role.id=a11acb6c8a3e4c8b8673190a6bb021f7 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:43.249020 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e083b-5859-4a06-847c-d4203aabc67f None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:43.249565 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e083b-5859-4a06-847c-d4203aabc67f None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:43.249565 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e083b-5859-4a06-847c-d4203aabc67f None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:43.251173 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 163/319] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:43.256829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cffe8-ab55-46e7-b06a-7c85a00196f7 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:43.257122 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cffe8-ab55-46e7-b06a-7c85a00196f7 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:43.257400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cffe8-ab55-46e7-b06a-7c85a00196f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:43.278603 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-4f2cffe8-ab55-46e7-b06a-7c85a00196f7 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:43.279824 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-4f2cffe8-ab55-46e7-b06a-7c85a00196f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:43.354923 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 157/320] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:01:43.624690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3951e-3730-4b95-9274-575eb732f84a None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:43.624878 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3951e-3730-4b95-9274-575eb732f84a None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:43.625157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3951e-3730-4b95-9274-575eb732f84a None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:43.626818 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 164/321] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:43.632089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d975b4-92aa-4110-9f10-4e550a706d15 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:43.632378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d975b4-92aa-4110-9f10-4e550a706d15 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:43.632654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d975b4-92aa-4110-9f10-4e550a706d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:43.647746 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3951e-3730-4b95-9274-575eb732f84a None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:43.651738 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-80d975b4-92aa-4110-9f10-4e550a706d15 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:43.652906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-80d975b4-92aa-4110-9f10-4e550a706d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:43.671577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:43.725437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 158/322] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:43.737352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d962a-7361-4325-a36f-72c23f6eb42f None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:43.737352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d962a-7361-4325-a36f-72c23f6eb42f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:43.737352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d962a-7361-4325-a36f-72c23f6eb42f None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:43.737352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 159/323] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:43.737352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90540080-8ce4-4b27-bb8f-afd9f1f361c2 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:43.737352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90540080-8ce4-4b27-bb8f-afd9f1f361c2 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:43.738099 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90540080-8ce4-4b27-bb8f-afd9f1f361c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:43.754883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-90540080-8ce4-4b27-bb8f-afd9f1f361c2 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:43.756040 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-90540080-8ce4-4b27-bb8f-afd9f1f361c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:43.762185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3951e-3730-4b95-9274-575eb732f84a None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:43.797999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199e99f-4c27-4af4-8c2d-71a585267ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:43.798639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199e99f-4c27-4af4-8c2d-71a585267ede None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:43.798921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199e99f-4c27-4af4-8c2d-71a585267ede None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:43.799264 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199e99f-4c27-4af4-8c2d-71a585267ede None admin] PATH_INFO: `/v3/domains/default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:43.801107 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199e99f-4c27-4af4-8c2d-71a585267ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:43.802606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199e99f-4c27-4af4-8c2d-71a585267ede None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:43.804443 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 165/324] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:01:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:43.809715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199e99f-4c27-4af4-8c2d-71a585267ede None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:43.829639 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 160/325] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:43.848930 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:43.919771 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199e99f-4c27-4af4-8c2d-71a585267ede None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:43.959107 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88a98c-0a6a-4bed-8dc7-d670cecc62e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:43.960153 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88a98c-0a6a-4bed-8dc7-d670cecc62e0 None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:43.960638 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88a98c-0a6a-4bed-8dc7-d670cecc62e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:43.961149 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88a98c-0a6a-4bed-8dc7-d670cecc62e0 None admin] PATH_INFO: `/v3/groups` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:43.962011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88a98c-0a6a-4bed-8dc7-d670cecc62e0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:43.963676 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88a98c-0a6a-4bed-8dc7-d670cecc62e0 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:44.004223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90540080-8ce4-4b27-bb8f-afd9f1f361c2 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:44.090701 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:44.102033 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 166/326] 10.222.0.79 () {60 vars in 1134 bytes} [Fri Sep 2 21:01:43 2022] POST /identity/v3/groups => generated 226 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:01:44.112249 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90540080-8ce4-4b27-bb8f-afd9f1f361c2 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:44.115076 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88a98c-0a6a-4bed-8dc7-d670cecc62e0 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:44.169152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8481481-be6d-4a20-aa5b-1604bcc5475c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:44.169901 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8481481-be6d-4a20-aa5b-1604bcc5475c None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:44.170188 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8481481-be6d-4a20-aa5b-1604bcc5475c None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:44.170463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8481481-be6d-4a20-aa5b-1604bcc5475c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:44.183596 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8481481-be6d-4a20-aa5b-1604bcc5475c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:44.189036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-a8481481-be6d-4a20-aa5b-1604bcc5475c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 21:01:44.189036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:44.189036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:44.189036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:44.189036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:44.189036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:44.189036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:44.189036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:44.189036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:44.189036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:44.189036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:44.189036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:44.189036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:44.189036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:44.189036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:44.189036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:44.190577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:44.190577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:44.190577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:44.190577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:44.190577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:44.190577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:44.190577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:44.190577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:44.190577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:44.190577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:44.190577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:44.190577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:44.190577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:44.190577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:44.190577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:44.190577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:44.191581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:44.191581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:44.191581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:44.191581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:44.191581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:44.191581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:44.191581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:44.191581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:44.191581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:44.191581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:44.191581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 21:01:44.191581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:44.191581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 161/327] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:44.196602 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8481481-be6d-4a20-aa5b-1604bcc5475c None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:44.249757 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:44.256523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88a98c-0a6a-4bed-8dc7-d670cecc62e0 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:44.304724 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fece4e2-5c1b-4f98-9a61-6b09e6932055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:44.305338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fece4e2-5c1b-4f98-9a61-6b09e6932055 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:44.305671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fece4e2-5c1b-4f98-9a61-6b09e6932055 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:44.305998 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fece4e2-5c1b-4f98-9a61-6b09e6932055 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:44.321122 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fece4e2-5c1b-4f98-9a61-6b09e6932055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:44.326193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-7fece4e2-5c1b-4f98-9a61-6b09e6932055 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:44.326193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:44.326193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:44.326193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:44.326193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:44.326193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:44.326193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:44.326193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:44.326193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:44.326193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:44.326193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:44.326193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:44.326193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:44.326193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:44.326193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:44.326193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:44.327074 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:44.327074 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:44.327074 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:44.327074 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:44.327074 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:44.327074 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:44.327074 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:44.327074 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:44.327074 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:44.327074 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:44.327074 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:44.327074 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:44.327074 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:44.327074 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:44.327074 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:44.327074 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:44.327862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:44.327862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:44.327862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:44.327862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:44.327862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:44.327862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:44.327862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:44.327862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:44.327862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:44.327862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:44.327862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:44.327862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:44.327862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 167/328] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:44.336563 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fece4e2-5c1b-4f98-9a61-6b09e6932055 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:44.369902 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8481481-be6d-4a20-aa5b-1604bcc5475c None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:44.435886 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4985b6-eed2-49f3-8d5c-8a427f97a44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:44.436994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4985b6-eed2-49f3-8d5c-8a427f97a44a None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:44.437514 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4985b6-eed2-49f3-8d5c-8a427f97a44a None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:44.438045 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4985b6-eed2-49f3-8d5c-8a427f97a44a None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:44.439293 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4985b6-eed2-49f3-8d5c-8a427f97a44a None admin] RBAC: Adding query filter params (name=reader) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:44.440413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4985b6-eed2-49f3-8d5c-8a427f97a44a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:44.442215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4985b6-eed2-49f3-8d5c-8a427f97a44a None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:44.461843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 162/329] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:44.464269 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4985b6-eed2-49f3-8d5c-8a427f97a44a None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:44.471813 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:44.518235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fece4e2-5c1b-4f98-9a61-6b09e6932055 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:44.571613 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7440d8d-2ac6-4209-806a-fb0f5e1427d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:44.572235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7440d8d-2ac6-4209-806a-fb0f5e1427d9 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:44.572579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7440d8d-2ac6-4209-806a-fb0f5e1427d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:44.572783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7440d8d-2ac6-4209-806a-fb0f5e1427d9 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:44.573728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7440d8d-2ac6-4209-806a-fb0f5e1427d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:44.573728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7440d8d-2ac6-4209-806a-fb0f5e1427d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:44.575229 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7440d8d-2ac6-4209-806a-fb0f5e1427d9 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:44.591619 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 168/330] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:44.594700 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7440d8d-2ac6-4209-806a-fb0f5e1427d9 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:44.625599 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:44.634930 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4985b6-eed2-49f3-8d5c-8a427f97a44a None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:44.687639 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666130b9-d12c-4b8e-9cd5-22648e5e26f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:44.688707 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666130b9-d12c-4b8e-9cd5-22648e5e26f1 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:44.689242 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666130b9-d12c-4b8e-9cd5-22648e5e26f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:44.689868 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666130b9-d12c-4b8e-9cd5-22648e5e26f1 None admin] PATH_INFO: `/v3/users/86b1602be35246e3b2227d2391cc29a0` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:44.692161 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666130b9-d12c-4b8e-9cd5-22648e5e26f1 None admin] RBAC: Authorizing `identity:get_user(user_id=86b1602be35246e3b2227d2391cc29a0)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:44.696142 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666130b9-d12c-4b8e-9cd5-22648e5e26f1 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:44.699339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 163/331] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:44 2022] GET /identity/v3/users/86b1602be35246e3b2227d2391cc29a0 => generated 293 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:44.707631 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666130b9-d12c-4b8e-9cd5-22648e5e26f1 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:44.760352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7440d8d-2ac6-4209-806a-fb0f5e1427d9 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:44.815942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:44.816694 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1f620-ce6a-4f32-a5e5-4f4ca4da6e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:44.817085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1f620-ce6a-4f32-a5e5-4f4ca4da6e23 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:44.817243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1f620-ce6a-4f32-a5e5-4f4ca4da6e23 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:44.817506 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1f620-ce6a-4f32-a5e5-4f4ca4da6e23 None admin] PATH_INFO: `/v3/users/0b0685d3016d4287a25e8dc98ca9b3d4` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:44.820504 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1f620-ce6a-4f32-a5e5-4f4ca4da6e23 None admin] RBAC: Authorizing `identity:get_user(user_id=0b0685d3016d4287a25e8dc98ca9b3d4)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:44.821886 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1f620-ce6a-4f32-a5e5-4f4ca4da6e23 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:44.832852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 169/332] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:44 2022] GET /identity/v3/users/0b0685d3016d4287a25e8dc98ca9b3d4 => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:44.840547 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1f620-ce6a-4f32-a5e5-4f4ca4da6e23 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:44.894930 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666130b9-d12c-4b8e-9cd5-22648e5e26f1 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:44.957185 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f180a-d303-428c-b678-289816628dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:44.958310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f180a-d303-428c-b678-289816628dc5 None admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:44.958727 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f180a-d303-428c-b678-289816628dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:44.959143 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f180a-d303-428c-b678-289816628dc5 None admin] PATH_INFO: `/v3/system/users/86b1602be35246e3b2227d2391cc29a0/roles/a11acb6c8a3e4c8b8673190a6bb021f7` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:44.963470 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f180a-d303-428c-b678-289816628dc5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=86b1602be35246e3b2227d2391cc29a0, role_id=a11acb6c8a3e4c8b8673190a6bb021f7)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:44.963470 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f180a-d303-428c-b678-289816628dc5 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:45.020598 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:45.043214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1f620-ce6a-4f32-a5e5-4f4ca4da6e23 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:45.049178 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 164/333] 10.222.0.79 () {58 vars in 1334 bytes} [Fri Sep 2 21:01:44 2022] PUT /identity/v3/system/users/86b1602be35246e3b2227d2391cc29a0/roles/a11acb6c8a3e4c8b8673190a6bb021f7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:01:45.104782 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719be09-f4c6-468c-8325-087f38d03d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:45.105989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719be09-f4c6-468c-8325-087f38d03d7f None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:45.106332 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719be09-f4c6-468c-8325-087f38d03d7f None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:45.106722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719be09-f4c6-468c-8325-087f38d03d7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:45.108088 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719be09-f4c6-468c-8325-087f38d03d7f None admin] RBAC: Adding query filter params (role.id=17200f478f4f42afb0a4d42b5da2183d, user.id=0b0685d3016d4287a25e8dc98ca9b3d4, scope.system=all) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:45.108602 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719be09-f4c6-468c-8325-087f38d03d7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:45.111466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719be09-f4c6-468c-8325-087f38d03d7f None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:45.132826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 170/334] 10.222.0.79 () {56 vars in 1308 bytes} [Fri Sep 2 21:01:44 2022] GET /identity/v3/role_assignments?user.id=0b0685d3016d4287a25e8dc98ca9b3d4&scope.system=all&role.id=17200f478f4f42afb0a4d42b5da2183d => generated 510 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:46.498368 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03db6b1-61e9-4acd-8247-8115c41c4cf3 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:46.499222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03db6b1-61e9-4acd-8247-8115c41c4cf3 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:46.499646 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03db6b1-61e9-4acd-8247-8115c41c4cf3 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:46.501508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 165/335] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:46.508906 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd679b1-2024-4760-95f6-5c16606a3c14 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:46.509858 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd679b1-2024-4760-95f6-5c16606a3c14 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:46.510360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd679b1-2024-4760-95f6-5c16606a3c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:46.531592 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-2cd679b1-2024-4760-95f6-5c16606a3c14 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:46.533131 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-2cd679b1-2024-4760-95f6-5c16606a3c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:46.617128 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 171/336] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:01:47.131589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5498638-8202-4955-9007-830ee2828e87 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:47.132270 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5498638-8202-4955-9007-830ee2828e87 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:47.132815 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5498638-8202-4955-9007-830ee2828e87 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:47.134694 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 166/337] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:47.140059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfe86e-dac6-49ce-9cd2-c6cfd172b6f8 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:47.140626 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfe86e-dac6-49ce-9cd2-c6cfd172b6f8 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:47.141094 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfe86e-dac6-49ce-9cd2-c6cfd172b6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:47.166836 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-5bcfe86e-dac6-49ce-9cd2-c6cfd172b6f8 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:47.168384 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-5bcfe86e-dac6-49ce-9cd2-c6cfd172b6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:47.202513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5498638-8202-4955-9007-830ee2828e87 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:47.306186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 172/338] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:47.315013 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f37f1-6a24-4624-bae9-72a9acee6514 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:47.315676 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f37f1-6a24-4624-bae9-72a9acee6514 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:47.316349 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f37f1-6a24-4624-bae9-72a9acee6514 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:47.318146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 173/339] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:47.327535 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38430e7-c5ef-49b6-bcc3-3bf969071bfd None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:47.328100 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38430e7-c5ef-49b6-bcc3-3bf969071bfd None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:47.328568 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38430e7-c5ef-49b6-bcc3-3bf969071bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:47.351530 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:47.352841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5498638-8202-4955-9007-830ee2828e87 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:47.369957 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-d38430e7-c5ef-49b6-bcc3-3bf969071bfd None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:47.371310 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-d38430e7-c5ef-49b6-bcc3-3bf969071bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:47.423084 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c9101-490b-4e6c-8666-ed1661de16fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:47.423737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c9101-490b-4e6c-8666-ed1661de16fd None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:47.424653 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c9101-490b-4e6c-8666-ed1661de16fd None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:47.425111 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c9101-490b-4e6c-8666-ed1661de16fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:47.432526 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:47.446107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c9101-490b-4e6c-8666-ed1661de16fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:47.452148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-559c9101-490b-4e6c-8666-ed1661de16fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:47.452148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:47.452148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:47.452148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:47.452148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:47.452148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:47.452148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:47.452148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:47.452148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:47.452148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:47.452148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:47.452148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:47.452148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:47.452148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:47.452148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:47.452148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:47.453043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:47.453043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:47.453043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:47.453043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:47.453043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:47.453043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:47.453043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:47.453043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:47.453043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:47.453043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:47.453043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:47.453043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:47.453043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:47.453043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:47.453043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:47.453043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:47.453859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:47.453859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:47.453859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:47.453859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:47.453859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:47.453859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:47.453859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:47.453859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:47.453859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:47.453859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:47.453859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:47.453859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:47.462681 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 167/340] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:01:47.468739 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c9101-490b-4e6c-8666-ed1661de16fd None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:47.529843 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 174/341] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:47.600747 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c9101-490b-4e6c-8666-ed1661de16fd None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:47.641499 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c29904-e79f-425b-9112-9caba3198e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:47.642635 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c29904-e79f-425b-9112-9caba3198e9d None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:47.643826 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c29904-e79f-425b-9112-9caba3198e9d None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:47.644481 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c29904-e79f-425b-9112-9caba3198e9d None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:47.645362 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c29904-e79f-425b-9112-9caba3198e9d None admin] RBAC: Adding query filter params (name=member) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:47.645882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c29904-e79f-425b-9112-9caba3198e9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:47.647462 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c29904-e79f-425b-9112-9caba3198e9d None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:47.656834 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 168/342] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:47.663509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38430e7-c5ef-49b6-bcc3-3bf969071bfd None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:47.822202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38430e7-c5ef-49b6-bcc3-3bf969071bfd None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:47.864750 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92e994-0b3e-4e36-84b7-ff26d547c1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:47.865741 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92e994-0b3e-4e36-84b7-ff26d547c1b7 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:47.866251 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92e994-0b3e-4e36-84b7-ff26d547c1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:47.866720 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92e994-0b3e-4e36-84b7-ff26d547c1b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:47.872231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:47.952538 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92e994-0b3e-4e36-84b7-ff26d547c1b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:47.954427 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92e994-0b3e-4e36-84b7-ff26d547c1b7 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:48.076313 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 175/343] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:48.083485 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c29904-e79f-425b-9112-9caba3198e9d None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:48.109867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92e994-0b3e-4e36-84b7-ff26d547c1b7 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:48.153565 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:48.168008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:48.223753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c29904-e79f-425b-9112-9caba3198e9d None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:48.268692 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907434e-cfcf-4fbf-a5e8-b9d2e3d145cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:48.269895 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907434e-cfcf-4fbf-a5e8-b9d2e3d145cc None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:48.270418 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907434e-cfcf-4fbf-a5e8-b9d2e3d145cc None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:48.270892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907434e-cfcf-4fbf-a5e8-b9d2e3d145cc None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:48.272483 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907434e-cfcf-4fbf-a5e8-b9d2e3d145cc None admin] RBAC: Authorizing `identity:get_project(project_id=8ede2fe0b38f4061965d7dbc9aef29a9)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:48.274304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907434e-cfcf-4fbf-a5e8-b9d2e3d145cc None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:48.276336 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 169/344] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:48 2022] GET /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:48.280472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907434e-cfcf-4fbf-a5e8-b9d2e3d145cc None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:48.305420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92e994-0b3e-4e36-84b7-ff26d547c1b7 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:48.357920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6c963-6e2f-4cc0-a4d0-f6ff3cdcf334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:48.358588 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6c963-6e2f-4cc0-a4d0-f6ff3cdcf334 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:48.358856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6c963-6e2f-4cc0-a4d0-f6ff3cdcf334 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:48.359132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6c963-6e2f-4cc0-a4d0-f6ff3cdcf334 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:48.375558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6c963-6e2f-4cc0-a4d0-f6ff3cdcf334 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:48.383477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-49c6c963-6e2f-4cc0-a4d0-f6ff3cdcf334 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:48.383477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:48.383477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:48.383477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:48.383477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:48.383477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:48.383477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:48.383477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:48.383477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:48.383477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:48.383477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:48.383477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:48.383477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:48.383477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:48.383477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:48.383477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:48.384409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:48.384409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:48.384409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:48.384409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:48.384409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:48.384409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:48.384409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:48.384409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:48.384409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:48.384409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:48.384409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:48.384409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:48.384409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:48.384409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:48.384409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:48.384409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:48.385204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:48.385204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:48.385204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:48.385204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:48.385204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:48.385204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:48.385204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:48.385204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:48.385204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:48.385204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:48.385204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:48.385204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:48.388473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 176/345] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Sep 2 21:01:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:48.389994 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6c963-6e2f-4cc0-a4d0-f6ff3cdcf334 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:48.424753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907434e-cfcf-4fbf-a5e8-b9d2e3d145cc None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:48.457973 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:48.473303 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64270f42-26b4-432d-b1db-9361db9fda28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:48.476898 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64270f42-26b4-432d-b1db-9361db9fda28 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:48.476898 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64270f42-26b4-432d-b1db-9361db9fda28 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:48.476898 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64270f42-26b4-432d-b1db-9361db9fda28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:48.490290 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64270f42-26b4-432d-b1db-9361db9fda28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:48.496593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-64270f42-26b4-432d-b1db-9361db9fda28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:48.496593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:48.496593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:48.496593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:48.496593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:48.496593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:48.496593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:48.496593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:48.496593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:48.496593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:48.496593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:48.496593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:48.496593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:48.496593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:48.496593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:48.496593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:48.497753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:48.497753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:48.497753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:48.497753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:48.497753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:48.497753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:48.497753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:48.497753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:48.497753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:48.497753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:48.497753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:48.497753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:48.497753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:48.497753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:48.497753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:48.497753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:48.498771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:48.498771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:48.498771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:48.498771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:48.498771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:48.498771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:48.498771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:48.498771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:48.498771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:48.498771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:48.498771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:48.498771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:48.500464 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 170/346] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:48.501932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62859495-cffc-495b-96e0-20971a181caf None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:48.502363 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62859495-cffc-495b-96e0-20971a181caf None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:48.502764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62859495-cffc-495b-96e0-20971a181caf None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:48.504290 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 171/347] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:48.505221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62859495-cffc-495b-96e0-20971a181caf None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:48.517321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:48.526220 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6c963-6e2f-4cc0-a4d0-f6ff3cdcf334 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:48.579788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9ab25-1f69-4457-828a-14cdbc83ccea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:48.580816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9ab25-1f69-4457-828a-14cdbc83ccea None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:48.581157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9ab25-1f69-4457-828a-14cdbc83ccea None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:48.581380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9ab25-1f69-4457-828a-14cdbc83ccea None admin] PATH_INFO: `/v3/groups/b8708a26a9594d24a8a786db404e93ae` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:48.593583 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9ab25-1f69-4457-828a-14cdbc83ccea None admin] RBAC: Authorizing `identity:get_group(group_id=b8708a26a9594d24a8a786db404e93ae)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:48.595342 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9ab25-1f69-4457-828a-14cdbc83ccea None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:48.597408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 177/348] 10.222.0.79 () {56 vars in 1180 bytes} [Fri Sep 2 21:01:48 2022] GET /identity/v3/groups/b8708a26a9594d24a8a786db404e93ae => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:48.598262 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9ab25-1f69-4457-828a-14cdbc83ccea None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:48.666044 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62859495-cffc-495b-96e0-20971a181caf None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:48.726594 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27431631-3acf-4c43-810d-030ed65c16c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:48.727448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27431631-3acf-4c43-810d-030ed65c16c2 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:48.727993 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27431631-3acf-4c43-810d-030ed65c16c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:48.728279 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27431631-3acf-4c43-810d-030ed65c16c2 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:48.729015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27431631-3acf-4c43-810d-030ed65c16c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:48.729326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27431631-3acf-4c43-810d-030ed65c16c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:48.730833 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27431631-3acf-4c43-810d-030ed65c16c2 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:48.743801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 172/349] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:48.745905 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565fe40-e1f4-48ba-8abc-51e77b59c1bc None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:48.746045 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565fe40-e1f4-48ba-8abc-51e77b59c1bc None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:48.748866 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565fe40-e1f4-48ba-8abc-51e77b59c1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:48.748984 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9ab25-1f69-4457-828a-14cdbc83ccea None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:48.766989 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-c565fe40-e1f4-48ba-8abc-51e77b59c1bc None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:48.769198 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-c565fe40-e1f4-48ba-8abc-51e77b59c1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:48.803651 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3f512-44bf-4b51-bf48-74f8ed2917cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:48.804278 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3f512-44bf-4b51-bf48-74f8ed2917cb None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:48.804562 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3f512-44bf-4b51-bf48-74f8ed2917cb None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:48.804840 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3f512-44bf-4b51-bf48-74f8ed2917cb None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:48.805511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3f512-44bf-4b51-bf48-74f8ed2917cb None admin] RBAC: Adding query filter params (name=member) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:48.805836 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3f512-44bf-4b51-bf48-74f8ed2917cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:48.807250 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3f512-44bf-4b51-bf48-74f8ed2917cb None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:48.817849 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 178/350] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:48.820003 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9d144-3c57-48a4-a40d-5d1960c9db0f None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:48.820429 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9d144-3c57-48a4-a40d-5d1960c9db0f None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:48.820710 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9d144-3c57-48a4-a40d-5d1960c9db0f None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:48.822534 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 179/351] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:48.823271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9d144-3c57-48a4-a40d-5d1960c9db0f None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:48.837634 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:48.850586 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:48.870888 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 173/352] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:48.872129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565fe40-e1f4-48ba-8abc-51e77b59c1bc None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:48.971079 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9d144-3c57-48a4-a40d-5d1960c9db0f None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:49.013089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565fe40-e1f4-48ba-8abc-51e77b59c1bc None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:49.022142 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a25612-1e74-4b98-99b5-9fb23620abcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:49.022897 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a25612-1e74-4b98-99b5-9fb23620abcb None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:49.023250 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a25612-1e74-4b98-99b5-9fb23620abcb None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:49.023597 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a25612-1e74-4b98-99b5-9fb23620abcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:49.024538 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a25612-1e74-4b98-99b5-9fb23620abcb None admin] RBAC: Adding query filter params (group.id=b8708a26a9594d24a8a786db404e93ae, role.id=17200f478f4f42afb0a4d42b5da2183d, scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:49.024873 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a25612-1e74-4b98-99b5-9fb23620abcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:49.026885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a25612-1e74-4b98-99b5-9fb23620abcb None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:49.036052 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 180/353] 10.222.0.79 () {56 vars in 1376 bytes} [Fri Sep 2 21:01:48 2022] GET /identity/v3/role_assignments?group.id=b8708a26a9594d24a8a786db404e93ae&scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9&role.id=17200f478f4f42afb0a4d42b5da2183d => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:49.037132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a25612-1e74-4b98-99b5-9fb23620abcb None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:49.062512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed92ec-46c5-4d6f-878a-901471069849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:49.063707 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed92ec-46c5-4d6f-878a-901471069849 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:49.064317 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed92ec-46c5-4d6f-878a-901471069849 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:49.065437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed92ec-46c5-4d6f-878a-901471069849 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:49.132200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:49.161589 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:49.167473 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed92ec-46c5-4d6f-878a-901471069849 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:49.169775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed92ec-46c5-4d6f-878a-901471069849 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:49.185501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a25612-1e74-4b98-99b5-9fb23620abcb None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:49.236590 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e30fab-1a1e-4937-9ddc-8d6eb218d083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:49.237697 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e30fab-1a1e-4937-9ddc-8d6eb218d083 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:49.238028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e30fab-1a1e-4937-9ddc-8d6eb218d083 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:49.238306 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e30fab-1a1e-4937-9ddc-8d6eb218d083 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:49.325794 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 174/354] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:49.326867 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f5a2c-9e02-4157-beb9-3e026b096c62 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:49.327150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f5a2c-9e02-4157-beb9-3e026b096c62 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:49.327430 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f5a2c-9e02-4157-beb9-3e026b096c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:49.350910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-d14f5a2c-9e02-4157-beb9-3e026b096c62 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:49.352809 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d14f5a2c-9e02-4157-beb9-3e026b096c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:49.355287 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e30fab-1a1e-4937-9ddc-8d6eb218d083 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:49.357072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e30fab-1a1e-4937-9ddc-8d6eb218d083 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:49.449881 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 175/355] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:49.449881 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97333965-03b6-454d-99bf-b8b7dd929065 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:49.449881 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97333965-03b6-454d-99bf-b8b7dd929065 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:49.449881 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97333965-03b6-454d-99bf-b8b7dd929065 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:49.449881 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 176/356] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:49.453108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97333965-03b6-454d-99bf-b8b7dd929065 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:49.468251 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:49.485930 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:49.508917 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 181/357] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:49.510099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e30fab-1a1e-4937-9ddc-8d6eb218d083 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:49.589680 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97333965-03b6-454d-99bf-b8b7dd929065 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:49.645938 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f4384-7857-4ff8-833b-dc4a982e7eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:49.647380 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f4384-7857-4ff8-833b-dc4a982e7eee None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:49.648135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f4384-7857-4ff8-833b-dc4a982e7eee None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:49.648834 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f4384-7857-4ff8-833b-dc4a982e7eee None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:49.651416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f4384-7857-4ff8-833b-dc4a982e7eee None admin] RBAC: Authorizing `identity:get_project(project_id=8ede2fe0b38f4061965d7dbc9aef29a9)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:49.654296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f4384-7857-4ff8-833b-dc4a982e7eee None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:49.656402 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 177/358] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:49 2022] GET /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:49.657910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ba992-0878-4cf9-b896-8fb898e5b1d9 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:49.658748 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ba992-0878-4cf9-b896-8fb898e5b1d9 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:49.659445 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ba992-0878-4cf9-b896-8fb898e5b1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:49.663749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e30fab-1a1e-4937-9ddc-8d6eb218d083 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:49.682931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-e67ba992-0878-4cf9-b896-8fb898e5b1d9 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:49.685030 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e67ba992-0878-4cf9-b896-8fb898e5b1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:49.716152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91c51e-f25a-480e-b817-23614b6bcb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:49.716855 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91c51e-f25a-480e-b817-23614b6bcb68 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:49.717142 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91c51e-f25a-480e-b817-23614b6bcb68 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:49.717413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91c51e-f25a-480e-b817-23614b6bcb68 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:49.731360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91c51e-f25a-480e-b817-23614b6bcb68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:49.737780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-fb91c51e-f25a-480e-b817-23614b6bcb68 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:49.737780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:49.737780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:49.737780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:49.737780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:49.737780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:49.737780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:49.737780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:49.737780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:49.737780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:49.737780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:49.737780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:49.737780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:49.737780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:49.737780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:49.737780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:49.738733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:49.738733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:49.738733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:49.738733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:49.738733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:49.738733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:49.738733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:49.738733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:49.738733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:49.738733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:49.738733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:49.738733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:49.738733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:49.738733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:49.738733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:49.738733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:49.739545 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:49.739545 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:49.739545 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:49.739545 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:49.739545 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:49.739545 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:49.739545 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:49.739545 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:49.739545 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:49.739545 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:49.739545 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:49.739545 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:49.743377 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 182/359] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Sep 2 21:01:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:49.743377 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91c51e-f25a-480e-b817-23614b6bcb68 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:49.768083 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 178/360] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:49.768986 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ba992-0878-4cf9-b896-8fb898e5b1d9 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:49.777150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:49.799579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:49.857557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91c51e-f25a-480e-b817-23614b6bcb68 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:49.881084 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ba992-0878-4cf9-b896-8fb898e5b1d9 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:49.904447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe987c-d913-4cd2-94a3-e6aa39c640c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:49.905327 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe987c-d913-4cd2-94a3-e6aa39c640c6 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:49.905759 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe987c-d913-4cd2-94a3-e6aa39c640c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:49.906237 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe987c-d913-4cd2-94a3-e6aa39c640c6 None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:49.908114 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe987c-d913-4cd2-94a3-e6aa39c640c6 None admin] RBAC: Authorizing `identity:get_project(project_id=b3d0577467b84edf9244abafa997d81b)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:49.909869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe987c-d913-4cd2-94a3-e6aa39c640c6 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:49.912724 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 183/361] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:49 2022] GET /identity/v3/projects/b3d0577467b84edf9244abafa997d81b => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:49.913849 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe987c-d913-4cd2-94a3-e6aa39c640c6 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:49.922633 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db730e5a-a255-4fab-be5f-3b85ef09b45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:49.923278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db730e5a-a255-4fab-be5f-3b85ef09b45d None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:49.924787 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db730e5a-a255-4fab-be5f-3b85ef09b45d None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:49.924787 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db730e5a-a255-4fab-be5f-3b85ef09b45d None admin] PATH_INFO: `/v3/groups/b8708a26a9594d24a8a786db404e93ae` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:49.926284 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db730e5a-a255-4fab-be5f-3b85ef09b45d None admin] RBAC: Authorizing `identity:get_group(group_id=b8708a26a9594d24a8a786db404e93ae)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:49.927732 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db730e5a-a255-4fab-be5f-3b85ef09b45d None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:49.930123 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 179/362] 10.222.0.79 () {56 vars in 1180 bytes} [Fri Sep 2 21:01:49 2022] GET /identity/v3/groups/b8708a26a9594d24a8a786db404e93ae => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:49.931354 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db730e5a-a255-4fab-be5f-3b85ef09b45d None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:50.034517 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:50.046721 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe987c-d913-4cd2-94a3-e6aa39c640c6 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:50.062891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db730e5a-a255-4fab-be5f-3b85ef09b45d None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:50.064936 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:50.093401 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dc859-5f5c-4108-a178-a83d8315a236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:50.094094 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dc859-5f5c-4108-a178-a83d8315a236 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:50.094451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dc859-5f5c-4108-a178-a83d8315a236 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:50.094798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dc859-5f5c-4108-a178-a83d8315a236 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:50.096322 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dc859-5f5c-4108-a178-a83d8315a236 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:50.096737 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dc859-5f5c-4108-a178-a83d8315a236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:50.098544 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dc859-5f5c-4108-a178-a83d8315a236 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:50.111557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 184/363] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:50.112674 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dc859-5f5c-4108-a178-a83d8315a236 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:50.115120 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de25d67-77b0-4c63-abc0-3a0427803236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:50.116313 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de25d67-77b0-4c63-abc0-3a0427803236 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:50.118755 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de25d67-77b0-4c63-abc0-3a0427803236 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:50.119187 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de25d67-77b0-4c63-abc0-3a0427803236 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:50.137736 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de25d67-77b0-4c63-abc0-3a0427803236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:50.140172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-5de25d67-77b0-4c63-abc0-3a0427803236 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 21:01:50.140172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:50.140172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:50.140172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:50.140172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:50.140172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:50.140172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:50.140172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:50.140172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:50.140172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:50.140172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:50.140172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:50.140172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:50.140172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:50.140172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:50.140172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:50.141036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:50.141036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:50.141036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:50.141036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:50.141036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:50.141036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:50.141036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:50.141036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:50.141036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:50.141036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:50.141036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:50.141036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:50.141036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:50.141036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:50.141036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:50.141036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:50.141883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:50.141883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:50.141883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:50.141883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:50.141883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:50.141883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:50.141883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:50.141883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:50.141883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:50.141883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:50.141883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 02 21:01:50.141883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:50.145352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 180/364] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:50.146502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de25d67-77b0-4c63-abc0-3a0427803236 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:50.252845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dc859-5f5c-4108-a178-a83d8315a236 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:50.272048 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de25d67-77b0-4c63-abc0-3a0427803236 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:50.295679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de840d1c-4e7a-432f-9978-e866560e7011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:50.296326 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de840d1c-4e7a-432f-9978-e866560e7011 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:50.296613 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de840d1c-4e7a-432f-9978-e866560e7011 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:50.296894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de840d1c-4e7a-432f-9978-e866560e7011 None admin] PATH_INFO: `/v3/groups/b8708a26a9594d24a8a786db404e93ae` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:50.300945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de840d1c-4e7a-432f-9978-e866560e7011 None admin] RBAC: Authorizing `identity:get_group(group_id=b8708a26a9594d24a8a786db404e93ae)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:50.302629 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de840d1c-4e7a-432f-9978-e866560e7011 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:50.304290 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 185/365] 10.222.0.79 () {56 vars in 1180 bytes} [Fri Sep 2 21:01:50 2022] GET /identity/v3/groups/b8708a26a9594d24a8a786db404e93ae => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:50.304913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de840d1c-4e7a-432f-9978-e866560e7011 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:50.316835 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d16d8a-6770-465d-880d-0cf41efc2f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:50.317449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d16d8a-6770-465d-880d-0cf41efc2f72 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:50.317731 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d16d8a-6770-465d-880d-0cf41efc2f72 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:50.318141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d16d8a-6770-465d-880d-0cf41efc2f72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:50.318830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d16d8a-6770-465d-880d-0cf41efc2f72 None admin] RBAC: Adding query filter params (group.id=b8708a26a9594d24a8a786db404e93ae, role.id=5feee6c423414badb9c65ac4076a7f45, scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:50.319143 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d16d8a-6770-465d-880d-0cf41efc2f72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:50.320591 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d16d8a-6770-465d-880d-0cf41efc2f72 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:50.322690 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:50.330248 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 181/366] 10.222.0.79 () {56 vars in 1376 bytes} [Fri Sep 2 21:01:50 2022] GET /identity/v3/role_assignments?group.id=b8708a26a9594d24a8a786db404e93ae&scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9&role.id=5feee6c423414badb9c65ac4076a7f45 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:50.331380 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d16d8a-6770-465d-880d-0cf41efc2f72 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:50.376120 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:50.465453 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de840d1c-4e7a-432f-9978-e866560e7011 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:50.496904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d16d8a-6770-465d-880d-0cf41efc2f72 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:50.521884 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d056a-ecf3-4e83-b186-85822f2f681e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:50.522591 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d056a-ecf3-4e83-b186-85822f2f681e None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:50.522977 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d056a-ecf3-4e83-b186-85822f2f681e None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:50.523262 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d056a-ecf3-4e83-b186-85822f2f681e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:50.542863 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec541d-ac1b-460d-aa9f-072e824a3444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:50.543504 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec541d-ac1b-460d-aa9f-072e824a3444 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:50.543789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec541d-ac1b-460d-aa9f-072e824a3444 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:50.544069 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec541d-ac1b-460d-aa9f-072e824a3444 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:50.558986 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec541d-ac1b-460d-aa9f-072e824a3444 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:50.565215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-64ec541d-ac1b-460d-aa9f-072e824a3444 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:50.565215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:50.565215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:50.565215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:50.565215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:50.565215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:50.565215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:50.565215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:50.565215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:50.565215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:50.565215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:50.565215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:50.565215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:50.565215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:50.565215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:50.565215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:50.566210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:50.566210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:50.566210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:50.566210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:50.566210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:50.566210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:50.566210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:50.566210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:50.566210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:50.566210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:50.566210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:50.566210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:50.566210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:50.566210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:50.566210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:50.566210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:50.566996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:50.566996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:50.566996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:50.566996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:50.566996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:50.566996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:50.566996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:50.566996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:50.566996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:50.566996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:50.566996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:50.566996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:50.566996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 182/367] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:01:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:50.568114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec541d-ac1b-460d-aa9f-072e824a3444 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:50.626014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d056a-ecf3-4e83-b186-85822f2f681e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:50.628775 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d056a-ecf3-4e83-b186-85822f2f681e None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:50.649287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:50.698940 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:50.708910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec541d-ac1b-460d-aa9f-072e824a3444 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:50.747709 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d4f7c-f0f2-41cb-9eeb-47dc5043d873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:50.748323 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d4f7c-f0f2-41cb-9eeb-47dc5043d873 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:50.748601 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d4f7c-f0f2-41cb-9eeb-47dc5043d873 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:50.748877 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d4f7c-f0f2-41cb-9eeb-47dc5043d873 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:50.749556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d4f7c-f0f2-41cb-9eeb-47dc5043d873 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:50.749887 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d4f7c-f0f2-41cb-9eeb-47dc5043d873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:50.752334 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d4f7c-f0f2-41cb-9eeb-47dc5043d873 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:50.764400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 183/368] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:50.765367 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d4f7c-f0f2-41cb-9eeb-47dc5043d873 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:50.772611 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 186/369] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:50.773328 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d056a-ecf3-4e83-b186-85822f2f681e None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:50.912693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d4f7c-f0f2-41cb-9eeb-47dc5043d873 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:50.920926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d056a-ecf3-4e83-b186-85822f2f681e None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:50.947831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:50.973294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3b673-ad25-4401-b272-f5d2a955271f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:50.974334 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3b673-ad25-4401-b272-f5d2a955271f None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:50.974918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3b673-ad25-4401-b272-f5d2a955271f None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:50.975587 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3b673-ad25-4401-b272-f5d2a955271f None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:50.976838 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3b673-ad25-4401-b272-f5d2a955271f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:50.977858 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3b673-ad25-4401-b272-f5d2a955271f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:50.977965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ec320-3e83-4cb7-99c5-ab24c811bfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:50.978071 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ec320-3e83-4cb7-99c5-ab24c811bfb5 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:50.978358 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ec320-3e83-4cb7-99c5-ab24c811bfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:50.978633 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ec320-3e83-4cb7-99c5-ab24c811bfb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:50.979437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ec320-3e83-4cb7-99c5-ab24c811bfb5 None admin] RBAC: Adding query filter params (group.id=b8708a26a9594d24a8a786db404e93ae, role.id=17200f478f4f42afb0a4d42b5da2183d, scope.project.id=b3d0577467b84edf9244abafa997d81b) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:50.979783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ec320-3e83-4cb7-99c5-ab24c811bfb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:50.981142 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3b673-ad25-4401-b272-f5d2a955271f None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:50.981263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ec320-3e83-4cb7-99c5-ab24c811bfb5 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:50.993528 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 184/370] 10.222.0.79 () {56 vars in 1376 bytes} [Fri Sep 2 21:01:50 2022] GET /identity/v3/role_assignments?group.id=b8708a26a9594d24a8a786db404e93ae&scope.project.id=b3d0577467b84edf9244abafa997d81b&role.id=17200f478f4f42afb0a4d42b5da2183d => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:50.993528 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ec320-3e83-4cb7-99c5-ab24c811bfb5 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:50.994122 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 187/371] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:50.994386 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3b673-ad25-4401-b272-f5d2a955271f None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:51.008990 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:51.130586 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3b673-ad25-4401-b272-f5d2a955271f None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:51.172817 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5c987-c810-49d9-a40e-265f4a77c221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:51.173412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5c987-c810-49d9-a40e-265f4a77c221 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:51.173732 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5c987-c810-49d9-a40e-265f4a77c221 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:51.174051 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5c987-c810-49d9-a40e-265f4a77c221 None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:51.175947 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5c987-c810-49d9-a40e-265f4a77c221 None admin] RBAC: Authorizing `identity:get_project(project_id=b3d0577467b84edf9244abafa997d81b)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:51.177654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5c987-c810-49d9-a40e-265f4a77c221 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:51.180916 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 188/372] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:50 2022] GET /identity/v3/projects/b3d0577467b84edf9244abafa997d81b => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:51.181117 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ec320-3e83-4cb7-99c5-ab24c811bfb5 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:51.181711 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5c987-c810-49d9-a40e-265f4a77c221 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:51.263659 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb7843-fdef-43b2-a1db-180d95803c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:51.264360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb7843-fdef-43b2-a1db-180d95803c87 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:51.264643 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb7843-fdef-43b2-a1db-180d95803c87 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:51.264918 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb7843-fdef-43b2-a1db-180d95803c87 None admin] PATH_INFO: `/v3/users/86b1602be35246e3b2227d2391cc29a0` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:51.266617 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb7843-fdef-43b2-a1db-180d95803c87 None admin] RBAC: Authorizing `identity:get_user(user_id=86b1602be35246e3b2227d2391cc29a0)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:51.270975 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb7843-fdef-43b2-a1db-180d95803c87 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:51.272845 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 185/373] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:01:50 2022] GET /identity/v3/users/86b1602be35246e3b2227d2391cc29a0 => generated 293 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:51.273381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb7843-fdef-43b2-a1db-180d95803c87 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:51.292875 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:51.339455 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5c987-c810-49d9-a40e-265f4a77c221 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:51.376250 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:51.409111 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707accdb-4d0b-400b-a245-9d4b1492bb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:51.409729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707accdb-4d0b-400b-a245-9d4b1492bb99 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:51.411474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707accdb-4d0b-400b-a245-9d4b1492bb99 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:51.411753 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707accdb-4d0b-400b-a245-9d4b1492bb99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:51.489951 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb7843-fdef-43b2-a1db-180d95803c87 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:51.501991 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707accdb-4d0b-400b-a245-9d4b1492bb99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:51.503503 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707accdb-4d0b-400b-a245-9d4b1492bb99 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:51.548420 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a593c6-d84d-4c4a-a454-9ec9e0c3fb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:51.549611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a593c6-d84d-4c4a-a454-9ec9e0c3fb9f None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:51.549928 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a593c6-d84d-4c4a-a454-9ec9e0c3fb9f None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:51.550206 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a593c6-d84d-4c4a-a454-9ec9e0c3fb9f None admin] PATH_INFO: `/v3/groups/b8708a26a9594d24a8a786db404e93ae` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:51.551526 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a593c6-d84d-4c4a-a454-9ec9e0c3fb9f None admin] RBAC: Authorizing `identity:get_group(group_id=b8708a26a9594d24a8a786db404e93ae)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:51.552971 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a593c6-d84d-4c4a-a454-9ec9e0c3fb9f None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:51.559695 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 186/374] 10.222.0.79 () {56 vars in 1180 bytes} [Fri Sep 2 21:01:51 2022] GET /identity/v3/groups/b8708a26a9594d24a8a786db404e93ae => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:51.560640 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a593c6-d84d-4c4a-a454-9ec9e0c3fb9f None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:51.581192 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:51.614076 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 189/375] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:51.615341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c84f3e-5174-4805-b465-0867320dc270 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:51.615627 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c84f3e-5174-4805-b465-0867320dc270 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:51.615956 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c84f3e-5174-4805-b465-0867320dc270 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:51.621188 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 190/376] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:51.621188 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c84f3e-5174-4805-b465-0867320dc270 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:51.693219 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a593c6-d84d-4c4a-a454-9ec9e0c3fb9f None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:51.714680 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:51.732589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7cc0f2-b215-4110-b779-4961defe62c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:51.733222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cc0f2-b215-4110-b779-4961defe62c0 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:51.733542 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cc0f2-b215-4110-b779-4961defe62c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:51.733881 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cc0f2-b215-4110-b779-4961defe62c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:51.734666 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7cc0f2-b215-4110-b779-4961defe62c0 None admin] RBAC: Adding query filter params (role.id=a11acb6c8a3e4c8b8673190a6bb021f7, user.id=86b1602be35246e3b2227d2391cc29a0, scope.system=all) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:51.735274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7cc0f2-b215-4110-b779-4961defe62c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:51.737094 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7cc0f2-b215-4110-b779-4961defe62c0 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:51.754020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 187/377] 10.222.0.79 () {56 vars in 1308 bytes} [Fri Sep 2 21:01:51 2022] GET /identity/v3/role_assignments?user.id=86b1602be35246e3b2227d2391cc29a0&scope.system=all&role.id=a11acb6c8a3e4c8b8673190a6bb021f7 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:51.754951 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7cc0f2-b215-4110-b779-4961defe62c0 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:51.758997 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c84f3e-5174-4805-b465-0867320dc270 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:51.804638 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0e06b-4d72-4dad-bb28-78fdcbe5a694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:51.805664 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0e06b-4d72-4dad-bb28-78fdcbe5a694 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:51.806223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0e06b-4d72-4dad-bb28-78fdcbe5a694 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:51.806838 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0e06b-4d72-4dad-bb28-78fdcbe5a694 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:51.808760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0e06b-4d72-4dad-bb28-78fdcbe5a694 None admin] RBAC: Adding query filter params (group.id=b8708a26a9594d24a8a786db404e93ae, role.id=5feee6c423414badb9c65ac4076a7f45, scope.project.id=b3d0577467b84edf9244abafa997d81b) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:51.810178 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0e06b-4d72-4dad-bb28-78fdcbe5a694 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:51.812256 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0e06b-4d72-4dad-bb28-78fdcbe5a694 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:51.833193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 191/378] 10.222.0.79 () {56 vars in 1376 bytes} [Fri Sep 2 21:01:51 2022] GET /identity/v3/role_assignments?group.id=b8708a26a9594d24a8a786db404e93ae&scope.project.id=b3d0577467b84edf9244abafa997d81b&role.id=5feee6c423414badb9c65ac4076a7f45 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:51.834509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab7abb-2bfc-420b-8a10-4bcda9c491f8 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:51.834799 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab7abb-2bfc-420b-8a10-4bcda9c491f8 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:51.835077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab7abb-2bfc-420b-8a10-4bcda9c491f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:51.878992 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-ddab7abb-2bfc-420b-8a10-4bcda9c491f8 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:51.880258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ddab7abb-2bfc-420b-8a10-4bcda9c491f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:51.977677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7cc0f2-b215-4110-b779-4961defe62c0 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:51.986869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:52.054411 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368a213-3e96-4300-8d25-cc2173dfb835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:52.055003 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368a213-3e96-4300-8d25-cc2173dfb835 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:52.055325 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368a213-3e96-4300-8d25-cc2173dfb835 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:52.055677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368a213-3e96-4300-8d25-cc2173dfb835 None admin] PATH_INFO: `/v3/projects/c04c8d4bc7dc450a92b56e01849b9dc9` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:52.058088 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368a213-3e96-4300-8d25-cc2173dfb835 None admin] RBAC: Authorizing `identity:get_project(project_id=c04c8d4bc7dc450a92b56e01849b9dc9)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:52.059554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368a213-3e96-4300-8d25-cc2173dfb835 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:52.063686 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 192/379] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:52.064953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 188/380] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:51 2022] GET /identity/v3/projects/c04c8d4bc7dc450a92b56e01849b9dc9 => generated 344 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:52.070783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab7abb-2bfc-420b-8a10-4bcda9c491f8 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:52.195230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab7abb-2bfc-420b-8a10-4bcda9c491f8 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:52.239141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a060e-688c-4875-ad9b-24cfb584b15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:52.239787 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a060e-688c-4875-ad9b-24cfb584b15e None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:52.240099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a060e-688c-4875-ad9b-24cfb584b15e None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:52.240371 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a060e-688c-4875-ad9b-24cfb584b15e None admin] PATH_INFO: `/v3/groups/d6952e07a89647d8b03b03a37b4de07d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:52.246100 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a060e-688c-4875-ad9b-24cfb584b15e None admin] RBAC: Authorizing `identity:get_group(group_id=d6952e07a89647d8b03b03a37b4de07d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:52.247567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a060e-688c-4875-ad9b-24cfb584b15e None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:52.250313 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 193/381] 10.222.0.79 () {56 vars in 1180 bytes} [Fri Sep 2 21:01:52 2022] GET /identity/v3/groups/d6952e07a89647d8b03b03a37b4de07d => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:52.255411 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368a213-3e96-4300-8d25-cc2173dfb835 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:52.319617 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:52.378900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368a213-3e96-4300-8d25-cc2173dfb835 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:52.419572 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cac69-eb94-496f-a004-fca8ec24e788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:52.420571 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cac69-eb94-496f-a004-fca8ec24e788 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:52.421094 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cac69-eb94-496f-a004-fca8ec24e788 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:52.421635 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cac69-eb94-496f-a004-fca8ec24e788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:52.422692 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cac69-eb94-496f-a004-fca8ec24e788 None admin] RBAC: Adding query filter params (group.id=d6952e07a89647d8b03b03a37b4de07d, role.id=32e6a7f83b444d1ca9e5891a2b175f9a, scope.project.id=c04c8d4bc7dc450a92b56e01849b9dc9) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:52.423214 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cac69-eb94-496f-a004-fca8ec24e788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:52.425127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cac69-eb94-496f-a004-fca8ec24e788 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:52.434260 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 189/382] 10.222.0.79 () {56 vars in 1376 bytes} [Fri Sep 2 21:01:52 2022] GET /identity/v3/role_assignments?group.id=d6952e07a89647d8b03b03a37b4de07d&scope.project.id=c04c8d4bc7dc450a92b56e01849b9dc9&role.id=32e6a7f83b444d1ca9e5891a2b175f9a => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:52.552485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a060e-688c-4875-ad9b-24cfb584b15e None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:52.601928 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:52.690860 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a060e-688c-4875-ad9b-24cfb584b15e None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:52.741375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53dec0-06ac-40a4-a886-f36b79a3d390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:52.742051 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53dec0-06ac-40a4-a886-f36b79a3d390 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:52.742336 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53dec0-06ac-40a4-a886-f36b79a3d390 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:52.742612 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53dec0-06ac-40a4-a886-f36b79a3d390 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:52.759253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53dec0-06ac-40a4-a886-f36b79a3d390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:52.764141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-7c53dec0-06ac-40a4-a886-f36b79a3d390 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:52.764141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:52.764141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:52.764141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:52.764141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:52.764141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:52.764141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:52.764141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:52.764141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:52.764141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:52.764141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:52.764141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:52.764141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:52.764141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:52.764141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:52.764141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:52.765011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:52.765011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:52.765011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:52.765011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:52.765011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:52.765011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:52.765011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:52.765011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:52.765011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:52.765011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:52.765011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:52.765011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:52.765011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:52.765011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:52.765011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:52.765011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:52.765772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:52.765772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:52.765772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:52.765772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:52.765772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:52.765772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:52.765772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:52.765772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:52.765772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:52.765772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:52.765772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:52.765772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:52.765772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 194/383] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:52.771811 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cac69-eb94-496f-a004-fca8ec24e788 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:52.934893 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cac69-eb94-496f-a004-fca8ec24e788 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:52.950831 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7061b8-58bd-49a8-bbf7-26dbb64c34e7 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:52.951134 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7061b8-58bd-49a8-bbf7-26dbb64c34e7 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:52.951387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7061b8-58bd-49a8-bbf7-26dbb64c34e7 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:52.952736 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 195/384] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:52.954329 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:52.960453 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65861d0a-c5c8-4a4e-904a-88bf8ef21629 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:52.960746 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65861d0a-c5c8-4a4e-904a-88bf8ef21629 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:52.961567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65861d0a-c5c8-4a4e-904a-88bf8ef21629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:52.991895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-65861d0a-c5c8-4a4e-904a-88bf8ef21629 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:52.993239 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-65861d0a-c5c8-4a4e-904a-88bf8ef21629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:53.016244 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fd0f4-d736-4486-8e7c-e02123bb4019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:53.016891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fd0f4-d736-4486-8e7c-e02123bb4019 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:53.017835 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fd0f4-d736-4486-8e7c-e02123bb4019 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:53.018158 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fd0f4-d736-4486-8e7c-e02123bb4019 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:53.018890 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fd0f4-d736-4486-8e7c-e02123bb4019 None admin] RBAC: Adding query filter params (name=member) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:53.019238 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fd0f4-d736-4486-8e7c-e02123bb4019 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:53.020661 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fd0f4-d736-4486-8e7c-e02123bb4019 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:53.044650 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 190/385] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:53.050295 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fd0f4-d736-4486-8e7c-e02123bb4019 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:53.145390 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 196/386] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 02 21:01:53.182509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fd0f4-d736-4486-8e7c-e02123bb4019 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:53.225403 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addb525-175e-4181-9b1a-3d89fd1e1aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:53.226003 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addb525-175e-4181-9b1a-3d89fd1e1aab None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:53.226287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addb525-175e-4181-9b1a-3d89fd1e1aab None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:53.226564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addb525-175e-4181-9b1a-3d89fd1e1aab None admin] PATH_INFO: `/v3/groups/b8708a26a9594d24a8a786db404e93ae` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:53.227707 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1addb525-175e-4181-9b1a-3d89fd1e1aab None admin] RBAC: Authorizing `identity:get_group(group_id=b8708a26a9594d24a8a786db404e93ae)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:53.230474 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1addb525-175e-4181-9b1a-3d89fd1e1aab None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:53.232394 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 191/387] 10.222.0.79 () {56 vars in 1180 bytes} [Fri Sep 2 21:01:53 2022] GET /identity/v3/groups/b8708a26a9594d24a8a786db404e93ae => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:53.238278 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65861d0a-c5c8-4a4e-904a-88bf8ef21629 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:53.280233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:53.389995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65861d0a-c5c8-4a4e-904a-88bf8ef21629 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:53.434805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac9bc4-bc95-4a19-ae93-79704b96cf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:53.435476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac9bc4-bc95-4a19-ae93-79704b96cf13 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:53.435760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac9bc4-bc95-4a19-ae93-79704b96cf13 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:53.436039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac9bc4-bc95-4a19-ae93-79704b96cf13 None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:53.442537 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac9bc4-bc95-4a19-ae93-79704b96cf13 None admin] RBAC: Authorizing `identity:get_project(project_id=8ede2fe0b38f4061965d7dbc9aef29a9)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:53.444090 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac9bc4-bc95-4a19-ae93-79704b96cf13 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:53.446236 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 197/388] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:53 2022] GET /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:53.452077 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addb525-175e-4181-9b1a-3d89fd1e1aab None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:53.506235 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:53.559128 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac9bc4-bc95-4a19-ae93-79704b96cf13 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:53.574713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addb525-175e-4181-9b1a-3d89fd1e1aab None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:53.626986 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c1f60-acce-4ffd-9797-ccb4b0d197c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:53.627664 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c1f60-acce-4ffd-9797-ccb4b0d197c0 None admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:53.627946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c1f60-acce-4ffd-9797-ccb4b0d197c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:53.628226 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c1f60-acce-4ffd-9797-ccb4b0d197c0 None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9/groups/b8708a26a9594d24a8a786db404e93ae/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:53.633741 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c1f60-acce-4ffd-9797-ccb4b0d197c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ede2fe0b38f4061965d7dbc9aef29a9, group_id=b8708a26a9594d24a8a786db404e93ae, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:53.635231 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c1f60-acce-4ffd-9797-ccb4b0d197c0 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:53.705603 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:53.716670 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac9bc4-bc95-4a19-ae93-79704b96cf13 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:53.733323 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 192/389] 10.222.0.79 () {58 vars in 1442 bytes} [Fri Sep 2 21:01:53 2022] PUT /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9/groups/b8708a26a9594d24a8a786db404e93ae/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:01:53.734896 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c30d4-041a-4b97-a94d-af55bea2d5ba None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:53.735615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c30d4-041a-4b97-a94d-af55bea2d5ba None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:53.735932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c30d4-041a-4b97-a94d-af55bea2d5ba None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:53.740316 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 193/390] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:53.752250 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095948e1-19bc-460b-affb-3a61c65c2013 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:53.752622 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095948e1-19bc-460b-affb-3a61c65c2013 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:53.752972 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095948e1-19bc-460b-affb-3a61c65c2013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:53.784447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6de85-bc78-4883-aa44-c8500cdb5d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:53.785661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6de85-bc78-4883-aa44-c8500cdb5d9f None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:53.786113 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6de85-bc78-4883-aa44-c8500cdb5d9f None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:53.786546 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6de85-bc78-4883-aa44-c8500cdb5d9f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:53.797048 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-095948e1-19bc-460b-affb-3a61c65c2013 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:53.799941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-095948e1-19bc-460b-affb-3a61c65c2013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:53.813332 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6de85-bc78-4883-aa44-c8500cdb5d9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:53.819888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-11e6de85-bc78-4883-aa44-c8500cdb5d9f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:53.819888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:53.819888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:53.819888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:53.819888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:53.819888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:53.819888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:53.819888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:53.819888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:53.819888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:53.819888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:53.819888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:53.819888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:53.819888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:53.819888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:53.819888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:53.821070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:53.821070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:53.821070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:53.821070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:53.821070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:53.821070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:53.821070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:53.821070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:53.821070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:53.821070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:53.821070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:53.821070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:53.821070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:53.821070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:53.821070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:53.821070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:53.822112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:53.822112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:53.822112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:53.822112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:53.822112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:53.822112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:53.822112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:53.822112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:53.822112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:53.822112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:53.822112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:53.822112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:53.824971 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 198/391] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Sep 2 21:01:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:53.834451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6de85-bc78-4883-aa44-c8500cdb5d9f None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:53.977416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 194/392] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:53.994725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6de85-bc78-4883-aa44-c8500cdb5d9f None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:54.029755 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36e4de-f549-4386-b281-5b994ea84e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:54.030395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36e4de-f549-4386-b281-5b994ea84e58 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:54.030674 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36e4de-f549-4386-b281-5b994ea84e58 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:54.030959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36e4de-f549-4386-b281-5b994ea84e58 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:54.031785 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36e4de-f549-4386-b281-5b994ea84e58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:54.032247 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36e4de-f549-4386-b281-5b994ea84e58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:54.034655 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36e4de-f549-4386-b281-5b994ea84e58 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:54.046131 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 199/393] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:54.051819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095948e1-19bc-460b-affb-3a61c65c2013 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:54.091194 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:54.177940 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095948e1-19bc-460b-affb-3a61c65c2013 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:54.222523 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e863fc-4005-4be2-862f-07803589f397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:54.223268 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e863fc-4005-4be2-862f-07803589f397 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:54.223615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e863fc-4005-4be2-862f-07803589f397 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:54.223898 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e863fc-4005-4be2-862f-07803589f397 None admin] PATH_INFO: `/v3/groups/b8708a26a9594d24a8a786db404e93ae` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:54.230720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e863fc-4005-4be2-862f-07803589f397 None admin] RBAC: Authorizing `identity:get_group(group_id=b8708a26a9594d24a8a786db404e93ae)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:54.232321 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e863fc-4005-4be2-862f-07803589f397 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:54.234536 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 195/394] 10.222.0.79 () {56 vars in 1180 bytes} [Fri Sep 2 21:01:54 2022] GET /identity/v3/groups/b8708a26a9594d24a8a786db404e93ae => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:54.241731 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36e4de-f549-4386-b281-5b994ea84e58 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:54.269075 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:54.394667 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36e4de-f549-4386-b281-5b994ea84e58 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:54.407075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e863fc-4005-4be2-862f-07803589f397 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:54.437888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be202b95-d972-49ef-ba55-d3b34efce4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:54.438524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be202b95-d972-49ef-ba55-d3b34efce4fe None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:54.438909 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be202b95-d972-49ef-ba55-d3b34efce4fe None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:54.439326 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be202b95-d972-49ef-ba55-d3b34efce4fe None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:54.440445 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be202b95-d972-49ef-ba55-d3b34efce4fe None admin] RBAC: Authorizing `identity:get_project(project_id=8ede2fe0b38f4061965d7dbc9aef29a9)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:54.441945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be202b95-d972-49ef-ba55-d3b34efce4fe None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:54.444068 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 200/395] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:54 2022] GET /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:54.458352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be202b95-d972-49ef-ba55-d3b34efce4fe None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:54.552485 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:54.556723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e863fc-4005-4be2-862f-07803589f397 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:54.586962 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:54.597140 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e122aa-eb63-443c-a61d-8b4bcfb739ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:54.597785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e122aa-eb63-443c-a61d-8b4bcfb739ac None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:54.598101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e122aa-eb63-443c-a61d-8b4bcfb739ac None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:54.598376 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e122aa-eb63-443c-a61d-8b4bcfb739ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:54.614452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e122aa-eb63-443c-a61d-8b4bcfb739ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:54.615474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be202b95-d972-49ef-ba55-d3b34efce4fe None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:54.620424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-f8e122aa-eb63-443c-a61d-8b4bcfb739ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:54.620424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:54.620424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:54.620424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:54.620424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:54.620424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:54.620424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:54.620424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:54.620424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:54.620424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:54.620424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:54.620424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:54.620424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:54.620424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:54.620424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:54.620424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:54.621413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:54.621413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:54.621413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:54.621413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:54.621413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:54.621413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:54.621413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:54.621413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:54.621413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:54.621413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:54.621413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:54.621413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:54.621413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:54.621413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:54.621413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:54.621413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:54.622266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:54.622266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:54.622266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:54.622266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:54.622266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:54.622266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:54.622266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:54.622266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:54.622266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:54.622266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:54.622266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:54.622266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:54.622266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 196/396] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:54.623085 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc695111-9c7d-489b-8f73-6c89511a717a None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:54.623703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc695111-9c7d-489b-8f73-6c89511a717a None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:54.623703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc695111-9c7d-489b-8f73-6c89511a717a None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:54.625119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 197/397] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:54.630598 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc695111-9c7d-489b-8f73-6c89511a717a None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:54.665739 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9fb6d-6c29-4390-ab0d-110e234153fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:54.666482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9fb6d-6c29-4390-ab0d-110e234153fe None admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:54.666762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9fb6d-6c29-4390-ab0d-110e234153fe None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:54.668358 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9fb6d-6c29-4390-ab0d-110e234153fe None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9/groups/b8708a26a9594d24a8a786db404e93ae/roles/5feee6c423414badb9c65ac4076a7f45` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:54.671366 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9fb6d-6c29-4390-ab0d-110e234153fe None admin] RBAC: Authorizing `identity:create_grant(project_id=8ede2fe0b38f4061965d7dbc9aef29a9, group_id=b8708a26a9594d24a8a786db404e93ae, role_id=5feee6c423414badb9c65ac4076a7f45)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:54.673954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9fb6d-6c29-4390-ab0d-110e234153fe None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:54.759310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc695111-9c7d-489b-8f73-6c89511a717a None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:54.763583 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 201/398] 10.222.0.79 () {58 vars in 1442 bytes} [Fri Sep 2 21:01:54 2022] PUT /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9/groups/b8708a26a9594d24a8a786db404e93ae/roles/5feee6c423414badb9c65ac4076a7f45 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:01:54.771092 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837f951-edcc-48d8-aa35-21211625198b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:54.771412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837f951-edcc-48d8-aa35-21211625198b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:54.771695 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837f951-edcc-48d8-aa35-21211625198b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:54.809991 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-0837f951-edcc-48d8-aa35-21211625198b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:54.811456 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-0837f951-edcc-48d8-aa35-21211625198b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:54.832167 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e9e34-80df-4022-ac2b-59400494e022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:54.832806 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e9e34-80df-4022-ac2b-59400494e022 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:54.833088 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e9e34-80df-4022-ac2b-59400494e022 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:54.833371 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e9e34-80df-4022-ac2b-59400494e022 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:54.834102 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e9e34-80df-4022-ac2b-59400494e022 None admin] RBAC: Adding query filter params (name=member) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:54.834413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e9e34-80df-4022-ac2b-59400494e022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:54.835901 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e9e34-80df-4022-ac2b-59400494e022 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:54.853730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 198/399] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:54.866969 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e9e34-80df-4022-ac2b-59400494e022 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:54.921271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 202/400] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:54.950736 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:55.068000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e9e34-80df-4022-ac2b-59400494e022 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:55.087922 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a3d29-a107-4c78-b290-a030eaa8774e None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:55.088217 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a3d29-a107-4c78-b290-a030eaa8774e None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:55.088501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a3d29-a107-4c78-b290-a030eaa8774e None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:55.090018 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 203/401] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:55.095592 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac892f-2830-4f6a-8641-2353434bc197 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:55.096095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac892f-2830-4f6a-8641-2353434bc197 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:55.096383 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac892f-2830-4f6a-8641-2353434bc197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:55.119577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93162aba-0baf-4edc-a36d-f7a9df9f24ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:55.120607 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93162aba-0baf-4edc-a36d-f7a9df9f24ab None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:55.121882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93162aba-0baf-4edc-a36d-f7a9df9f24ab None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:55.122342 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93162aba-0baf-4edc-a36d-f7a9df9f24ab None admin] PATH_INFO: `/v3/groups/b8708a26a9594d24a8a786db404e93ae` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:55.124757 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93162aba-0baf-4edc-a36d-f7a9df9f24ab None admin] RBAC: Authorizing `identity:get_group(group_id=b8708a26a9594d24a8a786db404e93ae)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:55.129718 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93162aba-0baf-4edc-a36d-f7a9df9f24ab None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:55.131603 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 199/402] 10.222.0.79 () {56 vars in 1180 bytes} [Fri Sep 2 21:01:54 2022] GET /identity/v3/groups/b8708a26a9594d24a8a786db404e93ae => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:55.132871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-8dac892f-2830-4f6a-8641-2353434bc197 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:55.134321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-8dac892f-2830-4f6a-8641-2353434bc197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:55.137156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93162aba-0baf-4edc-a36d-f7a9df9f24ab None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:55.270264 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:55.282499 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93162aba-0baf-4edc-a36d-f7a9df9f24ab None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:55.307535 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:55.313373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 204/403] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:55.314445 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac892f-2830-4f6a-8641-2353434bc197 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:55.343168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119ea49-ee50-4158-98d7-da71ec26ee2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:55.343833 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119ea49-ee50-4158-98d7-da71ec26ee2d None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:55.344123 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119ea49-ee50-4158-98d7-da71ec26ee2d None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:55.344406 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119ea49-ee50-4158-98d7-da71ec26ee2d None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:55.350567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119ea49-ee50-4158-98d7-da71ec26ee2d None admin] RBAC: Authorizing `identity:get_project(project_id=b3d0577467b84edf9244abafa997d81b)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:55.352126 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119ea49-ee50-4158-98d7-da71ec26ee2d None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:55.354067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 200/404] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:55 2022] GET /identity/v3/projects/b3d0577467b84edf9244abafa997d81b => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:55.363975 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119ea49-ee50-4158-98d7-da71ec26ee2d None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:55.435968 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac892f-2830-4f6a-8641-2353434bc197 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:55.480764 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3db439-8bdc-41a2-9650-5aebe557315d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:55.481476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3db439-8bdc-41a2-9650-5aebe557315d None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:55.481768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3db439-8bdc-41a2-9650-5aebe557315d None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:55.482072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3db439-8bdc-41a2-9650-5aebe557315d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:55.494549 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3db439-8bdc-41a2-9650-5aebe557315d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:55.502387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-3c3db439-8bdc-41a2-9650-5aebe557315d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:55.502387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:55.502387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:55.502387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:55.502387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:55.502387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:55.502387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:55.502387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:55.502387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:55.502387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:55.502387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:55.502387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:55.502387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:55.502387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:55.502387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:55.502387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:55.503397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:55.503397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:55.503397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:55.503397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:55.503397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:55.503397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:55.503397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:55.503397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:55.503397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:55.503397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:55.503397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:55.503397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:55.503397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:55.503397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:55.503397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:55.503397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:55.504190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:55.504190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:55.504190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:55.504190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:55.504190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:55.504190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:55.504190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:55.504190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:55.504190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:55.504190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:55.504190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:55.504190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:55.504190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 205/405] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Sep 2 21:01:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:55.513830 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3db439-8bdc-41a2-9650-5aebe557315d None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:55.586311 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:55.603841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119ea49-ee50-4158-98d7-da71ec26ee2d None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:55.631715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3db439-8bdc-41a2-9650-5aebe557315d None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:55.656632 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62c7e0-0278-4f9f-ad60-311efe810978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:55.657300 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62c7e0-0278-4f9f-ad60-311efe810978 None admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:55.658304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62c7e0-0278-4f9f-ad60-311efe810978 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:55.658589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62c7e0-0278-4f9f-ad60-311efe810978 None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b/groups/b8708a26a9594d24a8a786db404e93ae/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:55.660570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62c7e0-0278-4f9f-ad60-311efe810978 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3d0577467b84edf9244abafa997d81b, group_id=b8708a26a9594d24a8a786db404e93ae, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:55.662048 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62c7e0-0278-4f9f-ad60-311efe810978 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:55.683011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19fc9b-6a9d-41fe-8651-983d634e5ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:55.683910 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19fc9b-6a9d-41fe-8651-983d634e5ab5 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:55.684556 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19fc9b-6a9d-41fe-8651-983d634e5ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:55.684906 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19fc9b-6a9d-41fe-8651-983d634e5ab5 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:55.685657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19fc9b-6a9d-41fe-8651-983d634e5ab5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:55.686053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19fc9b-6a9d-41fe-8651-983d634e5ab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:55.689076 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19fc9b-6a9d-41fe-8651-983d634e5ab5 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:55.698742 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 206/406] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:55.703399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19fc9b-6a9d-41fe-8651-983d634e5ab5 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:55.796422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 201/407] 10.222.0.79 () {58 vars in 1442 bytes} [Fri Sep 2 21:01:55 2022] PUT /identity/v3/projects/b3d0577467b84edf9244abafa997d81b/groups/b8708a26a9594d24a8a786db404e93ae/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:01:55.797277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62c7e0-0278-4f9f-ad60-311efe810978 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:55.847777 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:55.850248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19fc9b-6a9d-41fe-8651-983d634e5ab5 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:55.900054 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:55.932661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ff832-8f95-4357-b63a-bfeacf2e23a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:55.933319 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ff832-8f95-4357-b63a-bfeacf2e23a4 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:55.933600 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ff832-8f95-4357-b63a-bfeacf2e23a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:55.933894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ff832-8f95-4357-b63a-bfeacf2e23a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:55.957607 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ff832-8f95-4357-b63a-bfeacf2e23a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:55.966864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-916ff832-8f95-4357-b63a-bfeacf2e23a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:55.966864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:55.966864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:55.966864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:55.966864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:55.966864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:55.966864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:55.966864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:55.966864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:55.966864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:55.966864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:55.966864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:55.966864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:55.966864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:55.966864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:55.966864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:55.969763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:55.969763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:55.969763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:55.969763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:55.969763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:55.969763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:55.969763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:55.969763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:55.969763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:55.969763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:55.969763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:55.969763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:55.969763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:55.969763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:55.969763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:55.969763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:55.971305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:55.971305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:55.971305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:55.971305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:55.971305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:55.971305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:55.971305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:55.971305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:55.971305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:55.971305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:55.971305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:01:55.971305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:55.971305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 207/408] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:01:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:55.978608 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ff832-8f95-4357-b63a-bfeacf2e23a4 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:56.028403 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62c7e0-0278-4f9f-ad60-311efe810978 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:56.098101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9ad10-40f2-4f8d-8efd-1e6e8cb369f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:56.098675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9ad10-40f2-4f8d-8efd-1e6e8cb369f3 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:56.098959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9ad10-40f2-4f8d-8efd-1e6e8cb369f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:56.099236 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9ad10-40f2-4f8d-8efd-1e6e8cb369f3 None admin] PATH_INFO: `/v3/groups/b8708a26a9594d24a8a786db404e93ae` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:56.101751 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9ad10-40f2-4f8d-8efd-1e6e8cb369f3 None admin] RBAC: Authorizing `identity:get_group(group_id=b8708a26a9594d24a8a786db404e93ae)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:56.104977 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9ad10-40f2-4f8d-8efd-1e6e8cb369f3 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:56.118008 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 202/409] 10.222.0.79 () {56 vars in 1180 bytes} [Fri Sep 2 21:01:55 2022] GET /identity/v3/groups/b8708a26a9594d24a8a786db404e93ae => generated 226 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:56.120215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9ad10-40f2-4f8d-8efd-1e6e8cb369f3 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:56.150226 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ff832-8f95-4357-b63a-bfeacf2e23a4 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:56.200788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02abff-3151-4ec2-9a4f-35f975bc9c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:56.201404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02abff-3151-4ec2-9a4f-35f975bc9c9d None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:56.201696 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02abff-3151-4ec2-9a4f-35f975bc9c9d None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:56.202005 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02abff-3151-4ec2-9a4f-35f975bc9c9d None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:56.202648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02abff-3151-4ec2-9a4f-35f975bc9c9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:56.202950 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02abff-3151-4ec2-9a4f-35f975bc9c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:56.204901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02abff-3151-4ec2-9a4f-35f975bc9c9d None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:56.216063 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 208/410] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:56.217976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958a991-6c15-494e-9f2b-c5eab6df90eb None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:56.218271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958a991-6c15-494e-9f2b-c5eab6df90eb None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:56.218554 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958a991-6c15-494e-9f2b-c5eab6df90eb None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:56.220990 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 209/411] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:56.225602 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958a991-6c15-494e-9f2b-c5eab6df90eb None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:56.276000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:56.283746 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:56.295565 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9ad10-40f2-4f8d-8efd-1e6e8cb369f3 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:56.337956 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47436671-7d87-48c4-9ce8-28807fe3afe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:56.338599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47436671-7d87-48c4-9ce8-28807fe3afe6 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:56.338881 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47436671-7d87-48c4-9ce8-28807fe3afe6 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:56.339160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47436671-7d87-48c4-9ce8-28807fe3afe6 None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:56.340311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47436671-7d87-48c4-9ce8-28807fe3afe6 None admin] RBAC: Authorizing `identity:get_project(project_id=b3d0577467b84edf9244abafa997d81b)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:56.341818 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47436671-7d87-48c4-9ce8-28807fe3afe6 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:56.343833 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 203/412] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:56 2022] GET /identity/v3/projects/b3d0577467b84edf9244abafa997d81b => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:56.347095 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cda3c-1ad5-4d81-a72b-3202afb4db4a None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:56.347396 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cda3c-1ad5-4d81-a72b-3202afb4db4a None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:56.347678 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cda3c-1ad5-4d81-a72b-3202afb4db4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:56.359137 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958a991-6c15-494e-9f2b-c5eab6df90eb None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:56.370400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-f90cda3c-1ad5-4d81-a72b-3202afb4db4a None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:56.371929 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f90cda3c-1ad5-4d81-a72b-3202afb4db4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:56.399346 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb352e00-8fc6-4b0e-b09a-181c7ae6c703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:56.400142 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb352e00-8fc6-4b0e-b09a-181c7ae6c703 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:56.400429 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb352e00-8fc6-4b0e-b09a-181c7ae6c703 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:56.400705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb352e00-8fc6-4b0e-b09a-181c7ae6c703 None admin] PATH_INFO: `/v3/groups/d6952e07a89647d8b03b03a37b4de07d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:56.402000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb352e00-8fc6-4b0e-b09a-181c7ae6c703 None admin] RBAC: Authorizing `identity:get_group(group_id=d6952e07a89647d8b03b03a37b4de07d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:56.403596 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb352e00-8fc6-4b0e-b09a-181c7ae6c703 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:56.405449 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 210/413] 10.222.0.79 () {56 vars in 1180 bytes} [Fri Sep 2 21:01:56 2022] GET /identity/v3/groups/d6952e07a89647d8b03b03a37b4de07d => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:56.406146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb352e00-8fc6-4b0e-b09a-181c7ae6c703 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:56.475720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 204/414] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:01:56.476609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cda3c-1ad5-4d81-a72b-3202afb4db4a None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:56.551071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb352e00-8fc6-4b0e-b09a-181c7ae6c703 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:56.580024 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:56.614416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:56.634583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cda3c-1ad5-4d81-a72b-3202afb4db4a None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:56.674340 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc94eb-fce3-4d8e-8ea2-bef1ca81b3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:56.675111 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc94eb-fce3-4d8e-8ea2-bef1ca81b3d3 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:56.675401 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc94eb-fce3-4d8e-8ea2-bef1ca81b3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:56.675679 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc94eb-fce3-4d8e-8ea2-bef1ca81b3d3 None admin] PATH_INFO: `/v3/projects/c04c8d4bc7dc450a92b56e01849b9dc9` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:56.676851 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc94eb-fce3-4d8e-8ea2-bef1ca81b3d3 None admin] RBAC: Authorizing `identity:get_project(project_id=c04c8d4bc7dc450a92b56e01849b9dc9)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:56.678465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc94eb-fce3-4d8e-8ea2-bef1ca81b3d3 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:56.680248 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 205/415] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:56 2022] GET /identity/v3/projects/c04c8d4bc7dc450a92b56e01849b9dc9 => generated 344 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:56.685906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc94eb-fce3-4d8e-8ea2-bef1ca81b3d3 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:56.694545 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79708a-3f85-4091-8979-689db2132fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:56.695234 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79708a-3f85-4091-8979-689db2132fe5 None admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:56.695527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79708a-3f85-4091-8979-689db2132fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:56.695804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79708a-3f85-4091-8979-689db2132fe5 None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b/groups/b8708a26a9594d24a8a786db404e93ae/roles/5feee6c423414badb9c65ac4076a7f45` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:56.706681 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79708a-3f85-4091-8979-689db2132fe5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3d0577467b84edf9244abafa997d81b, group_id=b8708a26a9594d24a8a786db404e93ae, role_id=5feee6c423414badb9c65ac4076a7f45)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:56.712942 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79708a-3f85-4091-8979-689db2132fe5 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:56.807623 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc94eb-fce3-4d8e-8ea2-bef1ca81b3d3 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:56.824268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 211/416] 10.222.0.79 () {58 vars in 1442 bytes} [Fri Sep 2 21:01:56 2022] PUT /identity/v3/projects/b3d0577467b84edf9244abafa997d81b/groups/b8708a26a9594d24a8a786db404e93ae/roles/5feee6c423414badb9c65ac4076a7f45 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:01:56.834650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79708a-3f85-4091-8979-689db2132fe5 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:56.848865 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e148b4-a297-477f-8c78-b6e5164b1033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:56.850360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e148b4-a297-477f-8c78-b6e5164b1033 None admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:56.850664 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e148b4-a297-477f-8c78-b6e5164b1033 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:56.851008 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e148b4-a297-477f-8c78-b6e5164b1033 None admin] PATH_INFO: `/v3/projects/c04c8d4bc7dc450a92b56e01849b9dc9/groups/d6952e07a89647d8b03b03a37b4de07d/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:56.853134 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e148b4-a297-477f-8c78-b6e5164b1033 None admin] RBAC: Authorizing `identity:create_grant(project_id=c04c8d4bc7dc450a92b56e01849b9dc9, group_id=d6952e07a89647d8b03b03a37b4de07d, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:56.854689 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e148b4-a297-477f-8c78-b6e5164b1033 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:56.931875 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 206/417] 10.222.0.79 () {58 vars in 1442 bytes} [Fri Sep 2 21:01:56 2022] PUT /identity/v3/projects/c04c8d4bc7dc450a92b56e01849b9dc9/groups/d6952e07a89647d8b03b03a37b4de07d/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:01:56.978979 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79708a-3f85-4091-8979-689db2132fe5 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:57.022874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c68a4c-7d75-42bc-8762-aacbb8424b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:57.023599 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c68a4c-7d75-42bc-8762-aacbb8424b46 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:57.023891 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c68a4c-7d75-42bc-8762-aacbb8424b46 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:57.024168 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c68a4c-7d75-42bc-8762-aacbb8424b46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:57.037843 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c68a4c-7d75-42bc-8762-aacbb8424b46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:57.043564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-e0c68a4c-7d75-42bc-8762-aacbb8424b46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:57.043564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:57.043564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:57.043564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:57.043564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:57.043564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:57.043564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:57.043564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:57.043564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:57.043564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:57.043564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:57.043564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:57.043564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:57.043564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:57.043564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:57.043564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:57.044553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:57.044553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:57.044553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:57.044553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:57.044553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:57.044553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:57.044553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:57.044553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:57.044553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:57.044553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:57.044553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:57.044553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:57.044553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:57.044553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:57.044553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:57.044553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:57.045338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:57.045338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:57.045338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:57.045338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:57.045338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:57.045338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:57.045338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:57.045338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:57.045338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:57.045338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:57.045338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:57.045338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:57.045338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 212/418] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:57.052712 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e148b4-a297-477f-8c78-b6e5164b1033 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:57.070101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:57.076958 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42887e-af9c-4aed-856b-938097ba3e3d None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:57.077248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42887e-af9c-4aed-856b-938097ba3e3d None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:57.077591 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42887e-af9c-4aed-856b-938097ba3e3d None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:57.080261 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 213/419] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:57.086346 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcea74-8a86-449d-ab42-df8b308db8de None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:57.086872 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcea74-8a86-449d-ab42-df8b308db8de None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:57.165865 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcea74-8a86-449d-ab42-df8b308db8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:57.165865 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-c1bcea74-8a86-449d-ab42-df8b308db8de None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:57.165865 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-c1bcea74-8a86-449d-ab42-df8b308db8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:57.165865 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:57.169061 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e148b4-a297-477f-8c78-b6e5164b1033 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:57.214049 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 214/420] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:01:57.225380 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e88322-7c0b-42c6-bca0-a4b6061802b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:57.227324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e88322-7c0b-42c6-bca0-a4b6061802b2 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:57.227611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e88322-7c0b-42c6-bca0-a4b6061802b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:57.227891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e88322-7c0b-42c6-bca0-a4b6061802b2 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:57.233964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e88322-7c0b-42c6-bca0-a4b6061802b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:57.233964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e88322-7c0b-42c6-bca0-a4b6061802b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:57.233964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e88322-7c0b-42c6-bca0-a4b6061802b2 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:57.240228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 207/421] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:57.246078 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcea74-8a86-449d-ab42-df8b308db8de None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:57.355258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcea74-8a86-449d-ab42-df8b308db8de None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:57.392212 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e456b1-c8bf-43e2-8df9-e967d3d1c3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:57.393020 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e456b1-c8bf-43e2-8df9-e967d3d1c3a1 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:57.393314 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e456b1-c8bf-43e2-8df9-e967d3d1c3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:57.393587 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e456b1-c8bf-43e2-8df9-e967d3d1c3a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:57.424362 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:57.466448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e456b1-c8bf-43e2-8df9-e967d3d1c3a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:57.467917 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e456b1-c8bf-43e2-8df9-e967d3d1c3a1 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:57.566442 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e88322-7c0b-42c6-bca0-a4b6061802b2 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:57.577757 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 215/422] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:57.585587 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e456b1-c8bf-43e2-8df9-e967d3d1c3a1 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:57.661898 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:57.689397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:57.733404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e456b1-c8bf-43e2-8df9-e967d3d1c3a1 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:57.740912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e88322-7c0b-42c6-bca0-a4b6061802b2 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:57.775184 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6095b0-a433-4a28-9b0a-c36e05606f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:57.777451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6095b0-a433-4a28-9b0a-c36e05606f39 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:57.777451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6095b0-a433-4a28-9b0a-c36e05606f39 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:57.777451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6095b0-a433-4a28-9b0a-c36e05606f39 None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:57.777802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6095b0-a433-4a28-9b0a-c36e05606f39 None admin] RBAC: Authorizing `identity:get_project(project_id=8ede2fe0b38f4061965d7dbc9aef29a9)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:57.779551 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6095b0-a433-4a28-9b0a-c36e05606f39 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:57.781690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 216/423] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:57 2022] GET /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:57.788534 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6095b0-a433-4a28-9b0a-c36e05606f39 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:57.815227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27660b7-2055-4d4d-a135-32fba38e03e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:57.816260 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27660b7-2055-4d4d-a135-32fba38e03e1 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:57.816544 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27660b7-2055-4d4d-a135-32fba38e03e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:57.821892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27660b7-2055-4d4d-a135-32fba38e03e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:57.846810 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27660b7-2055-4d4d-a135-32fba38e03e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:57.852482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-f27660b7-2055-4d4d-a135-32fba38e03e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:57.852482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:57.852482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:57.852482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:57.852482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:57.852482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:57.852482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:57.852482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:57.852482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:57.852482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:57.852482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:57.852482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:57.852482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:57.852482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:57.852482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:57.852482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:57.853846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:57.853846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:57.853846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:57.853846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:57.853846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:57.853846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:57.853846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:57.853846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:57.853846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:57.853846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:57.853846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:57.853846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:57.853846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:57.853846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:57.853846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:57.853846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:57.854669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:57.854669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:57.854669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:57.854669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:57.854669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:57.854669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:57.854669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:57.854669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:57.854669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:57.854669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:57.854669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:57.854669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:57.854669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 208/424] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Sep 2 21:01:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:57.859420 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27660b7-2055-4d4d-a135-32fba38e03e1 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:57.915812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6095b0-a433-4a28-9b0a-c36e05606f39 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:57.949464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:57.966898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6f7a5-d367-4d9e-8078-200c201a015f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:57.969099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6f7a5-d367-4d9e-8078-200c201a015f None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:57.970324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6f7a5-d367-4d9e-8078-200c201a015f None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:57.972641 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6f7a5-d367-4d9e-8078-200c201a015f None admin] PATH_INFO: `/v3/groups/b8708a26a9594d24a8a786db404e93ae` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:57.977882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6f7a5-d367-4d9e-8078-200c201a015f None admin] RBAC: Authorizing `identity:get_group(group_id=b8708a26a9594d24a8a786db404e93ae)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:57.979386 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6f7a5-d367-4d9e-8078-200c201a015f None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:57.981157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 217/425] 10.222.0.79 () {56 vars in 1180 bytes} [Fri Sep 2 21:01:57 2022] GET /identity/v3/groups/b8708a26a9594d24a8a786db404e93ae => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:57.998756 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6f7a5-d367-4d9e-8078-200c201a015f None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:58.039193 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27660b7-2055-4d4d-a135-32fba38e03e1 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:58.072709 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:58.083649 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00d87a-8cc3-44de-9bdf-cf2d0c72a2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:58.084618 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00d87a-8cc3-44de-9bdf-cf2d0c72a2c6 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:58.087445 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00d87a-8cc3-44de-9bdf-cf2d0c72a2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:58.087445 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00d87a-8cc3-44de-9bdf-cf2d0c72a2c6 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:58.087887 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00d87a-8cc3-44de-9bdf-cf2d0c72a2c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:58.088401 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00d87a-8cc3-44de-9bdf-cf2d0c72a2c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:58.090059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00d87a-8cc3-44de-9bdf-cf2d0c72a2c6 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:58.108139 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 209/426] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:01:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:58.119174 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00d87a-8cc3-44de-9bdf-cf2d0c72a2c6 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:58.152948 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6f7a5-d367-4d9e-8078-200c201a015f None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:58.198662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ec1a8-25fa-4e6a-bcc9-ee6c6a339c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:58.199564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ec1a8-25fa-4e6a-bcc9-ee6c6a339c0e None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:58.199850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ec1a8-25fa-4e6a-bcc9-ee6c6a339c0e None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:58.200125 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ec1a8-25fa-4e6a-bcc9-ee6c6a339c0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:58.200860 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ec1a8-25fa-4e6a-bcc9-ee6c6a339c0e None admin] RBAC: Adding query filter params (group.id=b8708a26a9594d24a8a786db404e93ae, role.id=17200f478f4f42afb0a4d42b5da2183d, scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:58.201174 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ec1a8-25fa-4e6a-bcc9-ee6c6a339c0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:58.203110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ec1a8-25fa-4e6a-bcc9-ee6c6a339c0e None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:58.211830 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 218/427] 10.222.0.79 () {56 vars in 1376 bytes} [Fri Sep 2 21:01:57 2022] GET /identity/v3/role_assignments?group.id=b8708a26a9594d24a8a786db404e93ae&scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9&role.id=17200f478f4f42afb0a4d42b5da2183d => generated 611 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:58.213751 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229a3b0-6f5a-46e0-9985-b10a7bf918ae None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:58.214209 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229a3b0-6f5a-46e0-9985-b10a7bf918ae None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:58.214487 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229a3b0-6f5a-46e0-9985-b10a7bf918ae None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:58.217900 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 219/428] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:58.223294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ef8fc-89b4-4e3d-b00b-57bd22c71deb None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:58.223624 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ef8fc-89b4-4e3d-b00b-57bd22c71deb None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:58.223858 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ef8fc-89b4-4e3d-b00b-57bd22c71deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:58.247151 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-f98ef8fc-89b4-4e3d-b00b-57bd22c71deb None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:58.248721 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f98ef8fc-89b4-4e3d-b00b-57bd22c71deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:58.273455 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00d87a-8cc3-44de-9bdf-cf2d0c72a2c6 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:58.358381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297f21a-6d93-4bfe-bcc8-16e2105d6c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:58.359484 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297f21a-6d93-4bfe-bcc8-16e2105d6c92 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:58.359967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297f21a-6d93-4bfe-bcc8-16e2105d6c92 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:58.361136 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297f21a-6d93-4bfe-bcc8-16e2105d6c92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:58.366193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:58.391043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 220/429] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:01:58.445729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:58.453339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297f21a-6d93-4bfe-bcc8-16e2105d6c92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:58.455197 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297f21a-6d93-4bfe-bcc8-16e2105d6c92 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:58.566281 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 210/430] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:58.570375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ef8fc-89b4-4e3d-b00b-57bd22c71deb None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:58.679311 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ef8fc-89b4-4e3d-b00b-57bd22c71deb None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:58.725414 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a037dc4-9096-435d-96ed-aac731e5cb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:58.726157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a037dc4-9096-435d-96ed-aac731e5cb9b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:58.726446 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a037dc4-9096-435d-96ed-aac731e5cb9b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:58.726726 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a037dc4-9096-435d-96ed-aac731e5cb9b None admin] PATH_INFO: `/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:58.727879 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a037dc4-9096-435d-96ed-aac731e5cb9b None admin] RBAC: Authorizing `identity:get_project(project_id=8ede2fe0b38f4061965d7dbc9aef29a9)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:58.729349 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a037dc4-9096-435d-96ed-aac731e5cb9b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:58.736251 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 221/431] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:58 2022] GET /identity/v3/projects/8ede2fe0b38f4061965d7dbc9aef29a9 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:58.745344 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297f21a-6d93-4bfe-bcc8-16e2105d6c92 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:58.745481 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a037dc4-9096-435d-96ed-aac731e5cb9b None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:58.837563 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:58.903044 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:58.911323 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297f21a-6d93-4bfe-bcc8-16e2105d6c92 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:58.911507 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a037dc4-9096-435d-96ed-aac731e5cb9b None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:58.955346 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0f708-12f0-41e3-8a73-4266cf2dd7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:58.955712 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e910f1-f645-47bd-92ce-a38baa9c1be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:58.955999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0f708-12f0-41e3-8a73-4266cf2dd7a1 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:58.956283 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0f708-12f0-41e3-8a73-4266cf2dd7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:58.956561 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0f708-12f0-41e3-8a73-4266cf2dd7a1 None admin] PATH_INFO: `/v3/groups/b8708a26a9594d24a8a786db404e93ae` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:58.957126 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e910f1-f645-47bd-92ce-a38baa9c1be1 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:58.957578 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e910f1-f645-47bd-92ce-a38baa9c1be1 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:58.957723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0f708-12f0-41e3-8a73-4266cf2dd7a1 None admin] RBAC: Authorizing `identity:get_group(group_id=b8708a26a9594d24a8a786db404e93ae)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:58.958101 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e910f1-f645-47bd-92ce-a38baa9c1be1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:58.959591 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0f708-12f0-41e3-8a73-4266cf2dd7a1 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:58.962333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 211/432] 10.222.0.79 () {56 vars in 1180 bytes} [Fri Sep 2 21:01:58 2022] GET /identity/v3/groups/b8708a26a9594d24a8a786db404e93ae => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:58.968316 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0f708-12f0-41e3-8a73-4266cf2dd7a1 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:58.971532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e910f1-f645-47bd-92ce-a38baa9c1be1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:58.978413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-47e910f1-f645-47bd-92ce-a38baa9c1be1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:58.978413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:58.978413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:58.978413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:58.978413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:58.978413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:58.978413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:58.978413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:58.978413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:58.978413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:58.978413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:58.978413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:58.978413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:58.978413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:58.978413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:58.978413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:58.979989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:58.979989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:58.979989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:58.979989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:58.979989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:58.979989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:58.979989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:58.979989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:58.979989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:58.979989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:58.979989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:58.979989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:58.979989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:58.979989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:58.979989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:58.979989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:58.980978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:58.980978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:58.980978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:58.980978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:58.980978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:58.980978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:58.980978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:58.980978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:58.980978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:58.980978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:58.980978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 02 21:01:58.980978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:01:58.986886 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 222/433] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:01:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:01:58.994409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e910f1-f645-47bd-92ce-a38baa9c1be1 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:59.104586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0f708-12f0-41e3-8a73-4266cf2dd7a1 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:59.119425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e910f1-f645-47bd-92ce-a38baa9c1be1 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:59.140532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:59.145659 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acba180-6450-4eaa-865a-12f3053dc373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:59.146717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acba180-6450-4eaa-865a-12f3053dc373 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:59.147148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acba180-6450-4eaa-865a-12f3053dc373 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:59.147568 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acba180-6450-4eaa-865a-12f3053dc373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:59.148452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acba180-6450-4eaa-865a-12f3053dc373 None admin] RBAC: Adding query filter params (group.id=b8708a26a9594d24a8a786db404e93ae, role.id=5feee6c423414badb9c65ac4076a7f45, scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:59.155336 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acba180-6450-4eaa-865a-12f3053dc373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:59.155336 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acba180-6450-4eaa-865a-12f3053dc373 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:59.157444 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 212/434] 10.222.0.79 () {56 vars in 1376 bytes} [Fri Sep 2 21:01:58 2022] GET /identity/v3/role_assignments?group.id=b8708a26a9594d24a8a786db404e93ae&scope.project.id=8ede2fe0b38f4061965d7dbc9aef29a9&role.id=5feee6c423414badb9c65ac4076a7f45 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:59.163097 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd253aaa-0156-45b8-970f-56a24ab0c8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:59.163097 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd253aaa-0156-45b8-970f-56a24ab0c8a6 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:59.163097 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd253aaa-0156-45b8-970f-56a24ab0c8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:59.163097 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd253aaa-0156-45b8-970f-56a24ab0c8a6 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:59.163534 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd253aaa-0156-45b8-970f-56a24ab0c8a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:01:59.169839 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd253aaa-0156-45b8-970f-56a24ab0c8a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:59.169839 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd253aaa-0156-45b8-970f-56a24ab0c8a6 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:59.177069 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 223/435] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:01:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:59.193203 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acba180-6450-4eaa-865a-12f3053dc373 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:59.233278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:59.331783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acba180-6450-4eaa-865a-12f3053dc373 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:59.369185 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2fdb4-5be3-409a-ab4b-c8b6f3e147ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:59.369723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2fdb4-5be3-409a-ab4b-c8b6f3e147ae None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:59.370036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2fdb4-5be3-409a-ab4b-c8b6f3e147ae None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:59.370343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2fdb4-5be3-409a-ab4b-c8b6f3e147ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:59.387712 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e4662-ba73-462b-af0c-e5f4531feb9e None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:59.388361 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e4662-ba73-462b-af0c-e5f4531feb9e None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:59.388705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e4662-ba73-462b-af0c-e5f4531feb9e None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:59.390460 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 224/436] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:59.396713 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0e8e8-1eac-47aa-9faa-9899432ad0a8 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:59.397005 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0e8e8-1eac-47aa-9faa-9899432ad0a8 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:59.397269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0e8e8-1eac-47aa-9faa-9899432ad0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:59.420511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-bac0e8e8-1eac-47aa-9faa-9899432ad0a8 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:59.424429 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-bac0e8e8-1eac-47aa-9faa-9899432ad0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:59.462896 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2fdb4-5be3-409a-ab4b-c8b6f3e147ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:59.464926 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2fdb4-5be3-409a-ab4b-c8b6f3e147ae None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:59.496105 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:59.512079 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 225/437] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:01:59.514501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7576b-4c69-41c9-a8e5-6f2836c2d154 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:59.514775 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7576b-4c69-41c9-a8e5-6f2836c2d154 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:59.515051 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7576b-4c69-41c9-a8e5-6f2836c2d154 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:59.517883 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 226/438] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:01:59.522999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3f40c-96ec-45bc-82a5-f6c9bbdffd95 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:59.523287 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3f40c-96ec-45bc-82a5-f6c9bbdffd95 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:59.523568 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3f40c-96ec-45bc-82a5-f6c9bbdffd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:59.545212 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-8be3f40c-96ec-45bc-82a5-f6c9bbdffd95 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:01:59.546386 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-8be3f40c-96ec-45bc-82a5-f6c9bbdffd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:01:59.585581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 213/439] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:01:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:01:59.591422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2fdb4-5be3-409a-ab4b-c8b6f3e147ae None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:59.640309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 227/440] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:01:59.716529 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2fdb4-5be3-409a-ab4b-c8b6f3e147ae None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:59.746234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:59.759430 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579e360-7142-4fe5-a496-71d5cec7208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:59.760077 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579e360-7142-4fe5-a496-71d5cec7208e None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:59.760413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579e360-7142-4fe5-a496-71d5cec7208e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:59.760696 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579e360-7142-4fe5-a496-71d5cec7208e None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:59.761865 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579e360-7142-4fe5-a496-71d5cec7208e None admin] RBAC: Authorizing `identity:get_project(project_id=b3d0577467b84edf9244abafa997d81b)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:59.763321 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579e360-7142-4fe5-a496-71d5cec7208e None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:59.765114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 214/441] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:01:59 2022] GET /identity/v3/projects/b3d0577467b84edf9244abafa997d81b => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:01:59.771337 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3f40c-96ec-45bc-82a5-f6c9bbdffd95 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:59.792299 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579e360-7142-4fe5-a496-71d5cec7208e None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:59.818197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:01:59.883728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3f40c-96ec-45bc-82a5-f6c9bbdffd95 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:59.904829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579e360-7142-4fe5-a496-71d5cec7208e None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:01:59.920754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d89ec-abef-4e1a-a6d3-98fa55b8302d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:59.921501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d89ec-abef-4e1a-a6d3-98fa55b8302d None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:59.921784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d89ec-abef-4e1a-a6d3-98fa55b8302d None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:59.922088 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d89ec-abef-4e1a-a6d3-98fa55b8302d None admin] PATH_INFO: `/v3/groups/b8708a26a9594d24a8a786db404e93ae` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:59.923907 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d89ec-abef-4e1a-a6d3-98fa55b8302d None admin] RBAC: Authorizing `identity:get_group(group_id=b8708a26a9594d24a8a786db404e93ae)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:01:59.925514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d89ec-abef-4e1a-a6d3-98fa55b8302d None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:01:59.927109 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 228/442] 10.222.0.79 () {56 vars in 1180 bytes} [Fri Sep 2 21:01:59 2022] GET /identity/v3/groups/b8708a26a9594d24a8a786db404e93ae => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:01:59.928956 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d89ec-abef-4e1a-a6d3-98fa55b8302d None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:01:59.941756 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f96b7e-0063-4991-89dc-eae1113902ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:01:59.942413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f96b7e-0063-4991-89dc-eae1113902ab None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:01:59.942730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f96b7e-0063-4991-89dc-eae1113902ab None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:01:59.942974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f96b7e-0063-4991-89dc-eae1113902ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:01:59.953798 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f96b7e-0063-4991-89dc-eae1113902ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:01:59.959720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-96f96b7e-0063-4991-89dc-eae1113902ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:59.959720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:01:59.959720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:01:59.959720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:01:59.959720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:01:59.959720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:01:59.959720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:01:59.959720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:01:59.959720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:01:59.959720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:01:59.959720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:01:59.959720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:01:59.959720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:01:59.959720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:01:59.959720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:01:59.959720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:01:59.960766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:01:59.960766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:01:59.960766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:01:59.960766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:01:59.960766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:01:59.960766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:01:59.960766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:01:59.960766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:01:59.960766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:01:59.960766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:01:59.960766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:01:59.960766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:01:59.960766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:01:59.960766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:01:59.960766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:01:59.960766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:01:59.961569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:01:59.961569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:01:59.961569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:01:59.961569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:01:59.961569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:01:59.961569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:01:59.961569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:01:59.961569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:01:59.961569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:01:59.961569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:01:59.961569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:01:59.961569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:01:59.961569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 215/443] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Sep 2 21:01:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:01:59.966599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f96b7e-0063-4991-89dc-eae1113902ab None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:00.021894 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:00.029828 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d89ec-abef-4e1a-a6d3-98fa55b8302d None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:00.039806 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:00.064657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b83f9c-c3a9-4ddc-8ea1-2ab991cc6e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:00.065566 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b83f9c-c3a9-4ddc-8ea1-2ab991cc6e06 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:00.065882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b83f9c-c3a9-4ddc-8ea1-2ab991cc6e06 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:00.066161 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b83f9c-c3a9-4ddc-8ea1-2ab991cc6e06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:00.067614 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f96b7e-0063-4991-89dc-eae1113902ab None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:00.076182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b83f9c-c3a9-4ddc-8ea1-2ab991cc6e06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:00.081312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-71b83f9c-c3a9-4ddc-8ea1-2ab991cc6e06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:02:00.081312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:00.081312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:00.081312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:00.081312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:00.081312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:00.081312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:00.081312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:00.081312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:00.081312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:00.081312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:00.081312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:00.081312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:00.081312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:00.081312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:00.081312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:00.082637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:00.082637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:00.082637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:00.082637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:00.082637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:00.082637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:00.082637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:00.082637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:00.082637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:00.082637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:00.082637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:00.082637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:00.082637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:00.082637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:00.082637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:00.082637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:00.083533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:00.083533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:00.083533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:00.083533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:00.083533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:00.083533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:00.083533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:00.083533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:00.083533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:00.083533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:00.083533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:02:00.083533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:00.083533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 229/444] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:01:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:00.083533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b83f9c-c3a9-4ddc-8ea1-2ab991cc6e06 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:00.107261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335ce9d-32c7-4f3b-8a09-63aa0292a66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:00.107875 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335ce9d-32c7-4f3b-8a09-63aa0292a66f None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:00.108156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335ce9d-32c7-4f3b-8a09-63aa0292a66f None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:00.108435 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335ce9d-32c7-4f3b-8a09-63aa0292a66f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:00.109174 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335ce9d-32c7-4f3b-8a09-63aa0292a66f None admin] RBAC: Adding query filter params (group.id=b8708a26a9594d24a8a786db404e93ae, role.id=17200f478f4f42afb0a4d42b5da2183d, scope.project.id=b3d0577467b84edf9244abafa997d81b) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:00.109485 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335ce9d-32c7-4f3b-8a09-63aa0292a66f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:00.111490 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335ce9d-32c7-4f3b-8a09-63aa0292a66f None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:00.117415 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 216/445] 10.222.0.79 () {56 vars in 1376 bytes} [Fri Sep 2 21:01:59 2022] GET /identity/v3/role_assignments?group.id=b8708a26a9594d24a8a786db404e93ae&scope.project.id=b3d0577467b84edf9244abafa997d81b&role.id=17200f478f4f42afb0a4d42b5da2183d => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:00.118156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335ce9d-32c7-4f3b-8a09-63aa0292a66f None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:00.214267 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b83f9c-c3a9-4ddc-8ea1-2ab991cc6e06 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:00.239054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335ce9d-32c7-4f3b-8a09-63aa0292a66f None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:00.257373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f88fc9-e1f6-48c2-8a9e-4dd2ca1a44c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:00.258447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f88fc9-e1f6-48c2-8a9e-4dd2ca1a44c6 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:00.258909 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f88fc9-e1f6-48c2-8a9e-4dd2ca1a44c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:00.259386 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:00.260301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f88fc9-e1f6-48c2-8a9e-4dd2ca1a44c6 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:00.261173 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f88fc9-e1f6-48c2-8a9e-4dd2ca1a44c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:00.261487 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f88fc9-e1f6-48c2-8a9e-4dd2ca1a44c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:00.262942 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f88fc9-e1f6-48c2-8a9e-4dd2ca1a44c6 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:00.273753 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 230/446] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:00.278807 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3098a6-72ab-4dc5-b149-03c685146e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:00.279319 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f88fc9-e1f6-48c2-8a9e-4dd2ca1a44c6 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:00.279415 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3098a6-72ab-4dc5-b149-03c685146e02 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:00.279757 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3098a6-72ab-4dc5-b149-03c685146e02 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:00.280058 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3098a6-72ab-4dc5-b149-03c685146e02 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:00.280773 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3098a6-72ab-4dc5-b149-03c685146e02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:00.281074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3098a6-72ab-4dc5-b149-03c685146e02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:00.282792 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3098a6-72ab-4dc5-b149-03c685146e02 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:00.292367 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 217/447] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:02:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:00.298275 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3098a6-72ab-4dc5-b149-03c685146e02 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:00.319698 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:00.407488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f88fc9-e1f6-48c2-8a9e-4dd2ca1a44c6 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:00.437035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3098a6-72ab-4dc5-b149-03c685146e02 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:00.452799 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce692363-25cf-4157-96ab-9a0b8f841100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:00.452799 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce692363-25cf-4157-96ab-9a0b8f841100 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:00.453185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce692363-25cf-4157-96ab-9a0b8f841100 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:00.453468 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce692363-25cf-4157-96ab-9a0b8f841100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:00.481533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf49c38-be27-46e1-9e47-7dac0a4a9ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:00.482149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf49c38-be27-46e1-9e47-7dac0a4a9ab5 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:00.482435 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf49c38-be27-46e1-9e47-7dac0a4a9ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:00.482718 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf49c38-be27-46e1-9e47-7dac0a4a9ab5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:00.531448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce692363-25cf-4157-96ab-9a0b8f841100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:00.533171 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce692363-25cf-4157-96ab-9a0b8f841100 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:00.534609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:00.555151 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf49c38-be27-46e1-9e47-7dac0a4a9ab5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:00.556594 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf49c38-be27-46e1-9e47-7dac0a4a9ab5 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:00.562822 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:00.654418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 231/448] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 02 21:02:00.659366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 218/449] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 02 21:02:00.660842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce692363-25cf-4157-96ab-9a0b8f841100 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:00.664935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf49c38-be27-46e1-9e47-7dac0a4a9ab5 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:00.749490 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:00.769247 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf49c38-be27-46e1-9e47-7dac0a4a9ab5 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:00.775516 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce692363-25cf-4157-96ab-9a0b8f841100 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:00.804383 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de24b4-84da-4f3d-bed0-9a40c5879c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:00.805014 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de24b4-84da-4f3d-bed0-9a40c5879c7f None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:00.805298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de24b4-84da-4f3d-bed0-9a40c5879c7f None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:00.805595 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de24b4-84da-4f3d-bed0-9a40c5879c7f None admin] PATH_INFO: `/v3/projects/c04c8d4bc7dc450a92b56e01849b9dc9` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:00.806250 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:00.806774 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de24b4-84da-4f3d-bed0-9a40c5879c7f None admin] RBAC: Authorizing `identity:get_project(project_id=c04c8d4bc7dc450a92b56e01849b9dc9)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:00.808240 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de24b4-84da-4f3d-bed0-9a40c5879c7f None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:00.810376 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 219/450] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:02:00 2022] GET /identity/v3/projects/c04c8d4bc7dc450a92b56e01849b9dc9 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:00.812184 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78682b-e751-43e7-93e8-b16925d4ffbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:00.812799 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78682b-e751-43e7-93e8-b16925d4ffbd None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:00.813075 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78682b-e751-43e7-93e8-b16925d4ffbd None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:00.813374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78682b-e751-43e7-93e8-b16925d4ffbd None admin] PATH_INFO: `/v3/projects/b3d0577467b84edf9244abafa997d81b` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:00.814931 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78682b-e751-43e7-93e8-b16925d4ffbd None admin] RBAC: Authorizing `identity:get_project(project_id=b3d0577467b84edf9244abafa997d81b)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:00.815566 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de24b4-84da-4f3d-bed0-9a40c5879c7f None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:00.816536 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78682b-e751-43e7-93e8-b16925d4ffbd None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:00.818313 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 232/451] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:02:00 2022] GET /identity/v3/projects/b3d0577467b84edf9244abafa997d81b => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:00.823636 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78682b-e751-43e7-93e8-b16925d4ffbd None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:00.917359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de24b4-84da-4f3d-bed0-9a40c5879c7f None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:00.924071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78682b-e751-43e7-93e8-b16925d4ffbd None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:00.952811 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2a595-e3a5-41f1-9176-b353db0f1314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:00.953445 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2a595-e3a5-41f1-9176-b353db0f1314 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:00.953737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2a595-e3a5-41f1-9176-b353db0f1314 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:00.954203 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2a595-e3a5-41f1-9176-b353db0f1314 None admin] PATH_INFO: `/v3/groups/d6952e07a89647d8b03b03a37b4de07d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:00.955687 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2a595-e3a5-41f1-9176-b353db0f1314 None admin] RBAC: Authorizing `identity:get_group(group_id=d6952e07a89647d8b03b03a37b4de07d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:00.957289 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2a595-e3a5-41f1-9176-b353db0f1314 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:00.958607 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bc491-54f4-4c52-baba-2f2067122e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:00.958901 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 220/452] 10.222.0.79 () {56 vars in 1180 bytes} [Fri Sep 2 21:02:00 2022] GET /identity/v3/groups/d6952e07a89647d8b03b03a37b4de07d => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:00.959236 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bc491-54f4-4c52-baba-2f2067122e84 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:00.959520 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bc491-54f4-4c52-baba-2f2067122e84 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:00.959800 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bc491-54f4-4c52-baba-2f2067122e84 None admin] PATH_INFO: `/v3/groups/b8708a26a9594d24a8a786db404e93ae` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:00.960914 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bc491-54f4-4c52-baba-2f2067122e84 None admin] RBAC: Authorizing `identity:get_group(group_id=b8708a26a9594d24a8a786db404e93ae)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:00.962387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bc491-54f4-4c52-baba-2f2067122e84 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:00.963978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 233/453] 10.222.0.79 () {56 vars in 1180 bytes} [Fri Sep 2 21:02:00 2022] GET /identity/v3/groups/b8708a26a9594d24a8a786db404e93ae => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:00.964705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2a595-e3a5-41f1-9176-b353db0f1314 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:00.970489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bc491-54f4-4c52-baba-2f2067122e84 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:00.984514 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:01.060697 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:01.073423 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2a595-e3a5-41f1-9176-b353db0f1314 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:01.098585 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bc491-54f4-4c52-baba-2f2067122e84 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:01.109529 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61b6ed-9e12-428c-8a9c-bec2a0c18708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:01.110172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61b6ed-9e12-428c-8a9c-bec2a0c18708 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:01.111105 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61b6ed-9e12-428c-8a9c-bec2a0c18708 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:01.111297 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61b6ed-9e12-428c-8a9c-bec2a0c18708 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:01.112037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61b6ed-9e12-428c-8a9c-bec2a0c18708 None admin] RBAC: Adding query filter params (group.id=d6952e07a89647d8b03b03a37b4de07d, role.id=32e6a7f83b444d1ca9e5891a2b175f9a, scope.project.id=c04c8d4bc7dc450a92b56e01849b9dc9) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:01.112349 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61b6ed-9e12-428c-8a9c-bec2a0c18708 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:01.113785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61b6ed-9e12-428c-8a9c-bec2a0c18708 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:01.119644 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 221/454] 10.222.0.79 () {56 vars in 1376 bytes} [Fri Sep 2 21:02:00 2022] GET /identity/v3/role_assignments?group.id=d6952e07a89647d8b03b03a37b4de07d&scope.project.id=c04c8d4bc7dc450a92b56e01849b9dc9&role.id=32e6a7f83b444d1ca9e5891a2b175f9a => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:01.134385 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3072ad-e4a6-4a08-8ec4-c182a48a3bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:01.135016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3072ad-e4a6-4a08-8ec4-c182a48a3bd7 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:01.135296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3072ad-e4a6-4a08-8ec4-c182a48a3bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:01.135570 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3072ad-e4a6-4a08-8ec4-c182a48a3bd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:01.136321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3072ad-e4a6-4a08-8ec4-c182a48a3bd7 None admin] RBAC: Adding query filter params (group.id=b8708a26a9594d24a8a786db404e93ae, role.id=5feee6c423414badb9c65ac4076a7f45, scope.project.id=b3d0577467b84edf9244abafa997d81b) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:01.136632 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3072ad-e4a6-4a08-8ec4-c182a48a3bd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:01.138159 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3072ad-e4a6-4a08-8ec4-c182a48a3bd7 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:01.146090 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 234/455] 10.222.0.79 () {56 vars in 1376 bytes} [Fri Sep 2 21:02:00 2022] GET /identity/v3/role_assignments?group.id=b8708a26a9594d24a8a786db404e93ae&scope.project.id=b3d0577467b84edf9244abafa997d81b&role.id=5feee6c423414badb9c65ac4076a7f45 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:03.686685 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4393e6-b6a0-4f3e-948c-512c7155f0ba None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:03.687736 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4393e6-b6a0-4f3e-948c-512c7155f0ba None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:03.688227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4393e6-b6a0-4f3e-948c-512c7155f0ba None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:03.691237 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 222/456] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:03.696288 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df00e33-cd89-4f02-9665-01dd6f6010e6 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:03.697155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df00e33-cd89-4f02-9665-01dd6f6010e6 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:03.697634 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df00e33-cd89-4f02-9665-01dd6f6010e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:03.722871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-0df00e33-cd89-4f02-9665-01dd6f6010e6 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:03.724422 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-0df00e33-cd89-4f02-9665-01dd6f6010e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:03.819111 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 235/457] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:02:03.962906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8b3d6-6a55-43d5-b1f5-f05e29c59025 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:03.963515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8b3d6-6a55-43d5-b1f5-f05e29c59025 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:03.963995 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8b3d6-6a55-43d5-b1f5-f05e29c59025 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:03.966006 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 223/458] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:03.976975 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604ac66-ddae-4c8b-853b-48496523d7bd None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:03.977538 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604ac66-ddae-4c8b-853b-48496523d7bd None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:03.978070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604ac66-ddae-4c8b-853b-48496523d7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:04.006872 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-b604ac66-ddae-4c8b-853b-48496523d7bd None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:04.008433 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b604ac66-ddae-4c8b-853b-48496523d7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:04.087439 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:04.103126 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 236/459] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:04.149538 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8b3d6-6a55-43d5-b1f5-f05e29c59025 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:04.224514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98baca-c6c6-45b4-ab6f-1b47abd3ba58 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:04.225125 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98baca-c6c6-45b4-ab6f-1b47abd3ba58 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:04.225602 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98baca-c6c6-45b4-ab6f-1b47abd3ba58 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:04.227479 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 237/460] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:04.232884 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb73a1f-a449-4896-8dac-0d9f713d7186 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:04.233455 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb73a1f-a449-4896-8dac-0d9f713d7186 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:04.234004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb73a1f-a449-4896-8dac-0d9f713d7186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:04.270166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:04.272916 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-7cb73a1f-a449-4896-8dac-0d9f713d7186 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:04.274138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-7cb73a1f-a449-4896-8dac-0d9f713d7186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:04.298688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8b3d6-6a55-43d5-b1f5-f05e29c59025 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:04.344192 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52acc3-5adc-465f-b78e-23fe7fd05d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:04.345437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52acc3-5adc-465f-b78e-23fe7fd05d41 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:04.345715 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52acc3-5adc-465f-b78e-23fe7fd05d41 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:04.346011 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52acc3-5adc-465f-b78e-23fe7fd05d41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:04.365470 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52acc3-5adc-465f-b78e-23fe7fd05d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:04.367136 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52acc3-5adc-465f-b78e-23fe7fd05d41 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:04.393880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-ff52acc3-5adc-465f-b78e-23fe7fd05d41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:04.393880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:04.393880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:04.393880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:04.393880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:04.393880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:04.393880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:04.393880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:04.393880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:04.393880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:04.393880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:04.393880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:04.393880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:04.393880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:04.393880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:04.393880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:04.394891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:04.394891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:04.394891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:04.394891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:04.394891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:04.394891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:04.394891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:04.394891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:04.394891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:04.394891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:04.394891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:04.394891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:04.394891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:04.394891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:04.394891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:04.394891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:04.394891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:04.395737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:04.395737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:04.395737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:04.397477 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 224/461] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:04.406889 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52acc3-5adc-465f-b78e-23fe7fd05d41 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:04.420860 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 238/462] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:04.432667 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb73a1f-a449-4896-8dac-0d9f713d7186 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:04.527813 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52acc3-5adc-465f-b78e-23fe7fd05d41 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:04.540399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb73a1f-a449-4896-8dac-0d9f713d7186 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:04.560851 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:04.562509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:04.568503 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4d933-a2d5-471e-8fca-9a9039877eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:04.569186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4d933-a2d5-471e-8fca-9a9039877eb5 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:04.569467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4d933-a2d5-471e-8fca-9a9039877eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:04.569854 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4d933-a2d5-471e-8fca-9a9039877eb5 None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:04.579848 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4d933-a2d5-471e-8fca-9a9039877eb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:04.579848 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4d933-a2d5-471e-8fca-9a9039877eb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:04.579848 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4d933-a2d5-471e-8fca-9a9039877eb5 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:04.580097 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9940c-66a7-416c-8ed8-f613eea39db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:04.580097 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9940c-66a7-416c-8ed8-f613eea39db9 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:04.580097 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9940c-66a7-416c-8ed8-f613eea39db9 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:04.580097 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9940c-66a7-416c-8ed8-f613eea39db9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:04.589043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9940c-66a7-416c-8ed8-f613eea39db9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:04.590022 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 225/463] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:04.590836 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9940c-66a7-416c-8ed8-f613eea39db9 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:04.591421 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e30e3-f006-46fb-958c-52d1fd2faf56 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:04.591708 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e30e3-f006-46fb-958c-52d1fd2faf56 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:04.591985 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e30e3-f006-46fb-958c-52d1fd2faf56 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:04.593494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 226/464] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:04.594211 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e30e3-f006-46fb-958c-52d1fd2faf56 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:04.615896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-b4c9940c-66a7-416c-8ed8-f613eea39db9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:04.615896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:04.615896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:04.615896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:04.615896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:04.615896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:04.615896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:04.615896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:04.615896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:04.615896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:04.615896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:04.615896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:04.615896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:04.615896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:04.615896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:04.615896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:04.616837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:04.616837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:04.616837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:04.616837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:04.616837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:04.616837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:04.616837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:04.616837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:04.616837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:04.616837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:04.616837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:04.616837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:04.616837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:04.616837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:04.616837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:04.616837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:04.616837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:04.617706 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:04.617706 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:04.617706 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:04.621898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 239/465] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:04.631213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e704d-55ab-4004-b961-0948efca9e13 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:04.631213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e704d-55ab-4004-b961-0948efca9e13 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:04.631213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e704d-55ab-4004-b961-0948efca9e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:04.643809 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-142e704d-55ab-4004-b961-0948efca9e13 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:04.645001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-142e704d-55ab-4004-b961-0948efca9e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:04.723278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e30e3-f006-46fb-958c-52d1fd2faf56 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:04.733681 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 240/466] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:04.734391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e704d-55ab-4004-b961-0948efca9e13 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:04.774516 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079793c7-eb28-4c42-87fe-89c9d95dab91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:04.775221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079793c7-eb28-4c42-87fe-89c9d95dab91 None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:04.775445 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079793c7-eb28-4c42-87fe-89c9d95dab91 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:04.775677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079793c7-eb28-4c42-87fe-89c9d95dab91 None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:04.776345 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079793c7-eb28-4c42-87fe-89c9d95dab91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:04.777905 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079793c7-eb28-4c42-87fe-89c9d95dab91 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:04.864956 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e704d-55ab-4004-b961-0948efca9e13 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:04.866787 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:04.899937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c76b7-48c3-4ecf-9b48-a8fe908c32ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:04.900554 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c76b7-48c3-4ecf-9b48-a8fe908c32ad None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:04.900839 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c76b7-48c3-4ecf-9b48-a8fe908c32ad None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:04.901115 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c76b7-48c3-4ecf-9b48-a8fe908c32ad None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:04.901764 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c76b7-48c3-4ecf-9b48-a8fe908c32ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:04.902106 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c76b7-48c3-4ecf-9b48-a8fe908c32ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:04.903519 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c76b7-48c3-4ecf-9b48-a8fe908c32ad None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:04.933957 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 241/468] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:04.933957 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c76b7-48c3-4ecf-9b48-a8fe908c32ad None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:04.934551 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 227/468] 10.222.0.79 () {60 vars in 1132 bytes} [Fri Sep 2 21:02:04 2022] POST /identity/v3/users => generated 246 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:04.935880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079793c7-eb28-4c42-87fe-89c9d95dab91 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:05.044140 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:05.101610 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c76b7-48c3-4ecf-9b48-a8fe908c32ad None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:05.112496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079793c7-eb28-4c42-87fe-89c9d95dab91 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:05.140311 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a473bd8-aa20-4706-90c1-07d695d2cad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:05.140970 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a473bd8-aa20-4706-90c1-07d695d2cad8 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:05.141255 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a473bd8-aa20-4706-90c1-07d695d2cad8 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:05.142086 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a473bd8-aa20-4706-90c1-07d695d2cad8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:05.153116 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b275d2-bd80-4146-a706-d53aa5d3cc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:05.153586 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a473bd8-aa20-4706-90c1-07d695d2cad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:05.153761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b275d2-bd80-4146-a706-d53aa5d3cc9a None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:05.154040 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b275d2-bd80-4146-a706-d53aa5d3cc9a None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:05.154318 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b275d2-bd80-4146-a706-d53aa5d3cc9a None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:05.154974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b275d2-bd80-4146-a706-d53aa5d3cc9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:05.155230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a473bd8-aa20-4706-90c1-07d695d2cad8 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:05.156400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b275d2-bd80-4146-a706-d53aa5d3cc9a None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:05.173395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-0a473bd8-aa20-4706-90c1-07d695d2cad8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:05.173395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:05.173395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:05.173395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:05.173395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:05.173395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:05.173395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:05.173395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:05.173395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:05.173395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:05.173395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:05.173395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:05.173395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:05.173395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:05.173395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:05.173395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:05.174749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:05.174749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:05.174749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:05.174749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:05.174749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:05.174749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:05.174749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:05.174749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:05.174749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:05.174749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:05.174749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:05.174749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:05.174749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:05.174749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:05.174749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:05.174749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:05.174749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:05.175569 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:05.175569 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:05.175569 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:05.175569 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 242/469] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:05.175569 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a473bd8-aa20-4706-90c1-07d695d2cad8 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:05.195687 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:05.259880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 228/470] 10.222.0.79 () {60 vars in 1132 bytes} [Fri Sep 2 21:02:04 2022] POST /identity/v3/users => generated 248 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:05.260784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b275d2-bd80-4146-a706-d53aa5d3cc9a None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:05.297728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a473bd8-aa20-4706-90c1-07d695d2cad8 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:05.348521 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341f044-db8c-4984-9175-4335d3efdc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:05.349790 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341f044-db8c-4984-9175-4335d3efdc12 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:05.350319 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341f044-db8c-4984-9175-4335d3efdc12 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:05.350790 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341f044-db8c-4984-9175-4335d3efdc12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:05.366715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341f044-db8c-4984-9175-4335d3efdc12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:05.369505 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341f044-db8c-4984-9175-4335d3efdc12 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:05.389509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-7341f044-db8c-4984-9175-4335d3efdc12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:05.389509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:05.389509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:05.389509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:05.389509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:05.389509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:05.389509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:05.389509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:05.389509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:05.389509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:05.389509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:05.389509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:05.389509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:05.389509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:05.389509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:05.389509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:05.390514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:05.390514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:05.390514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:05.390514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:05.390514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:05.390514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:05.390514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:05.390514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:05.390514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:05.390514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:05.390514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:05.390514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:05.390514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:05.390514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:05.390514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:05.390514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:05.390514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:05.391381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:05.391381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:05.391381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:05.394884 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 243/471] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:05.403078 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341f044-db8c-4984-9175-4335d3efdc12 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:05.468713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b275d2-bd80-4146-a706-d53aa5d3cc9a None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:05.473557 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:05.495235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:05.537523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341f044-db8c-4984-9175-4335d3efdc12 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:05.547029 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804ec65-2f61-46d7-8d37-d1a0a62e7a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:05.547813 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804ec65-2f61-46d7-8d37-d1a0a62e7a00 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:05.548782 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804ec65-2f61-46d7-8d37-d1a0a62e7a00 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:05.549068 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804ec65-2f61-46d7-8d37-d1a0a62e7a00 None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:05.549745 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804ec65-2f61-46d7-8d37-d1a0a62e7a00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:05.550084 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804ec65-2f61-46d7-8d37-d1a0a62e7a00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:05.551504 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804ec65-2f61-46d7-8d37-d1a0a62e7a00 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:05.571164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 229/472] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:05.572530 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee557f1c-d4a5-4d10-9f98-eb958bb24ca5 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:05.572819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee557f1c-d4a5-4d10-9f98-eb958bb24ca5 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:05.573101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee557f1c-d4a5-4d10-9f98-eb958bb24ca5 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:05.574675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 230/473] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:05.580348 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee557f1c-d4a5-4d10-9f98-eb958bb24ca5 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:05.587386 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430c60d-14b4-4c93-863a-875745a1ab0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:05.588011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430c60d-14b4-4c93-863a-875745a1ab0d None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:05.588300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430c60d-14b4-4c93-863a-875745a1ab0d None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:05.588581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430c60d-14b4-4c93-863a-875745a1ab0d None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:05.589237 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430c60d-14b4-4c93-863a-875745a1ab0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:05.589548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430c60d-14b4-4c93-863a-875745a1ab0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:05.590993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430c60d-14b4-4c93-863a-875745a1ab0d None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:05.617032 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 244/474] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:05.619173 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd88d07-fa3a-4d56-9f70-65fb9fa1df97 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:05.619473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd88d07-fa3a-4d56-9f70-65fb9fa1df97 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:05.619756 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd88d07-fa3a-4d56-9f70-65fb9fa1df97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:05.651224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-8bd88d07-fa3a-4d56-9f70-65fb9fa1df97 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:05.651849 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-8bd88d07-fa3a-4d56-9f70-65fb9fa1df97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:05.752268 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee557f1c-d4a5-4d10-9f98-eb958bb24ca5 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:05.764765 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 245/475] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:05.765705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd88d07-fa3a-4d56-9f70-65fb9fa1df97 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:05.841326 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:05.867506 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5f6bf-9f1c-4b18-9455-9bd692f8b31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:05.874001 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5f6bf-9f1c-4b18-9455-9bd692f8b31a None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:05.876106 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5f6bf-9f1c-4b18-9455-9bd692f8b31a None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:05.877306 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5f6bf-9f1c-4b18-9455-9bd692f8b31a None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:05.878795 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5f6bf-9f1c-4b18-9455-9bd692f8b31a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:05.884485 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5f6bf-9f1c-4b18-9455-9bd692f8b31a None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:05.892129 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd88d07-fa3a-4d56-9f70-65fb9fa1df97 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:05.945221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d3671-5e3d-4787-8bf4-94a4cb4f97d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:05.945936 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d3671-5e3d-4787-8bf4-94a4cb4f97d8 None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:05.946237 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d3671-5e3d-4787-8bf4-94a4cb4f97d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:05.946518 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d3671-5e3d-4787-8bf4-94a4cb4f97d8 None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:05.947244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d3671-5e3d-4787-8bf4-94a4cb4f97d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:05.948767 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d3671-5e3d-4787-8bf4-94a4cb4f97d8 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:06.093006 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 231/476] 10.222.0.79 () {60 vars in 1132 bytes} [Fri Sep 2 21:02:05 2022] POST /identity/v3/users => generated 248 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:06.144404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 246/477] 10.222.0.79 () {60 vars in 1132 bytes} [Fri Sep 2 21:02:05 2022] POST /identity/v3/users => generated 249 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:06.193108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5f6bf-9f1c-4b18-9455-9bd692f8b31a None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:06.229481 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:06.336161 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5f6bf-9f1c-4b18-9455-9bd692f8b31a None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:06.377250 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e9756-fa5b-4f0d-8275-d51ae8e4161c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:06.379437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e9756-fa5b-4f0d-8275-d51ae8e4161c None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:06.379437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e9756-fa5b-4f0d-8275-d51ae8e4161c None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:06.379437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e9756-fa5b-4f0d-8275-d51ae8e4161c None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:06.379437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e9756-fa5b-4f0d-8275-d51ae8e4161c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:06.381149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e9756-fa5b-4f0d-8275-d51ae8e4161c None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:06.440162 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.sql.core [None req-d91e9756-fa5b-4f0d-8275-d51ae8e4161c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 02 21:02:06.440162 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 02 21:02:06.440162 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [parameters: {'id': 'b8037f620bc74fcaadfa5fd995507c00', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 02 21:02:06.440162 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82124) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 02 21:02:06.459785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-d91e9756-fa5b-4f0d-8275-d51ae8e4161c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 02 21:02:06.459785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:06.459785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 21:02:06.459785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 21:02:06.459785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 21:02:06.459785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 21:02:06.459785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 21:02:06.459785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 21:02:06.459785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 21:02:06.459785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application conn.query(q) Sep 02 21:02:06.459785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 21:02:06.459785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 21:02:06.459785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 21:02:06.459785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application result.read() Sep 02 21:02:06.459785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 21:02:06.460801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 21:02:06.460801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 21:02:06.460801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 21:02:06.460801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 21:02:06.460801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 21:02:06.460801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 21:02:06.460801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 21:02:06.460801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 02 21:02:06.460801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:06.460801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 02 21:02:06.460801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:06.460801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:06.460801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 02 21:02:06.460801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 02 21:02:06.460801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 02 21:02:06.460801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return ref.to_dict() Sep 02 21:02:06.460801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 21:02:06.460801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application next(self.gen) Sep 02 21:02:06.461729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 02 21:02:06.461729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application yield resource Sep 02 21:02:06.461729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 21:02:06.461729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application next(self.gen) Sep 02 21:02:06.461729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 02 21:02:06.461729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self.session.rollback() Sep 02 21:02:06.461729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 02 21:02:06.461729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self.force_reraise() Sep 02 21:02:06.461729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 02 21:02:06.461729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise self.value Sep 02 21:02:06.461729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 02 21:02:06.461729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 02 21:02:06.461729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 02 21:02:06.461729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application session.commit() Sep 02 21:02:06.461729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 02 21:02:06.461729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 02 21:02:06.461729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 02 21:02:06.462655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._prepare_impl() Sep 02 21:02:06.462655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 02 21:02:06.462655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self.session.flush() Sep 02 21:02:06.462655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 02 21:02:06.462655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._flush(objects) Sep 02 21:02:06.462655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 02 21:02:06.462655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 02 21:02:06.462655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 02 21:02:06.462655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application compat.raise_( Sep 02 21:02:06.462655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 21:02:06.462655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception Sep 02 21:02:06.462655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 02 21:02:06.462655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application flush_context.execute() Sep 02 21:02:06.462655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 02 21:02:06.462655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rec.execute(self) Sep 02 21:02:06.462655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 02 21:02:06.462655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 02 21:02:06.463512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 02 21:02:06.463512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 02 21:02:06.463512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 02 21:02:06.463512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 02 21:02:06.463512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 02 21:02:06.463512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 02 21:02:06.463512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 02 21:02:06.463512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 02 21:02:06.463512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 02 21:02:06.463512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 02 21:02:06.463512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 02 21:02:06.463512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 02 21:02:06.463512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 02 21:02:06.463512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 02 21:02:06.463512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 21:02:06.463512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception Sep 02 21:02:06.464326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 21:02:06.464326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 21:02:06.464326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 21:02:06.464326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 21:02:06.464326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 21:02:06.464326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 21:02:06.464326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 21:02:06.464326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application conn.query(q) Sep 02 21:02:06.464326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 21:02:06.464326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 21:02:06.464326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 21:02:06.464326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application result.read() Sep 02 21:02:06.464326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 21:02:06.464326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 21:02:06.464326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 21:02:06.464326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 21:02:06.465118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 21:02:06.465118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 21:02:06.465118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 21:02:06.465118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 21:02:06.465118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 02 21:02:06.465118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 02 21:02:06.465118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [parameters: {'id': 'b8037f620bc74fcaadfa5fd995507c00', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 02 21:02:06.465118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 02 21:02:06.465118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:06.465118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:06.465118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:06.465118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:06.465118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:06.465118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:06.465118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:06.465118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:06.467241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:06.467241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:06.467241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:06.467241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:06.467241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:06.467241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:06.467241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 02 21:02:06.467241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 02 21:02:06.467241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:06.467241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:06.467241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 02 21:02:06.467241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 02 21:02:06.467241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 02 21:02:06.467241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 02 21:02:06.467241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 02 21:02:06.467241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:06.471004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 232/478] 10.222.0.79 () {60 vars in 1131 bytes} [Fri Sep 2 21:02:06 2022] POST /identity/v3/roles => generated 144 bytes in 278 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:06.476956 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d3671-5e3d-4787-8bf4-94a4cb4f97d8 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:06.607715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d3671-5e3d-4787-8bf4-94a4cb4f97d8 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:06.622639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:06.662656 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739711d-ea66-48e8-9707-e75032e237ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:06.662656 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739711d-ea66-48e8-9707-e75032e237ee None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:06.662656 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739711d-ea66-48e8-9707-e75032e237ee None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:06.662656 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739711d-ea66-48e8-9707-e75032e237ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:06.681353 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739711d-ea66-48e8-9707-e75032e237ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:06.700892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-9739711d-ea66-48e8-9707-e75032e237ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:02:06.700892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:06.700892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:06.700892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:06.700892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:06.700892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:06.700892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:06.700892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:06.700892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:06.700892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:06.700892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:06.700892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:06.700892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:06.700892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:06.700892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:06.700892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:06.702949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:06.702949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:06.702949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:06.702949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:06.702949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:06.702949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:06.702949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:06.702949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:06.702949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:06.702949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:06.702949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:06.702949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:06.702949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:06.702949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:06.702949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:06.702949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:06.705789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:06.705789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:06.705789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:06.705789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:06.705789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:06.705789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:06.705789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:06.705789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:06.705789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:06.705789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:06.705789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 02 21:02:06.705789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:06.705789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 247/479] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Sep 2 21:02:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:06.714019 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e9756-fa5b-4f0d-8275-d51ae8e4161c None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:06.909257 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:06.931133 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e9756-fa5b-4f0d-8275-d51ae8e4161c None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:06.983507 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534c9cd-ea22-4c76-858b-438ade644173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:06.984485 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534c9cd-ea22-4c76-858b-438ade644173 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:06.984968 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534c9cd-ea22-4c76-858b-438ade644173 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:06.986051 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534c9cd-ea22-4c76-858b-438ade644173 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:06.987007 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534c9cd-ea22-4c76-858b-438ade644173 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:06.987517 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534c9cd-ea22-4c76-858b-438ade644173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:06.989174 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534c9cd-ea22-4c76-858b-438ade644173 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:06.998729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 233/480] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:07.270977 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fa292-841f-4d13-a145-ab061759d364 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:07.271474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fa292-841f-4d13-a145-ab061759d364 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:07.271474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fa292-841f-4d13-a145-ab061759d364 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:07.272994 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 248/481] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:07.278558 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22f07-c075-48e1-8353-b488d10a8e54 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:07.279113 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22f07-c075-48e1-8353-b488d10a8e54 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:07.279619 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22f07-c075-48e1-8353-b488d10a8e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:07.300136 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-a8b22f07-c075-48e1-8353-b488d10a8e54 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:07.301655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-a8b22f07-c075-48e1-8353-b488d10a8e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:07.380639 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 234/482] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:07.734852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6bcdf-eea0-46cf-8651-83bb71785ef4 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:07.735161 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6bcdf-eea0-46cf-8651-83bb71785ef4 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:07.735430 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6bcdf-eea0-46cf-8651-83bb71785ef4 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:07.737347 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 249/483] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:07.742827 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c09a20-9f96-42ef-bac2-890e68c05ad6 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:07.743111 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c09a20-9f96-42ef-bac2-890e68c05ad6 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:07.743389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c09a20-9f96-42ef-bac2-890e68c05ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:07.758020 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6bcdf-eea0-46cf-8651-83bb71785ef4 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:07.771588 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-a4c09a20-9f96-42ef-bac2-890e68c05ad6 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:07.772837 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-a4c09a20-9f96-42ef-bac2-890e68c05ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:07.916476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 235/484] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:07.926589 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6bcdf-eea0-46cf-8651-83bb71785ef4 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:07.966172 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1078d-7c11-47a9-a111-a21d981b7bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:07.966720 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1078d-7c11-47a9-a111-a21d981b7bea None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:07.967002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1078d-7c11-47a9-a111-a21d981b7bea None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:07.967272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1078d-7c11-47a9-a111-a21d981b7bea None admin] PATH_INFO: `/v3/roles/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:07.979330 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1078d-7c11-47a9-a111-a21d981b7bea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:07.984794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-c3c1078d-7c11-47a9-a111-a21d981b7bea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:07.984794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:07.984794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:07.984794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:07.984794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:07.984794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:07.984794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:07.984794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:07.984794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:07.984794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:07.984794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:07.984794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:07.984794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:07.984794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:07.984794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:07.984794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:07.985852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:07.985852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:07.985852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:07.985852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:07.985852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:07.985852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:07.985852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:07.985852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:07.985852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:07.985852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:07.985852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:07.985852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:07.985852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:07.985852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:07.985852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:07.985852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:07.986669 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:07.986669 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:07.986669 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:07.986669 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:07.986669 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:07.986669 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:07.986669 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:07.986669 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:07.986669 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:07.986669 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:07.986669 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:07.986669 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:07.987277 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 250/485] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:02:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:07.992646 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c09a20-9f96-42ef-bac2-890e68c05ad6 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:08.004807 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:08.156778 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c09a20-9f96-42ef-bac2-890e68c05ad6 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:08.205224 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1452a3-817a-426d-9ef0-574f90287a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:08.205864 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1452a3-817a-426d-9ef0-574f90287a2b None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:08.206150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1452a3-817a-426d-9ef0-574f90287a2b None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:08.206426 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1452a3-817a-426d-9ef0-574f90287a2b None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:08.207109 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1452a3-817a-426d-9ef0-574f90287a2b None admin] RBAC: Adding query filter params (name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:08.207412 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1452a3-817a-426d-9ef0-574f90287a2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:08.208788 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1452a3-817a-426d-9ef0-574f90287a2b None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:08.222144 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 236/486] 10.222.0.79 () {56 vars in 1103 bytes} [Fri Sep 2 21:02:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:08.227206 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1078d-7c11-47a9-a111-a21d981b7bea None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:08.273242 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1452a3-817a-426d-9ef0-574f90287a2b None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:08.303230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:08.354889 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:08.395838 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1452a3-817a-426d-9ef0-574f90287a2b None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:08.436759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23196ceb-e348-41d6-8dd9-150e46b6b7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:08.437861 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23196ceb-e348-41d6-8dd9-150e46b6b7e9 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:08.438359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23196ceb-e348-41d6-8dd9-150e46b6b7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:08.439350 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23196ceb-e348-41d6-8dd9-150e46b6b7e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:08.451821 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23196ceb-e348-41d6-8dd9-150e46b6b7e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:08.458239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-23196ceb-e348-41d6-8dd9-150e46b6b7e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:08.458239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:08.458239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:08.458239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:08.458239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:08.458239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:08.458239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:08.458239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:08.458239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:08.458239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:08.458239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:08.458239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:08.458239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:08.458239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:08.458239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:08.458239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:08.459147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:08.459147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:08.459147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:08.459147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:08.459147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:08.459147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:08.459147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:08.459147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:08.459147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:08.459147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:08.459147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:08.459147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:08.459147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:08.459147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:08.459147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:08.459147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:08.459942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:08.459942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:08.459942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:08.459942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:08.459942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:08.459942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:08.459942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:08.459942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:08.459942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:08.459942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:08.459942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:08.459942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:08.467593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 237/487] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:02:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:08.469164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23196ceb-e348-41d6-8dd9-150e46b6b7e9 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:08.493869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1078d-7c11-47a9-a111-a21d981b7bea None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:08.531112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fb03b-a1d2-4c65-a5c0-414cabb76811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:08.531742 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fb03b-a1d2-4c65-a5c0-414cabb76811 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:08.532815 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fb03b-a1d2-4c65-a5c0-414cabb76811 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:08.532815 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fb03b-a1d2-4c65-a5c0-414cabb76811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:08.544010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fb03b-a1d2-4c65-a5c0-414cabb76811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:08.546310 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fb03b-a1d2-4c65-a5c0-414cabb76811 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:08.566882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-d33fb03b-a1d2-4c65-a5c0-414cabb76811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:08.566882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:08.566882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:08.566882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:08.566882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:08.566882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:08.566882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:08.566882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:08.566882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:08.566882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:08.566882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:08.566882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:08.566882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:08.566882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:08.566882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:08.566882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:08.567856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:08.567856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:08.567856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:08.567856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:08.567856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:08.567856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:08.567856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:08.567856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:08.567856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:08.567856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:08.567856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:08.567856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:08.567856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:08.567856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:08.567856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:08.567856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:08.567856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:08.568676 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:08.568676 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:08.568676 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:08.573175 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 251/488] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:08.574551 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e2439-fca6-42b7-8417-7da1bb86f928 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:08.575155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e2439-fca6-42b7-8417-7da1bb86f928 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:08.575460 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e2439-fca6-42b7-8417-7da1bb86f928 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:08.577355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 252/489] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:08.578113 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e2439-fca6-42b7-8417-7da1bb86f928 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:08.610518 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23196ceb-e348-41d6-8dd9-150e46b6b7e9 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:08.641453 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:08.650416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963e9c6-514f-496d-a8e8-e75fe7ebaf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:08.651234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963e9c6-514f-496d-a8e8-e75fe7ebaf88 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:08.656413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963e9c6-514f-496d-a8e8-e75fe7ebaf88 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:08.656413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963e9c6-514f-496d-a8e8-e75fe7ebaf88 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:08.656413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963e9c6-514f-496d-a8e8-e75fe7ebaf88 None admin] RBAC: Adding query filter params (name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:08.656413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963e9c6-514f-496d-a8e8-e75fe7ebaf88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:08.656413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963e9c6-514f-496d-a8e8-e75fe7ebaf88 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:08.664049 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 238/490] 10.222.0.79 () {56 vars in 1103 bytes} [Fri Sep 2 21:02:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:08.668550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc97c7-b4d2-49d1-96ff-ba4c357f7545 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:08.668550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc97c7-b4d2-49d1-96ff-ba4c357f7545 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:08.668550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc97c7-b4d2-49d1-96ff-ba4c357f7545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:08.691569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-1dbc97c7-b4d2-49d1-96ff-ba4c357f7545 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:08.692826 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-1dbc97c7-b4d2-49d1-96ff-ba4c357f7545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:08.698641 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:08.722471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e2439-fca6-42b7-8417-7da1bb86f928 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:08.761139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff2b96-f4e3-46ae-9542-10f246011ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:08.761761 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff2b96-f4e3-46ae-9542-10f246011ccb None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:08.761992 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff2b96-f4e3-46ae-9542-10f246011ccb None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:08.762263 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff2b96-f4e3-46ae-9542-10f246011ccb None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:08.762954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff2b96-f4e3-46ae-9542-10f246011ccb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:08.763257 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff2b96-f4e3-46ae-9542-10f246011ccb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:08.764837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff2b96-f4e3-46ae-9542-10f246011ccb None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:08.769661 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 239/491] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:08.770764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8d782-cb9d-4c89-a5d5-31acf54de4f9 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:08.771055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8d782-cb9d-4c89-a5d5-31acf54de4f9 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:08.771333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8d782-cb9d-4c89-a5d5-31acf54de4f9 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:08.772742 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 240/492] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:08.777316 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8d782-cb9d-4c89-a5d5-31acf54de4f9 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:08.793029 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 253/493] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:08.795797 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbbe88-d2b7-4646-b406-9b6f0ca978dc None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:08.796326 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbbe88-d2b7-4646-b406-9b6f0ca978dc None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:08.797216 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbbe88-d2b7-4646-b406-9b6f0ca978dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:08.823233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-15cbbe88-d2b7-4646-b406-9b6f0ca978dc None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:08.825344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-15cbbe88-d2b7-4646-b406-9b6f0ca978dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:08.890829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8d782-cb9d-4c89-a5d5-31acf54de4f9 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:08.915875 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:08.928109 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 254/494] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:08.933713 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbbe88-d2b7-4646-b406-9b6f0ca978dc None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:08.943696 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0bd55-8ad9-4d9a-bf6d-9b505d263d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:08.944401 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0bd55-8ad9-4d9a-bf6d-9b505d263d42 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:08.944686 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0bd55-8ad9-4d9a-bf6d-9b505d263d42 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:08.944961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0bd55-8ad9-4d9a-bf6d-9b505d263d42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:08.972482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0bd55-8ad9-4d9a-bf6d-9b505d263d42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:08.974366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0bd55-8ad9-4d9a-bf6d-9b505d263d42 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:09.007314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-0ef0bd55-8ad9-4d9a-bf6d-9b505d263d42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:09.007314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:09.007314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:09.007314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:09.007314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:09.007314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:09.007314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:09.007314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:09.007314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:09.007314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:09.007314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:09.007314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:09.007314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:09.007314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:09.007314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:09.007314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:09.008292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:09.008292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:09.008292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:09.008292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:09.008292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:09.008292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:09.008292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:09.008292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:09.008292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:09.008292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:09.008292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:09.008292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:09.008292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:09.008292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:09.008292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:09.008292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:09.008292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:09.009132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:09.009132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:09.009132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:09.009132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 241/495] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:09.029517 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:09.030469 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0bd55-8ad9-4d9a-bf6d-9b505d263d42 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:09.060337 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbbe88-d2b7-4646-b406-9b6f0ca978dc None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:09.105984 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d324b-c1d8-4f4e-9284-50458ac9326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:09.107301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d324b-c1d8-4f4e-9284-50458ac9326a None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:09.108122 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d324b-c1d8-4f4e-9284-50458ac9326a None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:09.108581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d324b-c1d8-4f4e-9284-50458ac9326a None admin] PATH_INFO: `/v3/users/nova` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:09.119824 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d324b-c1d8-4f4e-9284-50458ac9326a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:09.122115 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d324b-c1d8-4f4e-9284-50458ac9326a None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:09.137469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-3c3d324b-c1d8-4f4e-9284-50458ac9326a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:02:09.137469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:09.137469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:09.137469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:09.137469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:09.137469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:09.137469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:09.137469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:09.137469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:09.137469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:09.137469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:09.137469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:09.137469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:09.137469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:09.137469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:09.137469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:09.138476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:09.138476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:09.138476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:09.138476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:09.138476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:09.138476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:09.138476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:09.138476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:09.138476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:09.138476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:09.138476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:09.138476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:09.138476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:09.138476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:09.138476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:09.138476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:09.138476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:09.138476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:09.139374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:09.139374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:09.139374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:09.139374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:09.139374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:09.139374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:09.139374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:09.139374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:09.139374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:02:09.139374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:09.144330 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 255/496] 10.222.0.79 () {56 vars in 1093 bytes} [Fri Sep 2 21:02:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:09.145957 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d324b-c1d8-4f4e-9284-50458ac9326a None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:09.178949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0bd55-8ad9-4d9a-bf6d-9b505d263d42 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:09.216221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab95b56-e42b-4f54-9aa1-2e95bb73abcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:09.216834 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab95b56-e42b-4f54-9aa1-2e95bb73abcd None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:09.217115 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab95b56-e42b-4f54-9aa1-2e95bb73abcd None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:09.217388 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab95b56-e42b-4f54-9aa1-2e95bb73abcd None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:09.218061 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab95b56-e42b-4f54-9aa1-2e95bb73abcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:09.218364 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab95b56-e42b-4f54-9aa1-2e95bb73abcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:09.220455 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab95b56-e42b-4f54-9aa1-2e95bb73abcd None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:09.239356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 242/497] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:09.239356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab95b56-e42b-4f54-9aa1-2e95bb73abcd None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:09.266650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d324b-c1d8-4f4e-9284-50458ac9326a None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:09.272425 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:09.304914 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee7d36-26f6-4d17-a9c0-cc2a12eaa4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:09.305443 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee7d36-26f6-4d17-a9c0-cc2a12eaa4ae None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:09.305734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee7d36-26f6-4d17-a9c0-cc2a12eaa4ae None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:09.306039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee7d36-26f6-4d17-a9c0-cc2a12eaa4ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:09.308183 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:09.318658 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee7d36-26f6-4d17-a9c0-cc2a12eaa4ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:09.323533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-e9ee7d36-26f6-4d17-a9c0-cc2a12eaa4ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:09.323533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:09.323533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:09.323533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:09.323533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:09.323533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:09.323533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:09.323533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:09.323533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:09.323533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:09.323533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:09.323533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:09.323533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:09.323533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:09.323533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:09.323533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:09.324690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:09.324690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:09.324690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:09.324690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:09.324690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:09.324690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:09.324690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:09.324690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:09.324690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:09.324690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:09.324690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:09.324690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:09.324690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:09.324690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:09.324690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:09.324690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:09.325482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:09.325482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:09.325482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:09.325482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:09.325482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:09.325482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:09.325482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:09.325482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:09.325482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:09.325482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:09.325482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:09.325482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:09.325482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 256/498] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:02:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:09.326644 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee7d36-26f6-4d17-a9c0-cc2a12eaa4ae None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:09.356431 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab95b56-e42b-4f54-9aa1-2e95bb73abcd None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:09.398131 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784439a-87d1-466f-beda-2803234c6c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:09.398742 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784439a-87d1-466f-beda-2803234c6c29 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:09.399057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784439a-87d1-466f-beda-2803234c6c29 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:09.399324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784439a-87d1-466f-beda-2803234c6c29 None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:09.400050 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784439a-87d1-466f-beda-2803234c6c29 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:09.400353 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784439a-87d1-466f-beda-2803234c6c29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:09.402589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784439a-87d1-466f-beda-2803234c6c29 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:09.436742 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee7d36-26f6-4d17-a9c0-cc2a12eaa4ae None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:09.449553 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 243/499] 10.222.0.79 () {56 vars in 1133 bytes} [Fri Sep 2 21:02:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:09.449553 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784439a-87d1-466f-beda-2803234c6c29 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:09.479722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd27c7-f3ac-4fd4-a5e6-85680fc63984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:09.480520 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd27c7-f3ac-4fd4-a5e6-85680fc63984 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:09.480814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd27c7-f3ac-4fd4-a5e6-85680fc63984 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:09.481094 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd27c7-f3ac-4fd4-a5e6-85680fc63984 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:09.489321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd27c7-f3ac-4fd4-a5e6-85680fc63984 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:09.490846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd27c7-f3ac-4fd4-a5e6-85680fc63984 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:09.503300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-4dbd27c7-f3ac-4fd4-a5e6-85680fc63984 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 02 21:02:09.503300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:09.503300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:09.503300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:09.503300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:09.503300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:09.503300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:09.503300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:09.503300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:09.503300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:09.503300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:09.503300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:09.503300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:09.503300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:09.503300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:09.503300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:09.504224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:09.504224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:09.504224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:09.504224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:09.504224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:09.504224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:09.504224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:09.504224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:09.504224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:09.504224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:09.504224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:09.504224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:09.504224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:09.504224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:09.504224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:09.504224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:09.504224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:09.504224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:09.510260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:09.510260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:09.510260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:09.510260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:09.510260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:09.510260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:09.510260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:09.510260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:09.510260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 02 21:02:09.510260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:09.510260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 257/500] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:02:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:09.510260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd27c7-f3ac-4fd4-a5e6-85680fc63984 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:09.560479 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:09.570178 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784439a-87d1-466f-beda-2803234c6c29 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:09.570337 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:09.604958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c09c21-4174-4613-8e6b-4af39962875e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:09.605590 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c09c21-4174-4613-8e6b-4af39962875e None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:09.605901 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c09c21-4174-4613-8e6b-4af39962875e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:09.606182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c09c21-4174-4613-8e6b-4af39962875e None admin] PATH_INFO: `/v3/roles/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:09.615992 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd27c7-f3ac-4fd4-a5e6-85680fc63984 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:09.617270 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c09c21-4174-4613-8e6b-4af39962875e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:09.622101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-68c09c21-4174-4613-8e6b-4af39962875e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:09.622101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:09.622101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:09.622101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:09.622101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:09.622101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:09.622101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:09.622101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:09.622101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:09.622101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:09.622101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:09.622101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:09.622101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:09.622101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:09.622101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:09.622101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:09.623147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:09.623147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:09.623147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:09.623147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:09.623147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:09.623147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:09.623147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:09.623147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:09.623147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:09.623147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:09.623147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:09.623147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:09.623147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:09.623147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:09.623147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:09.623147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:09.623984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:09.623984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:09.623984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:09.623984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:09.623984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:09.623984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:09.623984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:09.623984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:09.623984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:09.623984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:09.623984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:09.623984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:09.623984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 244/501] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:02:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:09.623984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c09c21-4174-4613-8e6b-4af39962875e None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:09.654437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4abfc-40b0-49ea-9b21-df3d83b385df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:09.655041 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4abfc-40b0-49ea-9b21-df3d83b385df None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:09.655329 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4abfc-40b0-49ea-9b21-df3d83b385df None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:09.655609 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4abfc-40b0-49ea-9b21-df3d83b385df None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:09.656270 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4abfc-40b0-49ea-9b21-df3d83b385df None admin] RBAC: Adding query filter params (name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:09.656572 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4abfc-40b0-49ea-9b21-df3d83b385df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:09.658335 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4abfc-40b0-49ea-9b21-df3d83b385df None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:09.666422 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 258/502] 10.222.0.79 () {56 vars in 1103 bytes} [Fri Sep 2 21:02:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:09.667236 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4abfc-40b0-49ea-9b21-df3d83b385df None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:09.746175 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c09c21-4174-4613-8e6b-4af39962875e None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:09.787110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abdda6-60f7-4f58-bcd8-0ff4464069c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:09.787580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4abfc-40b0-49ea-9b21-df3d83b385df None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:09.787769 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abdda6-60f7-4f58-bcd8-0ff4464069c1 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:09.787994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abdda6-60f7-4f58-bcd8-0ff4464069c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:09.788268 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abdda6-60f7-4f58-bcd8-0ff4464069c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:09.803586 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:09.808369 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:09.821889 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e320c3-c888-4745-90e0-c1a65771c655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:09.822420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e320c3-c888-4745-90e0-c1a65771c655 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:09.822704 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e320c3-c888-4745-90e0-c1a65771c655 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:09.822980 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e320c3-c888-4745-90e0-c1a65771c655 None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:09.823704 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e320c3-c888-4745-90e0-c1a65771c655 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:09.824019 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e320c3-c888-4745-90e0-c1a65771c655 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:09.825443 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e320c3-c888-4745-90e0-c1a65771c655 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:09.858871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abdda6-60f7-4f58-bcd8-0ff4464069c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:09.860492 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abdda6-60f7-4f58-bcd8-0ff4464069c1 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:09.862773 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 259/503] 10.222.0.79 () {56 vars in 1137 bytes} [Fri Sep 2 21:02:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:09.864123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5028c8c-90b9-448f-b52c-63412b8b9104 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:09.864388 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5028c8c-90b9-448f-b52c-63412b8b9104 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:09.864687 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5028c8c-90b9-448f-b52c-63412b8b9104 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:09.870455 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 260/504] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:09.870455 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5028c8c-90b9-448f-b52c-63412b8b9104 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:09.965038 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 245/505] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:02:09.965967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abdda6-60f7-4f58-bcd8-0ff4464069c1 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:09.972633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5028c8c-90b9-448f-b52c-63412b8b9104 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:10.007095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1b179-09d7-4200-ba8d-f642d4d5707f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:10.007704 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1b179-09d7-4200-ba8d-f642d4d5707f None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:10.007990 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1b179-09d7-4200-ba8d-f642d4d5707f None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:10.008266 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1b179-09d7-4200-ba8d-f642d4d5707f None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:10.008930 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1b179-09d7-4200-ba8d-f642d4d5707f None admin] RBAC: Adding query filter params (name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:10.009233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1b179-09d7-4200-ba8d-f642d4d5707f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:10.010656 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1b179-09d7-4200-ba8d-f642d4d5707f None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:10.015083 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:10.019337 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 261/506] 10.222.0.79 () {56 vars in 1103 bytes} [Fri Sep 2 21:02:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:10.020174 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1b179-09d7-4200-ba8d-f642d4d5707f None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:10.055644 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:10.065613 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abdda6-60f7-4f58-bcd8-0ff4464069c1 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:10.101216 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07718d-31d7-4221-b30c-07ebd7a1a73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:10.101788 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07718d-31d7-4221-b30c-07ebd7a1a73a None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:10.102085 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07718d-31d7-4221-b30c-07ebd7a1a73a None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:10.102449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07718d-31d7-4221-b30c-07ebd7a1a73a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:10.113277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07718d-31d7-4221-b30c-07ebd7a1a73a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:10.114749 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07718d-31d7-4221-b30c-07ebd7a1a73a None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:10.121912 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1b179-09d7-4200-ba8d-f642d4d5707f None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:10.129326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-af07718d-31d7-4221-b30c-07ebd7a1a73a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:10.129326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:10.129326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:10.129326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:10.129326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:10.129326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:10.129326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:10.129326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:10.129326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:10.129326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:10.129326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:10.129326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:10.129326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:10.129326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:10.129326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:10.129326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:10.130255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:10.130255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:10.130255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:10.130255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:10.130255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:10.130255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:10.130255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:10.130255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:10.130255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:10.130255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:10.130255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:10.130255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:10.130255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:10.130255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:10.130255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:10.130255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:10.130255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:10.131107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:10.131107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:10.131107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:10.131107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 246/507] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:10.131576 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7c995-c316-4847-9d7b-cfed6c923ee2 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:10.131849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7c995-c316-4847-9d7b-cfed6c923ee2 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:10.132130 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7c995-c316-4847-9d7b-cfed6c923ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:10.149852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-95f7c995-c316-4847-9d7b-cfed6c923ee2 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:10.151056 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-95f7c995-c316-4847-9d7b-cfed6c923ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:10.158120 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236d50e-66cc-4ca2-a2d2-56173bd6eb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:10.158698 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236d50e-66cc-4ca2-a2d2-56173bd6eb00 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:10.158979 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236d50e-66cc-4ca2-a2d2-56173bd6eb00 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:10.159244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236d50e-66cc-4ca2-a2d2-56173bd6eb00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:10.218595 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 247/508] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:10.219426 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7c995-c316-4847-9d7b-cfed6c923ee2 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:10.227318 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236d50e-66cc-4ca2-a2d2-56173bd6eb00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:10.228943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236d50e-66cc-4ca2-a2d2-56173bd6eb00 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:10.259065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:10.270440 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:10.333038 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7c995-c316-4847-9d7b-cfed6c923ee2 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:10.348027 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 262/509] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:02:10.348027 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236d50e-66cc-4ca2-a2d2-56173bd6eb00 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:10.376103 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7fb41-bddf-4727-ba83-7a5309974267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:10.376742 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7fb41-bddf-4727-ba83-7a5309974267 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:10.377026 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7fb41-bddf-4727-ba83-7a5309974267 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:10.377313 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7fb41-bddf-4727-ba83-7a5309974267 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:10.388360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7fb41-bddf-4727-ba83-7a5309974267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:10.389850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7fb41-bddf-4727-ba83-7a5309974267 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:10.406114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-9aa7fb41-bddf-4727-ba83-7a5309974267 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:10.406114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:10.406114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:10.406114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:10.406114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:10.406114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:10.406114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:10.406114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:10.406114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:10.406114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:10.406114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:10.406114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:10.406114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:10.406114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:10.406114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:10.406114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:10.407750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:10.407750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:10.407750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:10.407750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:10.407750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:10.407750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:10.407750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:10.407750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:10.407750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:10.407750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:10.407750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:10.407750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:10.407750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:10.407750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:10.407750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:10.407750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:10.407750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:10.408797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:10.408797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:10.408797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:10.408797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 248/510] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:10.408797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7fb41-bddf-4727-ba83-7a5309974267 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:10.464236 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236d50e-66cc-4ca2-a2d2-56173bd6eb00 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:10.506553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3cc98-ddf5-4896-84e9-c97e95ba318a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:10.507181 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3cc98-ddf5-4896-84e9-c97e95ba318a None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:10.507462 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3cc98-ddf5-4896-84e9-c97e95ba318a None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:10.507731 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3cc98-ddf5-4896-84e9-c97e95ba318a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:10.508625 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:10.510487 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:10.518910 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3cc98-ddf5-4896-84e9-c97e95ba318a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:10.520382 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3cc98-ddf5-4896-84e9-c97e95ba318a None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:10.527140 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7fb41-bddf-4727-ba83-7a5309974267 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:10.535867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-ecb3cc98-ddf5-4896-84e9-c97e95ba318a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:10.535867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:10.535867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:10.535867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:10.535867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:10.535867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:10.535867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:10.535867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:10.535867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:10.535867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:10.535867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:10.535867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:10.535867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:10.535867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:10.535867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:10.535867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:10.536807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:10.536807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:10.536807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:10.536807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:10.536807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:10.536807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:10.536807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:10.536807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:10.536807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:10.536807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:10.536807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:10.536807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:10.536807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:10.536807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:10.536807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:10.536807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:10.536807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:10.537643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:10.537643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:10.537643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:10.537643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 263/511] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:10.537899 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3cc98-ddf5-4896-84e9-c97e95ba318a None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:10.561106 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f87be3-d2b1-4cde-831f-62d2765f4e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:10.561776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f87be3-d2b1-4cde-831f-62d2765f4e74 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:10.562119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f87be3-d2b1-4cde-831f-62d2765f4e74 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:10.562398 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f87be3-d2b1-4cde-831f-62d2765f4e74 None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:10.563049 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f87be3-d2b1-4cde-831f-62d2765f4e74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:10.563360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f87be3-d2b1-4cde-831f-62d2765f4e74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:10.565282 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f87be3-d2b1-4cde-831f-62d2765f4e74 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:10.576860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 249/512] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:10.577678 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f87be3-d2b1-4cde-831f-62d2765f4e74 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:10.639106 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3cc98-ddf5-4896-84e9-c97e95ba318a None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:10.675048 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d921180-4cf7-4ac6-a251-9ce6cfdcef61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:10.675687 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d921180-4cf7-4ac6-a251-9ce6cfdcef61 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:10.675997 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d921180-4cf7-4ac6-a251-9ce6cfdcef61 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:10.676251 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d921180-4cf7-4ac6-a251-9ce6cfdcef61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:10.679455 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f87be3-d2b1-4cde-831f-62d2765f4e74 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:10.688002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d921180-4cf7-4ac6-a251-9ce6cfdcef61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:10.690464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d921180-4cf7-4ac6-a251-9ce6cfdcef61 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:10.706904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-4d921180-4cf7-4ac6-a251-9ce6cfdcef61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:10.706904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:10.706904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:10.706904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:10.706904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:10.706904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:10.706904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:10.706904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:10.706904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:10.706904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:10.706904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:10.706904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:10.706904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:10.706904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:10.706904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:10.706904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:10.707859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:10.707859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:10.707859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:10.707859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:10.707859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:10.707859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:10.707859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:10.707859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:10.707859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:10.707859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:10.707859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:10.707859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:10.707859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:10.707859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:10.707859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:10.707859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:10.707859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:10.708713 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:10.708713 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:10.708713 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:10.708713 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 264/513] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:10.708919 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d921180-4cf7-4ac6-a251-9ce6cfdcef61 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:10.719155 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be050537-99fa-48ea-9f56-11c0d63c21ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:10.719940 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be050537-99fa-48ea-9f56-11c0d63c21ac None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:10.720226 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be050537-99fa-48ea-9f56-11c0d63c21ac None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:10.720504 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be050537-99fa-48ea-9f56-11c0d63c21ac None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:10.721160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be050537-99fa-48ea-9f56-11c0d63c21ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:10.721474 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be050537-99fa-48ea-9f56-11c0d63c21ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:10.722891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be050537-99fa-48ea-9f56-11c0d63c21ac None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:10.734855 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 250/514] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:10.736325 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be050537-99fa-48ea-9f56-11c0d63c21ac None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:10.739638 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:10.761281 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:10.827298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d921180-4cf7-4ac6-a251-9ce6cfdcef61 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:10.839075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be050537-99fa-48ea-9f56-11c0d63c21ac None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:10.868051 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406325f-282e-4ffb-ab50-1c613bd29279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:10.868875 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406325f-282e-4ffb-ab50-1c613bd29279 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:10.869188 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406325f-282e-4ffb-ab50-1c613bd29279 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:10.869615 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406325f-282e-4ffb-ab50-1c613bd29279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:10.882971 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d969f60-9e56-4aa1-9bc8-920a83bb74b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:10.883579 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d969f60-9e56-4aa1-9bc8-920a83bb74b1 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:10.883886 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d969f60-9e56-4aa1-9bc8-920a83bb74b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:10.884165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d969f60-9e56-4aa1-9bc8-920a83bb74b1 None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:10.884817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d969f60-9e56-4aa1-9bc8-920a83bb74b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:10.885122 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d969f60-9e56-4aa1-9bc8-920a83bb74b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:10.886523 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d969f60-9e56-4aa1-9bc8-920a83bb74b1 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:10.886766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406325f-282e-4ffb-ab50-1c613bd29279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:10.888256 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406325f-282e-4ffb-ab50-1c613bd29279 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:10.899481 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 251/515] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:10.900260 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d969f60-9e56-4aa1-9bc8-920a83bb74b1 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:10.903582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-8406325f-282e-4ffb-ab50-1c613bd29279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:10.903582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:10.903582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:10.903582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:10.903582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:10.903582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:10.903582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:10.903582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:10.903582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:10.903582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:10.903582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:10.903582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:10.903582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:10.903582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:10.903582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:10.903582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:10.904945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:10.904945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:10.904945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:10.904945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:10.904945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:10.904945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:10.904945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:10.904945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:10.904945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:10.904945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:10.904945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:10.904945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:10.904945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:10.904945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:10.904945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:10.904945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:10.904945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:10.906143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:10.906143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:10.906143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:10.906143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 265/516] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:10.906143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406325f-282e-4ffb-ab50-1c613bd29279 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:10.972386 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:11.005003 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:11.013063 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d969f60-9e56-4aa1-9bc8-920a83bb74b1 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:11.014022 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406325f-282e-4ffb-ab50-1c613bd29279 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:11.049261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6f49b-5d15-4a32-b296-730b02e95ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:11.049928 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6f49b-5d15-4a32-b296-730b02e95ca0 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:11.050215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6f49b-5d15-4a32-b296-730b02e95ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:11.050411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c507ab-c1e8-4cd1-bfd7-51b01bcfadf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:11.050527 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6f49b-5d15-4a32-b296-730b02e95ca0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:11.051016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c507ab-c1e8-4cd1-bfd7-51b01bcfadf7 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:11.051294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c507ab-c1e8-4cd1-bfd7-51b01bcfadf7 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:11.051571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c507ab-c1e8-4cd1-bfd7-51b01bcfadf7 None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:11.052208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c507ab-c1e8-4cd1-bfd7-51b01bcfadf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:11.052516 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c507ab-c1e8-4cd1-bfd7-51b01bcfadf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:11.053923 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c507ab-c1e8-4cd1-bfd7-51b01bcfadf7 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:11.058220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6f49b-5d15-4a32-b296-730b02e95ca0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:11.059655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6f49b-5d15-4a32-b296-730b02e95ca0 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:11.066567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 266/517] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:11.067395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c507ab-c1e8-4cd1-bfd7-51b01bcfadf7 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:11.072958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-c3d6f49b-5d15-4a32-b296-730b02e95ca0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 21:02:11.072958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:11.072958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:11.072958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:11.072958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:11.072958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:11.072958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:11.072958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:11.072958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:11.072958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:11.072958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:11.072958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:11.072958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:11.072958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:11.072958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:11.072958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:11.074067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:11.074067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:11.074067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:11.074067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:11.074067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:11.074067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:11.074067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:11.074067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:11.074067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:11.074067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:11.074067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:11.074067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:11.074067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:11.074067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:11.074067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:11.074067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:11.074067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:11.074067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:11.074957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:11.074957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:11.074957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:11.074957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:11.074957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:11.074957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:11.074957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:11.074957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:11.074957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 21:02:11.074957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:11.074957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 252/518] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:02:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:11.074957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6f49b-5d15-4a32-b296-730b02e95ca0 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:11.178697 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c507ab-c1e8-4cd1-bfd7-51b01bcfadf7 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:11.179859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6f49b-5d15-4a32-b296-730b02e95ca0 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:11.205672 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:11.217947 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda9766-9451-406c-a8dd-6a41b0d5a09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:11.218588 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda9766-9451-406c-a8dd-6a41b0d5a09f None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:11.218866 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda9766-9451-406c-a8dd-6a41b0d5a09f None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:11.219141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda9766-9451-406c-a8dd-6a41b0d5a09f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:11.220427 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a83238-d259-43f0-910f-b5c36c8ccc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:11.221154 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a83238-d259-43f0-910f-b5c36c8ccc37 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:11.221443 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a83238-d259-43f0-910f-b5c36c8ccc37 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:11.221712 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a83238-d259-43f0-910f-b5c36c8ccc37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:11.228094 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda9766-9451-406c-a8dd-6a41b0d5a09f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:11.228456 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a83238-d259-43f0-910f-b5c36c8ccc37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:11.229555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda9766-9451-406c-a8dd-6a41b0d5a09f None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:11.229942 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a83238-d259-43f0-910f-b5c36c8ccc37 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:11.242227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-7eda9766-9451-406c-a8dd-6a41b0d5a09f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 21:02:11.242227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:11.242227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:11.242227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:11.242227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:11.242227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:11.242227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:11.242227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:11.242227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:11.242227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:11.242227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:11.242227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:11.242227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:11.242227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:11.242227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:11.242227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:11.243261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:11.243261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:11.243261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:11.243261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:11.243261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:11.243261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:11.243261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:11.243261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:11.243261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:11.243261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:11.243261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:11.243261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:11.243261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:11.243261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:11.243261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:11.243261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:11.243261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:11.243261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:11.244176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:11.244176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:11.244176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:11.244176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:11.244176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:11.244176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:11.244176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:11.244176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:11.244176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 21:02:11.244176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:11.244827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-29a83238-d259-43f0-910f-b5c36c8ccc37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:11.244827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:11.244827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:11.244827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:11.244827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:11.244827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:11.244827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:11.244827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:11.244827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:11.244827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:11.244827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:11.244827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:11.244827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:11.244827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:11.244827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:11.245567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:11.245567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:11.245567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:11.245567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:11.245567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:11.245567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:11.245567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:11.245567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:11.245567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:11.245567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:11.245567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:11.245567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:11.245567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:11.245567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:11.245567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:11.245567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:11.245567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:11.246479 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:11.246479 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:11.246479 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:11.246479 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:11.246479 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:11.246479 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:11.246479 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:11.246479 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:11.246932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 253/519] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:02:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:11.246932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda9766-9451-406c-a8dd-6a41b0d5a09f None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:11.248564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 267/520] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:11.249114 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a83238-d259-43f0-910f-b5c36c8ccc37 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:11.264432 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:11.349259 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda9766-9451-406c-a8dd-6a41b0d5a09f None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:11.351586 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a83238-d259-43f0-910f-b5c36c8ccc37 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:11.384896 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3770b1f-e6ce-4a1c-8f89-14c8b92ca0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:11.385506 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3770b1f-e6ce-4a1c-8f89-14c8b92ca0fd None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:11.385790 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3770b1f-e6ce-4a1c-8f89-14c8b92ca0fd None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:11.386112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3770b1f-e6ce-4a1c-8f89-14c8b92ca0fd None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:11.386767 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3770b1f-e6ce-4a1c-8f89-14c8b92ca0fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:11.386995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b154c-a839-49bb-b9f2-8d5a875fd43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:11.387110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3770b1f-e6ce-4a1c-8f89-14c8b92ca0fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:11.387634 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b154c-a839-49bb-b9f2-8d5a875fd43f None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:11.387918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b154c-a839-49bb-b9f2-8d5a875fd43f None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:11.388196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b154c-a839-49bb-b9f2-8d5a875fd43f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:11.388493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3770b1f-e6ce-4a1c-8f89-14c8b92ca0fd None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:11.395838 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b154c-a839-49bb-b9f2-8d5a875fd43f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:11.397306 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b154c-a839-49bb-b9f2-8d5a875fd43f None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:11.401179 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 254/521] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:11.402054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3770b1f-e6ce-4a1c-8f89-14c8b92ca0fd None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:11.409965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-c28b154c-a839-49bb-b9f2-8d5a875fd43f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:11.409965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:11.409965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:11.409965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:11.409965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:11.409965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:11.409965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:11.409965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:11.409965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:11.409965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:11.409965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:11.409965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:11.409965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:11.409965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:11.409965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:11.410995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:11.410995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:11.410995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:11.410995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:11.410995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:11.410995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:11.410995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:11.410995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:11.410995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:11.410995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:11.410995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:11.410995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:11.410995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:11.410995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:11.410995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:11.410995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:11.410995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:11.411862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:11.411862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:11.411862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:11.411862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:11.411862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:11.411862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:11.411862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:11.411862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:11.411862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 268/522] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:11.412362 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b154c-a839-49bb-b9f2-8d5a875fd43f None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:11.465773 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:11.498406 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:11.521742 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3770b1f-e6ce-4a1c-8f89-14c8b92ca0fd None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:11.528602 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b154c-a839-49bb-b9f2-8d5a875fd43f None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:11.557066 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa045dee-2a47-43dc-b19f-6354b41e9f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:11.557672 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa045dee-2a47-43dc-b19f-6354b41e9f80 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:11.557982 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa045dee-2a47-43dc-b19f-6354b41e9f80 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:11.558256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa045dee-2a47-43dc-b19f-6354b41e9f80 None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:11.558981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa045dee-2a47-43dc-b19f-6354b41e9f80 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:11.559284 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa045dee-2a47-43dc-b19f-6354b41e9f80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:11.560697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa045dee-2a47-43dc-b19f-6354b41e9f80 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:11.563870 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514846a-8377-491a-96e4-32da5c6927a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:11.564474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514846a-8377-491a-96e4-32da5c6927a0 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:11.564757 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514846a-8377-491a-96e4-32da5c6927a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:11.565036 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514846a-8377-491a-96e4-32da5c6927a0 None admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:11.565726 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514846a-8377-491a-96e4-32da5c6927a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:11.566070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514846a-8377-491a-96e4-32da5c6927a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:11.567508 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514846a-8377-491a-96e4-32da5c6927a0 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:11.577718 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 255/523] 10.222.0.79 () {56 vars in 1139 bytes} [Fri Sep 2 21:02:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:11.578566 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa045dee-2a47-43dc-b19f-6354b41e9f80 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:11.590370 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 269/524] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:11.591340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514846a-8377-491a-96e4-32da5c6927a0 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:11.689177 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa045dee-2a47-43dc-b19f-6354b41e9f80 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:11.690836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:11.696535 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514846a-8377-491a-96e4-32da5c6927a0 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:11.725315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170410c9-f4b2-4578-92dd-c05d60f74341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:11.725862 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170410c9-f4b2-4578-92dd-c05d60f74341 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:11.726147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170410c9-f4b2-4578-92dd-c05d60f74341 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:11.726424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170410c9-f4b2-4578-92dd-c05d60f74341 None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:11.727155 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170410c9-f4b2-4578-92dd-c05d60f74341 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:11.727472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170410c9-f4b2-4578-92dd-c05d60f74341 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:11.728530 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:11.729133 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170410c9-f4b2-4578-92dd-c05d60f74341 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:11.733439 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f13175-46f3-41b3-8334-df4bdf7d1f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:11.734111 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f13175-46f3-41b3-8334-df4bdf7d1f91 None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:11.734394 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f13175-46f3-41b3-8334-df4bdf7d1f91 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:11.734672 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f13175-46f3-41b3-8334-df4bdf7d1f91 None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:11.735948 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f13175-46f3-41b3-8334-df4bdf7d1f91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:11.737403 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f13175-46f3-41b3-8334-df4bdf7d1f91 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:11.747861 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 256/525] 10.222.0.79 () {56 vars in 1137 bytes} [Fri Sep 2 21:02:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:11.748694 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170410c9-f4b2-4578-92dd-c05d60f74341 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:11.850091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170410c9-f4b2-4578-92dd-c05d60f74341 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:11.885738 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddacbf-a412-4b13-87a1-f675ab6f5ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:11.886489 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddacbf-a412-4b13-87a1-f675ab6f5ded None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:11.886843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddacbf-a412-4b13-87a1-f675ab6f5ded None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:11.887121 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddacbf-a412-4b13-87a1-f675ab6f5ded None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:11.887825 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddacbf-a412-4b13-87a1-f675ab6f5ded None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:11.888134 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddacbf-a412-4b13-87a1-f675ab6f5ded None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:11.889547 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 270/526] 10.222.0.79 () {60 vars in 1132 bytes} [Fri Sep 2 21:02:11 2022] POST /identity/v3/users => generated 247 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:11.890449 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f13175-46f3-41b3-8334-df4bdf7d1f91 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:11.892875 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddacbf-a412-4b13-87a1-f675ab6f5ded None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:11.914356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 257/527] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:11.915245 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddacbf-a412-4b13-87a1-f675ab6f5ded None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:11.943911 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:12.024161 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f13175-46f3-41b3-8334-df4bdf7d1f91 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:12.037098 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddacbf-a412-4b13-87a1-f675ab6f5ded None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:12.066562 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac652ef-2a08-4aee-840d-ce14b5ecf5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:12.067160 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac652ef-2a08-4aee-840d-ce14b5ecf5eb None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:12.067444 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac652ef-2a08-4aee-840d-ce14b5ecf5eb None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:12.067723 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac652ef-2a08-4aee-840d-ce14b5ecf5eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:12.081977 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9ea77-3504-4113-96c7-2154949ece5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:12.083055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9ea77-3504-4113-96c7-2154949ece5c None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:12.083342 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9ea77-3504-4113-96c7-2154949ece5c None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:12.084042 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9ea77-3504-4113-96c7-2154949ece5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:12.084806 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9ea77-3504-4113-96c7-2154949ece5c None admin] RBAC: Adding query filter params (role.id=1c1ddcbda0754702bb016952e90405ca, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=632071470f7d409ab7b0129d120320c7) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:12.085384 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9ea77-3504-4113-96c7-2154949ece5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:12.087088 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9ea77-3504-4113-96c7-2154949ece5c None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:12.093333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 258/528] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:11 2022] GET /identity/v3/role_assignments?user.id=632071470f7d409ab7b0129d120320c7&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=1c1ddcbda0754702bb016952e90405ca => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:12.094181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9ea77-3504-4113-96c7-2154949ece5c None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:12.136218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:12.150741 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac652ef-2a08-4aee-840d-ce14b5ecf5eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:12.152375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac652ef-2a08-4aee-840d-ce14b5ecf5eb None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:12.230211 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:12.255880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9ea77-3504-4113-96c7-2154949ece5c None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:12.281783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 271/529] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:02:12.283267 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac652ef-2a08-4aee-840d-ce14b5ecf5eb None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:12.303604 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f236936-98e9-4d7b-aa80-7bcb72966e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:12.304481 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f236936-98e9-4d7b-aa80-7bcb72966e79 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:12.304793 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f236936-98e9-4d7b-aa80-7bcb72966e79 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:12.305448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f236936-98e9-4d7b-aa80-7bcb72966e79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:12.394374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:12.400097 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f236936-98e9-4d7b-aa80-7bcb72966e79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:12.401927 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f236936-98e9-4d7b-aa80-7bcb72966e79 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:12.410593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac652ef-2a08-4aee-840d-ce14b5ecf5eb None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:12.456222 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62efcc-8a2d-4d4b-afd0-5002f5ecde8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:12.456848 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62efcc-8a2d-4d4b-afd0-5002f5ecde8b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:12.457133 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62efcc-8a2d-4d4b-afd0-5002f5ecde8b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:12.457411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62efcc-8a2d-4d4b-afd0-5002f5ecde8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:12.458754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62efcc-8a2d-4d4b-afd0-5002f5ecde8b None admin] RBAC: Adding query filter params (role.id=1c1ddcbda0754702bb016952e90405ca, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=72840602ec264a74855b601c8d1ddf89) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:12.459072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62efcc-8a2d-4d4b-afd0-5002f5ecde8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:12.460805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62efcc-8a2d-4d4b-afd0-5002f5ecde8b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:12.469365 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 272/530] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:12 2022] GET /identity/v3/role_assignments?user.id=72840602ec264a74855b601c8d1ddf89&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=1c1ddcbda0754702bb016952e90405ca => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:12.470575 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62efcc-8a2d-4d4b-afd0-5002f5ecde8b None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:12.503828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:12.523715 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 259/531] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:02:12.534747 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f236936-98e9-4d7b-aa80-7bcb72966e79 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:12.619350 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62efcc-8a2d-4d4b-afd0-5002f5ecde8b None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:12.672078 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017a223-e3cb-4e61-8b7b-ea2a349164aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:12.673263 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017a223-e3cb-4e61-8b7b-ea2a349164aa None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:12.673549 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017a223-e3cb-4e61-8b7b-ea2a349164aa None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:12.673844 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017a223-e3cb-4e61-8b7b-ea2a349164aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:12.695733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017a223-e3cb-4e61-8b7b-ea2a349164aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:12.697959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017a223-e3cb-4e61-8b7b-ea2a349164aa None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:12.716972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-4017a223-e3cb-4e61-8b7b-ea2a349164aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:12.716972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:12.716972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:12.716972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:12.716972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:12.716972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:12.716972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:12.716972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:12.716972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:12.716972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:12.716972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:12.716972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:12.716972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:12.716972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:12.716972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:12.716972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:12.717982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:12.717982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:12.717982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:12.717982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:12.717982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:12.717982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:12.717982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:12.717982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:12.717982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:12.717982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:12.717982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:12.717982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:12.717982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:12.717982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:12.717982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:12.717982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:12.717982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:12.718826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:12.718826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:12.718826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:12.729129 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 273/532] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:12.734742 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017a223-e3cb-4e61-8b7b-ea2a349164aa None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:12.742360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:12.788429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f236936-98e9-4d7b-aa80-7bcb72966e79 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:12.852396 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfbc23-1e36-434a-bd53-2a399b15f2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:12.853413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfbc23-1e36-434a-bd53-2a399b15f2f1 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:12.854625 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfbc23-1e36-434a-bd53-2a399b15f2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:12.855698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfbc23-1e36-434a-bd53-2a399b15f2f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:12.876837 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfbc23-1e36-434a-bd53-2a399b15f2f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:12.879438 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfbc23-1e36-434a-bd53-2a399b15f2f1 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:12.904651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-eecfbc23-1e36-434a-bd53-2a399b15f2f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:12.904651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:12.904651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:12.904651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:12.904651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:12.904651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:12.904651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:12.904651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:12.904651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:12.904651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:12.904651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:12.904651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:12.904651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:12.904651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:12.904651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:12.904651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:12.905836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:12.905836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:12.905836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:12.905836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:12.905836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:12.905836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:12.905836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:12.905836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:12.905836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:12.905836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:12.905836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:12.905836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:12.905836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:12.905836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:12.905836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:12.905836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:12.905836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:12.906901 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:12.906901 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:12.906901 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:12.917627 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 260/533] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:12.919888 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfbc23-1e36-434a-bd53-2a399b15f2f1 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:12.944731 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017a223-e3cb-4e61-8b7b-ea2a349164aa None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:12.978221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:13.007652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec7c62-e44f-4a88-b2c9-29c87dea104f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:13.008240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec7c62-e44f-4a88-b2c9-29c87dea104f None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:13.008689 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec7c62-e44f-4a88-b2c9-29c87dea104f None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:13.009077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec7c62-e44f-4a88-b2c9-29c87dea104f None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:13.009754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec7c62-e44f-4a88-b2c9-29c87dea104f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:13.010189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec7c62-e44f-4a88-b2c9-29c87dea104f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:13.011691 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec7c62-e44f-4a88-b2c9-29c87dea104f None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:13.036657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 274/534] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:13.042113 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec7c62-e44f-4a88-b2c9-29c87dea104f None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:13.050994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfbc23-1e36-434a-bd53-2a399b15f2f1 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:13.089255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72081350-6b84-4f7b-a063-77ce19af6a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:13.090344 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72081350-6b84-4f7b-a063-77ce19af6a4a None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:13.090867 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72081350-6b84-4f7b-a063-77ce19af6a4a None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:13.091340 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72081350-6b84-4f7b-a063-77ce19af6a4a None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:13.092193 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72081350-6b84-4f7b-a063-77ce19af6a4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:13.092727 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72081350-6b84-4f7b-a063-77ce19af6a4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:13.094644 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72081350-6b84-4f7b-a063-77ce19af6a4a None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:13.128053 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 261/535] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:13.133759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72081350-6b84-4f7b-a063-77ce19af6a4a None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:13.185507 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:13.260715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec7c62-e44f-4a88-b2c9-29c87dea104f None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:13.278798 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:13.285947 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72081350-6b84-4f7b-a063-77ce19af6a4a None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:13.324134 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319eb387-c07e-4e3b-b3ef-8c425d500d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:13.325140 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319eb387-c07e-4e3b-b3ef-8c425d500d43 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:13.325649 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319eb387-c07e-4e3b-b3ef-8c425d500d43 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:13.326213 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319eb387-c07e-4e3b-b3ef-8c425d500d43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:13.335127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319eb387-c07e-4e3b-b3ef-8c425d500d43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:13.337037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319eb387-c07e-4e3b-b3ef-8c425d500d43 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:13.349239 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66d811-8398-4a77-9ca8-484c1d8468a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:13.349944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66d811-8398-4a77-9ca8-484c1d8468a6 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:13.350231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66d811-8398-4a77-9ca8-484c1d8468a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:13.350509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66d811-8398-4a77-9ca8-484c1d8468a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:13.351759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-319eb387-c07e-4e3b-b3ef-8c425d500d43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:13.351759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:13.351759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:13.351759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:13.351759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:13.351759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:13.351759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:13.351759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:13.351759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:13.351759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:13.351759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:13.351759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:13.351759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:13.351759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:13.351759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:13.352660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:13.352660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:13.352660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:13.352660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:13.352660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:13.352660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:13.352660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:13.352660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:13.352660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:13.352660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:13.352660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:13.352660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:13.352660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:13.352660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:13.352660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:13.352660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:13.352660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:13.353533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:13.353533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:13.353533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:13.353533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:13.353533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:13.353533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:13.353533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:13.353533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:13.355954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 262/536] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:13.362770 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319eb387-c07e-4e3b-b3ef-8c425d500d43 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:13.362946 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66d811-8398-4a77-9ca8-484c1d8468a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:13.365831 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66d811-8398-4a77-9ca8-484c1d8468a6 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:13.381832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-cd66d811-8398-4a77-9ca8-484c1d8468a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:13.381832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:13.381832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:13.381832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:13.381832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:13.381832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:13.381832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:13.381832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:13.381832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:13.381832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:13.381832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:13.381832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:13.381832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:13.381832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:13.381832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:13.382745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:13.382745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:13.382745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:13.382745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:13.382745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:13.382745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:13.382745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:13.382745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:13.382745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:13.382745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:13.382745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:13.382745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:13.382745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:13.382745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:13.382745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:13.382745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:13.382745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:13.383573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:13.383573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:13.383573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:13.383573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:13.383573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:13.383573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:13.383573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:13.383573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:13.383573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 275/537] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:13.384978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66d811-8398-4a77-9ca8-484c1d8468a6 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:13.556697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319eb387-c07e-4e3b-b3ef-8c425d500d43 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:13.560742 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66d811-8398-4a77-9ca8-484c1d8468a6 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:13.603876 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:13.622993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6c441-98aa-4d83-a7ab-635bc964bbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:13.623598 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6c441-98aa-4d83-a7ab-635bc964bbf6 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:13.623881 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6c441-98aa-4d83-a7ab-635bc964bbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:13.624705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d49387-7b89-4ab3-8336-8fae3ed9275e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:13.625312 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d49387-7b89-4ab3-8336-8fae3ed9275e None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:13.625584 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d49387-7b89-4ab3-8336-8fae3ed9275e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:13.625913 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d49387-7b89-4ab3-8336-8fae3ed9275e None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:13.626777 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d49387-7b89-4ab3-8336-8fae3ed9275e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:13.627082 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d49387-7b89-4ab3-8336-8fae3ed9275e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:13.628516 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d49387-7b89-4ab3-8336-8fae3ed9275e None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:13.630390 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6c441-98aa-4d83-a7ab-635bc964bbf6 None admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:13.631153 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6c441-98aa-4d83-a7ab-635bc964bbf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:13.631467 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6c441-98aa-4d83-a7ab-635bc964bbf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:13.632904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6c441-98aa-4d83-a7ab-635bc964bbf6 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:13.655865 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 263/538] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:13.656165 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 276/539] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:13.660475 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d49387-7b89-4ab3-8336-8fae3ed9275e None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:13.666514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6c441-98aa-4d83-a7ab-635bc964bbf6 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:13.711530 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:13.861786 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6c441-98aa-4d83-a7ab-635bc964bbf6 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:13.894874 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d49387-7b89-4ab3-8336-8fae3ed9275e None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:13.937400 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14511c42-7dbd-4327-ab7a-e2a947ac3bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:13.938098 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14511c42-7dbd-4327-ab7a-e2a947ac3bf8 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:13.939068 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14511c42-7dbd-4327-ab7a-e2a947ac3bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:13.939431 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14511c42-7dbd-4327-ab7a-e2a947ac3bf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:13.940247 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14511c42-7dbd-4327-ab7a-e2a947ac3bf8 None admin] RBAC: Adding query filter params (role.id=1c1ddcbda0754702bb016952e90405ca, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=7fc07c138a414936b2bb95dd3ded9ee7) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:13.940560 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14511c42-7dbd-4327-ab7a-e2a947ac3bf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:13.942081 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14511c42-7dbd-4327-ab7a-e2a947ac3bf8 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:13.960529 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 277/540] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:13 2022] GET /identity/v3/role_assignments?user.id=7fc07c138a414936b2bb95dd3ded9ee7&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=1c1ddcbda0754702bb016952e90405ca => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:13.963887 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2962f-5dc3-4dbc-99c5-3bfa0df009f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:13.964512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2962f-5dc3-4dbc-99c5-3bfa0df009f2 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:13.964793 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2962f-5dc3-4dbc-99c5-3bfa0df009f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:13.965066 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2962f-5dc3-4dbc-99c5-3bfa0df009f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:13.965833 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2962f-5dc3-4dbc-99c5-3bfa0df009f2 None admin] RBAC: Adding query filter params (role.id=1c1ddcbda0754702bb016952e90405ca, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=aefaf6998acc4434aab62b9625bd25fa) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:13.966155 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2962f-5dc3-4dbc-99c5-3bfa0df009f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:13.967698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2962f-5dc3-4dbc-99c5-3bfa0df009f2 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:13.975636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 264/541] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:13 2022] GET /identity/v3/role_assignments?user.id=aefaf6998acc4434aab62b9625bd25fa&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=1c1ddcbda0754702bb016952e90405ca => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:14.189411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0844f-31da-4f40-9b59-574cb0d08824 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:14.189847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0844f-31da-4f40-9b59-574cb0d08824 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:14.190230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0844f-31da-4f40-9b59-574cb0d08824 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:14.191649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 278/542] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:14.197509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da7e64-b683-4956-b1ee-f889af07411d None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:14.198070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da7e64-b683-4956-b1ee-f889af07411d None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:14.198271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da7e64-b683-4956-b1ee-f889af07411d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:14.222892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-25da7e64-b683-4956-b1ee-f889af07411d None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:14.224306 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-25da7e64-b683-4956-b1ee-f889af07411d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:14.301028 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 265/543] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:14.308984 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6d69c-5fcc-49c5-9ba5-d0c148eaee29 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:14.309269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6d69c-5fcc-49c5-9ba5-d0c148eaee29 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:14.309532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6d69c-5fcc-49c5-9ba5-d0c148eaee29 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:14.311146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 279/544] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:14.317452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c713586-5f7d-42d5-a07e-8a185dbc0428 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:14.317746 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c713586-5f7d-42d5-a07e-8a185dbc0428 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:14.318046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c713586-5f7d-42d5-a07e-8a185dbc0428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:14.338851 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-9c713586-5f7d-42d5-a07e-8a185dbc0428 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:14.340048 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-9c713586-5f7d-42d5-a07e-8a185dbc0428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:14.343156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:14.427896 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 266/545] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:14.636205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6d69c-5fcc-49c5-9ba5-d0c148eaee29 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:14.701779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:14.776479 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6d69c-5fcc-49c5-9ba5-d0c148eaee29 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:14.815580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836663cb-5970-4e1c-a9ba-37767e213f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:14.816219 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836663cb-5970-4e1c-a9ba-37767e213f49 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:14.816501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836663cb-5970-4e1c-a9ba-37767e213f49 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:14.816777 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836663cb-5970-4e1c-a9ba-37767e213f49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:14.827808 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836663cb-5970-4e1c-a9ba-37767e213f49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:14.831222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c713586-5f7d-42d5-a07e-8a185dbc0428 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:14.834221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-836663cb-5970-4e1c-a9ba-37767e213f49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:14.834221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:14.834221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:14.834221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:14.834221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:14.834221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:14.834221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:14.834221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:14.834221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:14.834221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:14.834221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:14.834221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:14.834221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:14.834221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:14.834221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:14.834221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:14.835118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:14.835118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:14.835118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:14.835118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:14.835118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:14.835118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:14.835118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:14.835118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:14.835118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:14.835118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:14.835118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:14.835118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:14.835118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:14.835118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:14.835118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:14.835118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:14.835907 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:14.835907 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:14.835907 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:14.835907 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:14.835907 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:14.835907 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:14.835907 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:14.835907 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:14.835907 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:14.835907 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:14.835907 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:14.835907 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:14.835907 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 280/546] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:02:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:14.841331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836663cb-5970-4e1c-a9ba-37767e213f49 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:14.978244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836663cb-5970-4e1c-a9ba-37767e213f49 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:14.988654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:15.016829 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dae0e-9ae1-480f-a496-b03c073c7bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:15.017762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dae0e-9ae1-480f-a496-b03c073c7bda None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:15.018242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dae0e-9ae1-480f-a496-b03c073c7bda None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:15.018703 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dae0e-9ae1-480f-a496-b03c073c7bda None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:15.019679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5dae0e-9ae1-480f-a496-b03c073c7bda None admin] RBAC: Adding query filter params (name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:15.020162 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5dae0e-9ae1-480f-a496-b03c073c7bda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:15.021801 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5dae0e-9ae1-480f-a496-b03c073c7bda None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:15.042192 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c713586-5f7d-42d5-a07e-8a185dbc0428 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:15.049857 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 281/547] 10.222.0.79 () {56 vars in 1103 bytes} [Fri Sep 2 21:02:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:15.054725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dae0e-9ae1-480f-a496-b03c073c7bda None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:15.113309 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a8d49-5a94-47b5-be9c-6847ccaa885b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:15.115432 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a8d49-5a94-47b5-be9c-6847ccaa885b None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:15.115937 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a8d49-5a94-47b5-be9c-6847ccaa885b None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:15.116411 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a8d49-5a94-47b5-be9c-6847ccaa885b None admin] PATH_INFO: `/v3/roles/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:15.127641 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:15.131208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a8d49-5a94-47b5-be9c-6847ccaa885b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:15.138129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-3e0a8d49-5a94-47b5-be9c-6847ccaa885b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:15.138129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:15.138129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:15.138129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:15.138129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:15.138129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:15.138129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:15.138129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:15.138129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:15.138129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:15.138129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:15.138129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:15.138129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:15.138129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:15.138129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:15.138129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:15.146784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:15.146784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:15.146784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:15.146784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:15.146784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:15.146784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:15.146784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:15.146784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:15.146784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:15.146784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:15.146784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:15.146784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:15.146784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:15.146784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:15.146784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:15.146784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:15.148070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:15.148070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:15.148070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:15.148070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:15.148070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:15.148070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:15.148070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:15.148070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:15.148070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:15.148070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:15.148070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:15.148070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:15.148070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 267/548] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:02:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:15.148070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd4649-15cf-43f3-8819-08f964fdb2b3 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:15.148971 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd4649-15cf-43f3-8819-08f964fdb2b3 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:15.148971 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd4649-15cf-43f3-8819-08f964fdb2b3 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:15.148971 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 268/549] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:15.148971 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd4649-15cf-43f3-8819-08f964fdb2b3 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:15.225539 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dae0e-9ae1-480f-a496-b03c073c7bda None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:15.294241 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d110da9-1212-4324-b6b0-1efcc24e102b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:15.295226 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d110da9-1212-4324-b6b0-1efcc24e102b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:15.295723 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d110da9-1212-4324-b6b0-1efcc24e102b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:15.296149 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d110da9-1212-4324-b6b0-1efcc24e102b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:15.297735 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd4649-15cf-43f3-8819-08f964fdb2b3 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:15.309560 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d110da9-1212-4324-b6b0-1efcc24e102b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:15.311782 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d110da9-1212-4324-b6b0-1efcc24e102b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:15.332152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-1d110da9-1212-4324-b6b0-1efcc24e102b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:15.332152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:15.332152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:15.332152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:15.332152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:15.332152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:15.332152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:15.332152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:15.332152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:15.332152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:15.332152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:15.332152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:15.332152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:15.332152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:15.332152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:15.332152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:15.333324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:15.333324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:15.333324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:15.333324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:15.333324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:15.333324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:15.333324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:15.333324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:15.333324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:15.333324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:15.333324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:15.333324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:15.333324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:15.333324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:15.333324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:15.333324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:15.333324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:15.334549 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:15.334549 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:15.334549 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:15.336271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 282/550] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:15.337728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebdf8e-d944-4688-9286-ee8a1ab25228 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:15.338060 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebdf8e-d944-4688-9286-ee8a1ab25228 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:15.338389 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebdf8e-d944-4688-9286-ee8a1ab25228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:15.347577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06581e2b-f3a3-4705-99ff-38b5eaf362fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:15.348578 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06581e2b-f3a3-4705-99ff-38b5eaf362fe None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:15.349093 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06581e2b-f3a3-4705-99ff-38b5eaf362fe None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:15.349634 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06581e2b-f3a3-4705-99ff-38b5eaf362fe None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:15.350546 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06581e2b-f3a3-4705-99ff-38b5eaf362fe None admin] RBAC: Adding query filter params (name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:15.351268 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06581e2b-f3a3-4705-99ff-38b5eaf362fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:15.353596 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06581e2b-f3a3-4705-99ff-38b5eaf362fe None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:15.359071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-a3ebdf8e-d944-4688-9286-ee8a1ab25228 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:15.360447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-a3ebdf8e-d944-4688-9286-ee8a1ab25228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:15.365412 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 269/551] 10.222.0.79 () {56 vars in 1103 bytes} [Fri Sep 2 21:02:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:15.366622 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06581e2b-f3a3-4705-99ff-38b5eaf362fe None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:15.383947 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:15.452553 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:15.459133 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 283/552] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:15.460431 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebdf8e-d944-4688-9286-ee8a1ab25228 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:15.506710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06581e2b-f3a3-4705-99ff-38b5eaf362fe None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:15.560393 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4063e-bb26-4814-8de2-778bfc89289e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:15.561324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4063e-bb26-4814-8de2-778bfc89289e None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:15.561787 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4063e-bb26-4814-8de2-778bfc89289e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:15.562263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4063e-bb26-4814-8de2-778bfc89289e None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:15.563107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4063e-bb26-4814-8de2-778bfc89289e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:15.563733 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4063e-bb26-4814-8de2-778bfc89289e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:15.565313 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4063e-bb26-4814-8de2-778bfc89289e None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:15.593667 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 270/553] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:15.601137 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4063e-bb26-4814-8de2-778bfc89289e None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:15.628808 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebdf8e-d944-4688-9286-ee8a1ab25228 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:15.693941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce7717-514e-4851-a37d-db018e649cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:15.694598 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce7717-514e-4851-a37d-db018e649cf8 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:15.694874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce7717-514e-4851-a37d-db018e649cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:15.695149 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce7717-514e-4851-a37d-db018e649cf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:15.726747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce7717-514e-4851-a37d-db018e649cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:15.728509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce7717-514e-4851-a37d-db018e649cf8 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:15.750412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-80ce7717-514e-4851-a37d-db018e649cf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:15.750412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:15.750412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:15.750412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:15.750412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:15.750412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:15.750412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:15.750412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:15.750412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:15.750412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:15.750412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:15.750412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:15.750412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:15.750412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:15.750412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:15.750412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:15.752046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:15.752046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:15.752046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:15.752046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:15.752046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:15.752046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:15.752046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:15.752046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:15.752046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:15.752046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:15.752046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:15.752046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:15.752046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:15.752046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:15.752046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:15.752046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:15.752046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:15.753233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:15.753233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:15.753233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:15.756721 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 284/554] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:15.760925 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce7717-514e-4851-a37d-db018e649cf8 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:15.769008 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4063e-bb26-4814-8de2-778bfc89289e None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:15.770219 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:15.796683 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:15.807202 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bcaca-f8fc-4eb8-ac15-ebf228943146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:15.808105 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bcaca-f8fc-4eb8-ac15-ebf228943146 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:15.808548 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bcaca-f8fc-4eb8-ac15-ebf228943146 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:15.808969 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bcaca-f8fc-4eb8-ac15-ebf228943146 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:15.825961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320bcaca-f8fc-4eb8-ac15-ebf228943146 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:15.828314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320bcaca-f8fc-4eb8-ac15-ebf228943146 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:15.844965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-320bcaca-f8fc-4eb8-ac15-ebf228943146 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:02:15.844965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:15.844965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:15.844965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:15.844965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:15.844965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:15.844965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:15.844965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:15.844965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:15.844965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:15.844965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:15.844965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:15.844965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:15.844965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:15.844965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:15.844965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:15.851533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:15.851533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:15.851533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:15.851533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:15.851533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:15.851533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:15.851533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:15.851533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:15.851533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:15.851533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:15.851533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:15.851533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:15.851533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:15.851533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:15.851533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:15.851533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:15.851533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:15.851533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:15.852583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:15.852583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:15.852583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:15.852583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:15.852583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:15.852583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:15.852583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:15.852583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:15.852583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:02:15.852583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:15.852583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 271/555] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:02:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:15.852583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bcaca-f8fc-4eb8-ac15-ebf228943146 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:15.931092 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce7717-514e-4851-a37d-db018e649cf8 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:15.968847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca3f62-c04d-408e-b7b6-552ad3a2bec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:15.969530 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca3f62-c04d-408e-b7b6-552ad3a2bec0 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:15.970160 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca3f62-c04d-408e-b7b6-552ad3a2bec0 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:15.970454 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca3f62-c04d-408e-b7b6-552ad3a2bec0 None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:15.971223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca3f62-c04d-408e-b7b6-552ad3a2bec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:15.971535 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca3f62-c04d-408e-b7b6-552ad3a2bec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:15.972951 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca3f62-c04d-408e-b7b6-552ad3a2bec0 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:15.979155 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bcaca-f8fc-4eb8-ac15-ebf228943146 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:15.986864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 285/556] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:15.987859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca3f62-c04d-408e-b7b6-552ad3a2bec0 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:16.019601 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a62b20-d032-486b-8678-66344f2fb8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:16.020242 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a62b20-d032-486b-8678-66344f2fb8a6 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:16.020578 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a62b20-d032-486b-8678-66344f2fb8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:16.020854 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a62b20-d032-486b-8678-66344f2fb8a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:16.033152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a62b20-d032-486b-8678-66344f2fb8a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:16.038797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-46a62b20-d032-486b-8678-66344f2fb8a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:16.038797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:16.038797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:16.038797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:16.038797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:16.038797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:16.038797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:16.038797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:16.038797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:16.038797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:16.038797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:16.038797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:16.038797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:16.038797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:16.038797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:16.038797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:16.040074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:16.040074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:16.040074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:16.040074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:16.040074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:16.040074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:16.040074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:16.040074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:16.040074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:16.040074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:16.040074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:16.040074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:16.040074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:16.040074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:16.040074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:16.040074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:16.040984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:16.040984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:16.040984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:16.040984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:16.040984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:16.040984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:16.040984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:16.040984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:16.040984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:16.040984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:16.040984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:16.040984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:16.045119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 272/557] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:02:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:16.046067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a62b20-d032-486b-8678-66344f2fb8a6 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:16.057433 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:16.099424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:16.099865 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca3f62-c04d-408e-b7b6-552ad3a2bec0 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:16.137599 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15622c2-14bd-4ada-a287-313bac7d63f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:16.138281 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15622c2-14bd-4ada-a287-313bac7d63f0 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:16.140141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15622c2-14bd-4ada-a287-313bac7d63f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:16.140141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15622c2-14bd-4ada-a287-313bac7d63f0 None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:16.140141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15622c2-14bd-4ada-a287-313bac7d63f0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:16.140141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15622c2-14bd-4ada-a287-313bac7d63f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:16.141540 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15622c2-14bd-4ada-a287-313bac7d63f0 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:16.162372 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a62b20-d032-486b-8678-66344f2fb8a6 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:16.167706 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 286/558] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Sep 2 21:02:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:16.168948 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15622c2-14bd-4ada-a287-313bac7d63f0 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:16.200886 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99071c84-1e19-4577-b57b-03b6516b3f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:16.201524 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99071c84-1e19-4577-b57b-03b6516b3f65 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:16.201839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99071c84-1e19-4577-b57b-03b6516b3f65 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:16.202114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99071c84-1e19-4577-b57b-03b6516b3f65 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:16.211905 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99071c84-1e19-4577-b57b-03b6516b3f65 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:16.213396 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99071c84-1e19-4577-b57b-03b6516b3f65 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:16.226897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-99071c84-1e19-4577-b57b-03b6516b3f65 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:02:16.226897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:16.226897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:16.226897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:16.226897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:16.226897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:16.226897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:16.226897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:16.226897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:16.226897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:16.226897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:16.226897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:16.226897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:16.226897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:16.226897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:16.226897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:16.228152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:16.228152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:16.228152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:16.228152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:16.228152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:16.228152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:16.228152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:16.228152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:16.228152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:16.228152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:16.228152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:16.228152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:16.228152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:16.228152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:16.228152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:16.228152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:16.228152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:16.228152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:16.229074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:16.229074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:16.229074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:16.229074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:16.229074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:16.229074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:16.229074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:16.229074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:16.229074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:02:16.229074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:16.229074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 273/559] 10.222.0.79 () {56 vars in 1093 bytes} [Fri Sep 2 21:02:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:16.229728 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667446d1-d935-43d9-8942-6d659cad5109 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:16.229728 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667446d1-d935-43d9-8942-6d659cad5109 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:16.229728 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667446d1-d935-43d9-8942-6d659cad5109 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:16.231059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 274/560] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:16.238194 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667446d1-d935-43d9-8942-6d659cad5109 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:16.290777 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15622c2-14bd-4ada-a287-313bac7d63f0 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:16.317704 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:16.331447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad1409-7236-4a33-95f9-cb7814c6003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:16.332055 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad1409-7236-4a33-95f9-cb7814c6003c None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:16.332336 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad1409-7236-4a33-95f9-cb7814c6003c None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:16.334752 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad1409-7236-4a33-95f9-cb7814c6003c None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:16.334752 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad1409-7236-4a33-95f9-cb7814c6003c None admin] RBAC: Adding query filter params (name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:16.334752 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad1409-7236-4a33-95f9-cb7814c6003c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:16.335209 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad1409-7236-4a33-95f9-cb7814c6003c None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:16.349902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 287/561] 10.222.0.79 () {56 vars in 1103 bytes} [Fri Sep 2 21:02:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:16.349902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad1409-7236-4a33-95f9-cb7814c6003c None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:16.356348 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667446d1-d935-43d9-8942-6d659cad5109 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:16.358125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:16.403906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d24a0-c56d-4e73-9b9d-4a01bf50f991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:16.404635 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d24a0-c56d-4e73-9b9d-4a01bf50f991 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:16.405142 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d24a0-c56d-4e73-9b9d-4a01bf50f991 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:16.405476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d24a0-c56d-4e73-9b9d-4a01bf50f991 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:16.460829 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad1409-7236-4a33-95f9-cb7814c6003c None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:16.477163 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d24a0-c56d-4e73-9b9d-4a01bf50f991 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:16.478719 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d24a0-c56d-4e73-9b9d-4a01bf50f991 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:16.495582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3f1f8-a716-496e-bd64-acac27d1d73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:16.496185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3f1f8-a716-496e-bd64-acac27d1d73b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:16.496470 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3f1f8-a716-496e-bd64-acac27d1d73b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:16.496808 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3f1f8-a716-496e-bd64-acac27d1d73b None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:16.497472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3f1f8-a716-496e-bd64-acac27d1d73b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:16.497781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3f1f8-a716-496e-bd64-acac27d1d73b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:16.499241 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3f1f8-a716-496e-bd64-acac27d1d73b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:16.516993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 288/562] 10.222.0.79 () {56 vars in 1133 bytes} [Fri Sep 2 21:02:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:16.518445 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ce533-e99e-4f31-a86a-4366fb025244 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:16.518738 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ce533-e99e-4f31-a86a-4366fb025244 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:16.519020 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ce533-e99e-4f31-a86a-4366fb025244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:16.537196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-616ce533-e99e-4f31-a86a-4366fb025244 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:16.538422 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-616ce533-e99e-4f31-a86a-4366fb025244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:16.574186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:16.582048 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 275/563] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:02:16.582905 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d24a0-c56d-4e73-9b9d-4a01bf50f991 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:16.585210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:16.608560 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 289/564] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:16.609959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcb3c4-67e4-4a94-a56b-fceb678928c6 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:16.610404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcb3c4-67e4-4a94-a56b-fceb678928c6 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:16.610842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcb3c4-67e4-4a94-a56b-fceb678928c6 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:16.612807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 290/565] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:16.613583 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcb3c4-67e4-4a94-a56b-fceb678928c6 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:16.703666 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d24a0-c56d-4e73-9b9d-4a01bf50f991 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:16.742681 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c4edd-acf5-422f-a109-e2834a1b4fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:16.743318 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c4edd-acf5-422f-a109-e2834a1b4fac None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:16.743592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c4edd-acf5-422f-a109-e2834a1b4fac None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:16.744125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c4edd-acf5-422f-a109-e2834a1b4fac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:16.747962 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcb3c4-67e4-4a94-a56b-fceb678928c6 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:16.755216 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c4edd-acf5-422f-a109-e2834a1b4fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:16.756684 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c4edd-acf5-422f-a109-e2834a1b4fac None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:16.772906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-e33c4edd-acf5-422f-a109-e2834a1b4fac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:16.772906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:16.772906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:16.772906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:16.772906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:16.772906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:16.772906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:16.772906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:16.772906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:16.772906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:16.772906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:16.772906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:16.772906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:16.772906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:16.772906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:16.772906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:16.780132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:16.780132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:16.780132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:16.780132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:16.780132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:16.780132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:16.780132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:16.780132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:16.780132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:16.780132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:16.780132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:16.780132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:16.780132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:16.780132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:16.780132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:16.780132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:16.780132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:16.781278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:16.781278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:16.781278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:16.781278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 276/566] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:16.781278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c4edd-acf5-422f-a109-e2834a1b4fac None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:16.795847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a22341-05e8-4bd6-a5e4-b04ae5197e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:16.796549 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a22341-05e8-4bd6-a5e4-b04ae5197e6f None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:16.796838 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a22341-05e8-4bd6-a5e4-b04ae5197e6f None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:16.797115 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a22341-05e8-4bd6-a5e4-b04ae5197e6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:16.808698 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a22341-05e8-4bd6-a5e4-b04ae5197e6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:16.810202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a22341-05e8-4bd6-a5e4-b04ae5197e6f None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:16.828298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-43a22341-05e8-4bd6-a5e4-b04ae5197e6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:16.828298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:16.828298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:16.828298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:16.828298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:16.828298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:16.828298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:16.828298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:16.828298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:16.828298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:16.828298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:16.828298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:16.828298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:16.828298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:16.828298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:16.828298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:16.829747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:16.829747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:16.829747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:16.829747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:16.829747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:16.829747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:16.829747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:16.829747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:16.829747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:16.829747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:16.829747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:16.829747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:16.829747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:16.829747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:16.829747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:16.829747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:16.829747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:16.830861 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:16.830861 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:16.830861 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:16.830861 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 291/567] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:16.831106 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e64c7b-84ab-4463-80a1-c1f619289e7d None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:16.831641 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e64c7b-84ab-4463-80a1-c1f619289e7d None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:16.831641 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e64c7b-84ab-4463-80a1-c1f619289e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:16.842401 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:16.850912 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-63e64c7b-84ab-4463-80a1-c1f619289e7d None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:16.852069 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-63e64c7b-84ab-4463-80a1-c1f619289e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:16.871658 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:16.892029 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c4edd-acf5-422f-a109-e2834a1b4fac None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:16.925167 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 292/568] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:16.934079 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e64c7b-84ab-4463-80a1-c1f619289e7d None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:16.934178 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64658c-611b-43d4-b694-4064e17406f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:16.934178 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64658c-611b-43d4-b694-4064e17406f0 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:16.934178 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64658c-611b-43d4-b694-4064e17406f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:16.934178 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64658c-611b-43d4-b694-4064e17406f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:16.944063 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f64658c-611b-43d4-b694-4064e17406f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:16.945511 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f64658c-611b-43d4-b694-4064e17406f0 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:16.961447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-1f64658c-611b-43d4-b694-4064e17406f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:16.961447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:16.961447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:16.961447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:16.961447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:16.961447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:16.961447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:16.961447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:16.961447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:16.961447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:16.961447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:16.961447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:16.961447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:16.961447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:16.961447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:16.961447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:16.962612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:16.962612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:16.962612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:16.962612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:16.962612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:16.962612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:16.962612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:16.962612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:16.962612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:16.962612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:16.962612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:16.962612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:16.962612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:16.962612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:16.962612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:16.962612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:16.962612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:16.963494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:16.963494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:16.963494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:16.963494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 277/569] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:16.963494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64658c-611b-43d4-b694-4064e17406f0 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:17.047175 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e64c7b-84ab-4463-80a1-c1f619289e7d None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:17.080920 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64658c-611b-43d4-b694-4064e17406f0 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:17.085703 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a69618-70a5-489f-99bd-af78963d3659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:17.086350 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a69618-70a5-489f-99bd-af78963d3659 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:17.086645 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a69618-70a5-489f-99bd-af78963d3659 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:17.086891 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a69618-70a5-489f-99bd-af78963d3659 None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:17.087538 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a69618-70a5-489f-99bd-af78963d3659 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:17.087842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a69618-70a5-489f-99bd-af78963d3659 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:17.088416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:17.089968 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a69618-70a5-489f-99bd-af78963d3659 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:17.103896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 293/570] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:17.104720 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a69618-70a5-489f-99bd-af78963d3659 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:17.121844 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:17.127318 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab0590-21eb-4822-8206-5e556c2193ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:17.127932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab0590-21eb-4822-8206-5e556c2193ac None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:17.128216 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab0590-21eb-4822-8206-5e556c2193ac None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:17.128495 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab0590-21eb-4822-8206-5e556c2193ac None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:17.129326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab0590-21eb-4822-8206-5e556c2193ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:17.129440 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab0590-21eb-4822-8206-5e556c2193ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:17.131000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab0590-21eb-4822-8206-5e556c2193ac None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:17.144550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 278/571] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:17.145431 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab0590-21eb-4822-8206-5e556c2193ac None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:17.221188 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a69618-70a5-489f-99bd-af78963d3659 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:17.249305 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab0590-21eb-4822-8206-5e556c2193ac None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:17.256366 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b099226-094c-4786-bc5f-a047b6e25e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:17.257036 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b099226-094c-4786-bc5f-a047b6e25e98 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:17.257285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b099226-094c-4786-bc5f-a047b6e25e98 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:17.257563 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b099226-094c-4786-bc5f-a047b6e25e98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:17.268522 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b099226-094c-4786-bc5f-a047b6e25e98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:17.275214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-0b099226-094c-4786-bc5f-a047b6e25e98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:17.275214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:17.275214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:17.275214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:17.275214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:17.275214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:17.275214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:17.275214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:17.275214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:17.275214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:17.275214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:17.275214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:17.275214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:17.275214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:17.275214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:17.275214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:17.276218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:17.276218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:17.276218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:17.276218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:17.276218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:17.276218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:17.276218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:17.276218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:17.276218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:17.276218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:17.276218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:17.276218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:17.276218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:17.276218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:17.276218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:17.276218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:17.277123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:17.277123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:17.277123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:17.277123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:17.277123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:17.277123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:17.277123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:17.277123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:17.277123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:17.277123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:17.277123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:17.277123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:17.277123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 294/572] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:02:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:17.277828 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b099226-094c-4786-bc5f-a047b6e25e98 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:17.289012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fc740-c9f5-4e62-820f-a099e8fa192f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:17.289620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fc740-c9f5-4e62-820f-a099e8fa192f None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:17.289950 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fc740-c9f5-4e62-820f-a099e8fa192f None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:17.290228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fc740-c9f5-4e62-820f-a099e8fa192f None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:17.290880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fc740-c9f5-4e62-820f-a099e8fa192f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:17.291216 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fc740-c9f5-4e62-820f-a099e8fa192f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:17.292600 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fc740-c9f5-4e62-820f-a099e8fa192f None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:17.306089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 279/573] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:17.306932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fc740-c9f5-4e62-820f-a099e8fa192f None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:17.335170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:17.369032 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:17.400491 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b099226-094c-4786-bc5f-a047b6e25e98 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:17.430944 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fc740-c9f5-4e62-820f-a099e8fa192f None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:17.440090 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca3ee0-defc-42d7-b504-e3830a03a9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:17.440733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca3ee0-defc-42d7-b504-e3830a03a9ce None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:17.441020 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca3ee0-defc-42d7-b504-e3830a03a9ce None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:17.441533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca3ee0-defc-42d7-b504-e3830a03a9ce None admin] PATH_INFO: `/v3/users/glance` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:17.449142 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca3ee0-defc-42d7-b504-e3830a03a9ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:17.450643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca3ee0-defc-42d7-b504-e3830a03a9ce None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:17.462868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-3cca3ee0-defc-42d7-b504-e3830a03a9ce None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 02 21:02:17.462868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:17.462868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:17.462868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:17.462868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:17.462868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:17.462868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:17.462868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:17.462868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:17.462868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:17.462868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:17.462868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:17.462868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:17.462868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:17.462868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:17.462868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:17.463895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:17.463895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:17.463895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:17.463895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:17.463895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:17.463895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:17.463895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:17.463895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:17.463895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:17.463895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:17.463895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:17.463895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:17.463895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:17.463895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:17.463895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:17.463895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:17.463895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:17.463895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:17.464835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:17.464835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:17.464835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:17.464835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:17.464835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:17.464835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:17.464835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:17.464835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:17.464835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 02 21:02:17.464835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:17.464835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 295/574] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:02:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:17.464835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca3ee0-defc-42d7-b504-e3830a03a9ce None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:17.471610 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf72094-5d9b-41b7-a461-ecdb6b74277d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:17.472258 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf72094-5d9b-41b7-a461-ecdb6b74277d None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:17.472541 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf72094-5d9b-41b7-a461-ecdb6b74277d None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:17.472815 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf72094-5d9b-41b7-a461-ecdb6b74277d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:17.480098 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf72094-5d9b-41b7-a461-ecdb6b74277d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:17.481557 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf72094-5d9b-41b7-a461-ecdb6b74277d None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:17.493330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-6bf72094-5d9b-41b7-a461-ecdb6b74277d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:17.493330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:17.493330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:17.493330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:17.493330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:17.493330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:17.493330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:17.493330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:17.493330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:17.493330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:17.493330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:17.493330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:17.493330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:17.493330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:17.493330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:17.494339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:17.494339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:17.494339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:17.494339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:17.494339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:17.494339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:17.494339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:17.494339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:17.494339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:17.494339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:17.494339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:17.494339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:17.494339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:17.494339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:17.494339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:17.494339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:17.494339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:17.495476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:17.495476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:17.495476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:17.495476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:17.495476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:17.495476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:17.495476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:17.495476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:17.495476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 280/575] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:17.495476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf72094-5d9b-41b7-a461-ecdb6b74277d None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:17.578972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca3ee0-defc-42d7-b504-e3830a03a9ce None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:17.584752 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:17.599485 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf72094-5d9b-41b7-a461-ecdb6b74277d None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:17.614417 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdfad7-f687-4e97-a008-0683f8651c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:17.615052 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdfad7-f687-4e97-a008-0683f8651c1d None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:17.615381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdfad7-f687-4e97-a008-0683f8651c1d None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:17.615610 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdfad7-f687-4e97-a008-0683f8651c1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:17.617485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:17.626160 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fdfad7-f687-4e97-a008-0683f8651c1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:17.631399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-24fdfad7-f687-4e97-a008-0683f8651c1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:17.631399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:17.631399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:17.631399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:17.631399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:17.631399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:17.631399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:17.631399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:17.631399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:17.631399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:17.631399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:17.631399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:17.631399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:17.631399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:17.631399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:17.631399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:17.632367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:17.632367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:17.632367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:17.632367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:17.632367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:17.632367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:17.632367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:17.632367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:17.632367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:17.632367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:17.632367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:17.632367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:17.632367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:17.632367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:17.632367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:17.632367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:17.634071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:17.634071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:17.634071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:17.634071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:17.634071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:17.634071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:17.634071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:17.634071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:17.634071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:17.634071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:17.634071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:17.634071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:17.634071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 296/576] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:02:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:17.634071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdfad7-f687-4e97-a008-0683f8651c1d None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:17.635644 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76d6b4-f62d-4b17-a0c0-ca638c7258eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:17.636225 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76d6b4-f62d-4b17-a0c0-ca638c7258eb None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:17.636711 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76d6b4-f62d-4b17-a0c0-ca638c7258eb None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:17.636990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76d6b4-f62d-4b17-a0c0-ca638c7258eb None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:17.638425 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76d6b4-f62d-4b17-a0c0-ca638c7258eb None admin] RBAC: Adding query filter params (name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:17.638835 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76d6b4-f62d-4b17-a0c0-ca638c7258eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:17.640899 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76d6b4-f62d-4b17-a0c0-ca638c7258eb None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:17.650356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 281/577] 10.222.0.79 () {56 vars in 1103 bytes} [Fri Sep 2 21:02:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:17.655664 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76d6b4-f62d-4b17-a0c0-ca638c7258eb None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:17.752857 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdfad7-f687-4e97-a008-0683f8651c1d None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:17.762098 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76d6b4-f62d-4b17-a0c0-ca638c7258eb None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:17.788804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea7c0d-080c-4bbf-932a-6c9b731048eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:17.789434 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea7c0d-080c-4bbf-932a-6c9b731048eb None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:17.789711 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea7c0d-080c-4bbf-932a-6c9b731048eb None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:17.790011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea7c0d-080c-4bbf-932a-6c9b731048eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:17.796569 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea7c0d-080c-4bbf-932a-6c9b731048eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:17.796999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc981ac-d018-49e0-a570-bdeacdb5a6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:17.797614 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc981ac-d018-49e0-a570-bdeacdb5a6ef None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:17.798041 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc981ac-d018-49e0-a570-bdeacdb5a6ef None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:17.798151 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea7c0d-080c-4bbf-932a-6c9b731048eb None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:17.798457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc981ac-d018-49e0-a570-bdeacdb5a6ef None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:17.799186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc981ac-d018-49e0-a570-bdeacdb5a6ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:17.799598 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc981ac-d018-49e0-a570-bdeacdb5a6ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:17.800904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc981ac-d018-49e0-a570-bdeacdb5a6ef None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:17.809512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-8cea7c0d-080c-4bbf-932a-6c9b731048eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:17.809512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:17.809512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:17.809512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:17.809512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:17.809512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:17.809512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:17.809512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:17.809512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:17.809512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:17.809512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:17.809512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:17.809512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:17.809512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:17.809512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:17.810617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:17.810617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:17.810617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:17.810617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:17.810617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:17.810617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:17.810617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:17.810617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:17.810617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:17.810617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:17.810617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:17.810617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:17.810617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:17.810617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:17.810617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:17.810617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:17.810617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:17.811696 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:17.811696 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:17.811696 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:17.811696 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:17.811696 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:17.811696 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:17.811696 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:17.811696 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:17.813990 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 297/578] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:17.814913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea7c0d-080c-4bbf-932a-6c9b731048eb None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:17.822242 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 282/579] 10.222.0.79 () {56 vars in 1137 bytes} [Fri Sep 2 21:02:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:17.823310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc981ac-d018-49e0-a570-bdeacdb5a6ef None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:17.833335 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:17.878202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:17.932816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea7c0d-080c-4bbf-932a-6c9b731048eb None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:17.942965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc981ac-d018-49e0-a570-bdeacdb5a6ef None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:17.969793 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6a466-26f7-4b44-9ebb-b839279ef18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:17.970441 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6a466-26f7-4b44-9ebb-b839279ef18e None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:17.970720 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6a466-26f7-4b44-9ebb-b839279ef18e None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:17.971000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6a466-26f7-4b44-9ebb-b839279ef18e None admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:17.971749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6a466-26f7-4b44-9ebb-b839279ef18e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:17.972056 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6a466-26f7-4b44-9ebb-b839279ef18e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:17.973599 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6a466-26f7-4b44-9ebb-b839279ef18e None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:17.978496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dd92a-69b7-4971-98bf-62b34c120b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:17.979114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dd92a-69b7-4971-98bf-62b34c120b8b None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:17.979396 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dd92a-69b7-4971-98bf-62b34c120b8b None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:17.979675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dd92a-69b7-4971-98bf-62b34c120b8b None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:17.980342 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131dd92a-69b7-4971-98bf-62b34c120b8b None admin] RBAC: Adding query filter params (name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:17.980649 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131dd92a-69b7-4971-98bf-62b34c120b8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:17.982137 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131dd92a-69b7-4971-98bf-62b34c120b8b None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:17.987133 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 298/580] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:17.987984 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6a466-26f7-4b44-9ebb-b839279ef18e None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:18.002668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 283/581] 10.222.0.79 () {56 vars in 1103 bytes} [Fri Sep 2 21:02:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:18.004409 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dd92a-69b7-4971-98bf-62b34c120b8b None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:18.088336 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:18.099839 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6a466-26f7-4b44-9ebb-b839279ef18e None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:18.115125 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:18.123780 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dd92a-69b7-4971-98bf-62b34c120b8b None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:18.134634 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0b58d-9092-4e2a-9953-73ffc347387f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:18.135265 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0b58d-9092-4e2a-9953-73ffc347387f None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:18.135555 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0b58d-9092-4e2a-9953-73ffc347387f None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:18.135833 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0b58d-9092-4e2a-9953-73ffc347387f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:18.145950 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0b58d-9092-4e2a-9953-73ffc347387f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:18.147367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0b58d-9092-4e2a-9953-73ffc347387f None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:18.158113 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584b25f-8a81-483d-b5f4-5fed2290f507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:18.158718 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584b25f-8a81-483d-b5f4-5fed2290f507 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:18.158996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584b25f-8a81-483d-b5f4-5fed2290f507 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:18.159270 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584b25f-8a81-483d-b5f4-5fed2290f507 None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:18.159961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584b25f-8a81-483d-b5f4-5fed2290f507 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:18.160267 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584b25f-8a81-483d-b5f4-5fed2290f507 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:18.161673 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584b25f-8a81-483d-b5f4-5fed2290f507 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:18.163064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-35f0b58d-9092-4e2a-9953-73ffc347387f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:18.163064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:18.163064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:18.163064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:18.163064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:18.163064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:18.163064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:18.163064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:18.163064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:18.163064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:18.163064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:18.163064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:18.163064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:18.163064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:18.163064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:18.163064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:18.164296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:18.164296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:18.164296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:18.164296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:18.164296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:18.164296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:18.164296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:18.164296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:18.164296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:18.164296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:18.164296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:18.164296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:18.164296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:18.164296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:18.164296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:18.164296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:18.164296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:18.165185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:18.165185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:18.165185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:18.165185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 299/582] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:18.165488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0b58d-9092-4e2a-9953-73ffc347387f None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:18.179994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 284/583] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:18.180811 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584b25f-8a81-483d-b5f4-5fed2290f507 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:18.271293 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0b58d-9092-4e2a-9953-73ffc347387f None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:18.288183 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584b25f-8a81-483d-b5f4-5fed2290f507 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:18.305061 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d155ff7-08f8-4c2a-a8ba-62a95b4c20c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:18.305687 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d155ff7-08f8-4c2a-a8ba-62a95b4c20c6 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:18.305997 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d155ff7-08f8-4c2a-a8ba-62a95b4c20c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:18.306283 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d155ff7-08f8-4c2a-a8ba-62a95b4c20c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:18.315762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:18.317401 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d155ff7-08f8-4c2a-a8ba-62a95b4c20c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:18.318884 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d155ff7-08f8-4c2a-a8ba-62a95b4c20c6 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:18.323331 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01af0b7-3be1-4fe3-bcd1-2e74dc75329e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:18.323986 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01af0b7-3be1-4fe3-bcd1-2e74dc75329e None admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:18.324271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01af0b7-3be1-4fe3-bcd1-2e74dc75329e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:18.324663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01af0b7-3be1-4fe3-bcd1-2e74dc75329e None admin] PATH_INFO: `/v3/projects/61c5f56764934c4a90ad38357b46f397/users/632071470f7d409ab7b0129d120320c7/roles/1c1ddcbda0754702bb016952e90405ca` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:18.333593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-9d155ff7-08f8-4c2a-a8ba-62a95b4c20c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:18.333593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:18.333593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:18.333593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:18.333593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:18.333593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:18.333593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:18.333593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:18.333593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:18.333593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:18.333593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:18.333593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:18.333593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:18.333593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:18.333593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:18.333593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:18.334643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:18.334643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:18.334643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:18.334643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:18.334643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:18.334643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:18.334643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:18.334643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:18.334643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:18.334643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:18.334643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:18.334643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:18.334643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:18.334643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:18.334643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:18.334643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:18.334643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:18.335535 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:18.335535 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:18.335535 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:18.335535 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 300/584] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:18.335802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d155ff7-08f8-4c2a-a8ba-62a95b4c20c6 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:18.342125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01af0b7-3be1-4fe3-bcd1-2e74dc75329e None admin] RBAC: Authorizing `identity:create_grant(project_id=61c5f56764934c4a90ad38357b46f397, user_id=632071470f7d409ab7b0129d120320c7, role_id=1c1ddcbda0754702bb016952e90405ca)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:18.343577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01af0b7-3be1-4fe3-bcd1-2e74dc75329e None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:18.359512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:18.443549 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d155ff7-08f8-4c2a-a8ba-62a95b4c20c6 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:18.456249 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 285/585] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:02:18 2022] PUT /identity/v3/projects/61c5f56764934c4a90ad38357b46f397/users/632071470f7d409ab7b0129d120320c7/roles/1c1ddcbda0754702bb016952e90405ca => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:02:18.457071 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01af0b7-3be1-4fe3-bcd1-2e74dc75329e None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:18.483575 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88651b-6b59-4916-8710-72fcc5d964c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:18.484232 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88651b-6b59-4916-8710-72fcc5d964c7 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:18.484805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88651b-6b59-4916-8710-72fcc5d964c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:18.485284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88651b-6b59-4916-8710-72fcc5d964c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:18.502449 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88651b-6b59-4916-8710-72fcc5d964c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:18.504177 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88651b-6b59-4916-8710-72fcc5d964c7 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:18.524976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-eb88651b-6b59-4916-8710-72fcc5d964c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:18.524976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:18.524976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:18.524976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:18.524976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:18.524976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:18.524976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:18.524976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:18.524976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:18.524976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:18.524976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:18.524976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:18.524976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:18.524976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:18.524976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:18.524976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:18.526057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:18.526057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:18.526057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:18.526057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:18.526057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:18.526057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:18.526057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:18.526057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:18.526057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:18.526057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:18.526057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:18.526057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:18.526057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:18.526057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:18.526057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:18.526057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:18.526057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:18.526983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:18.526983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:18.526983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:18.526983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 301/586] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:18.526983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88651b-6b59-4916-8710-72fcc5d964c7 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:18.591237 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01af0b7-3be1-4fe3-bcd1-2e74dc75329e None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:18.610863 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:18.635650 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490ba7d-36d8-4b28-92db-947c89a3f7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:18.636308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490ba7d-36d8-4b28-92db-947c89a3f7b9 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:18.636588 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490ba7d-36d8-4b28-92db-947c89a3f7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:18.636862 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490ba7d-36d8-4b28-92db-947c89a3f7b9 None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:18.637511 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490ba7d-36d8-4b28-92db-947c89a3f7b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:18.637848 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490ba7d-36d8-4b28-92db-947c89a3f7b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:18.639369 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490ba7d-36d8-4b28-92db-947c89a3f7b9 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:18.645256 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88651b-6b59-4916-8710-72fcc5d964c7 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:18.652326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 286/587] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:18.653171 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490ba7d-36d8-4b28-92db-947c89a3f7b9 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:18.691741 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b75d70-6207-4c76-9e9c-37121fe5f07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:18.692106 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b75d70-6207-4c76-9e9c-37121fe5f07a None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:18.692433 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b75d70-6207-4c76-9e9c-37121fe5f07a None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:18.692724 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b75d70-6207-4c76-9e9c-37121fe5f07a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:18.693611 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b75d70-6207-4c76-9e9c-37121fe5f07a None admin] RBAC: Adding query filter params (role.id=1c1ddcbda0754702bb016952e90405ca, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=3da2b1dc9dae413a8ee63ad67e840f8c) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:18.693832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b75d70-6207-4c76-9e9c-37121fe5f07a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:18.695276 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b75d70-6207-4c76-9e9c-37121fe5f07a None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:18.701193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 302/588] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:18 2022] GET /identity/v3/role_assignments?user.id=3da2b1dc9dae413a8ee63ad67e840f8c&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=1c1ddcbda0754702bb016952e90405ca => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:18.702203 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:18.707175 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b75d70-6207-4c76-9e9c-37121fe5f07a None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:18.806391 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490ba7d-36d8-4b28-92db-947c89a3f7b9 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:18.851849 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b75d70-6207-4c76-9e9c-37121fe5f07a None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:18.857299 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90470aa7-9675-4950-8416-ba181302e1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:18.858190 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90470aa7-9675-4950-8416-ba181302e1b5 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:18.858620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90470aa7-9675-4950-8416-ba181302e1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:18.859053 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90470aa7-9675-4950-8416-ba181302e1b5 None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:18.859715 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90470aa7-9675-4950-8416-ba181302e1b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:18.860016 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90470aa7-9675-4950-8416-ba181302e1b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:18.862791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90470aa7-9675-4950-8416-ba181302e1b5 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:18.877791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 287/589] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:18.879200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90470aa7-9675-4950-8416-ba181302e1b5 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:18.903103 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f3ade-2ef8-4b4f-8529-7df048001f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:18.904036 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f3ade-2ef8-4b4f-8529-7df048001f1a None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:18.904334 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f3ade-2ef8-4b4f-8529-7df048001f1a None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:18.905011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f3ade-2ef8-4b4f-8529-7df048001f1a None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:18.905687 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f3ade-2ef8-4b4f-8529-7df048001f1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:18.906029 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f3ade-2ef8-4b4f-8529-7df048001f1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:18.907978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f3ade-2ef8-4b4f-8529-7df048001f1a None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:18.910649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:18.927609 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 303/590] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:18.928715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f3ade-2ef8-4b4f-8529-7df048001f1a None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:18.996454 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:19.000800 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90470aa7-9675-4950-8416-ba181302e1b5 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:19.041043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c155e0-26eb-45df-bc6a-0370037b4f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:19.042411 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c155e0-26eb-45df-bc6a-0370037b4f08 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:19.043128 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c155e0-26eb-45df-bc6a-0370037b4f08 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:19.043560 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c155e0-26eb-45df-bc6a-0370037b4f08 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:19.054739 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c155e0-26eb-45df-bc6a-0370037b4f08 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:19.057221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c155e0-26eb-45df-bc6a-0370037b4f08 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:19.066919 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f3ade-2ef8-4b4f-8529-7df048001f1a None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:19.073871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-15c155e0-26eb-45df-bc6a-0370037b4f08 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 21:02:19.073871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:19.073871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:19.073871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:19.073871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:19.073871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:19.073871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:19.073871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:19.073871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:19.073871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:19.073871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:19.073871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:19.073871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:19.073871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:19.073871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:19.073871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:19.074903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:19.074903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:19.074903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:19.074903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:19.074903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:19.074903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:19.074903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:19.074903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:19.074903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:19.074903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:19.074903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:19.074903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:19.074903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:19.074903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:19.074903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:19.074903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:19.074903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:19.074903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:19.075843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:19.075843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:19.075843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:19.075843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:19.075843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:19.075843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:19.075843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:19.075843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:19.075843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 21:02:19.075843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:19.075843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 288/591] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:02:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:19.081341 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c155e0-26eb-45df-bc6a-0370037b4f08 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:19.115381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb386ad8-7d0f-4972-8b85-21b058653f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:19.116940 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb386ad8-7d0f-4972-8b85-21b058653f56 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:19.117506 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb386ad8-7d0f-4972-8b85-21b058653f56 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:19.118062 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb386ad8-7d0f-4972-8b85-21b058653f56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:19.127434 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb386ad8-7d0f-4972-8b85-21b058653f56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:19.128909 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb386ad8-7d0f-4972-8b85-21b058653f56 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:19.143014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-fb386ad8-7d0f-4972-8b85-21b058653f56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:19.143014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:19.143014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:19.143014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:19.143014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:19.143014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:19.143014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:19.143014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:19.143014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:19.143014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:19.143014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:19.143014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:19.143014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:19.143014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:19.143014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:19.144118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:19.144118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:19.144118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:19.144118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:19.144118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:19.144118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:19.144118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:19.144118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:19.144118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:19.144118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:19.144118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:19.144118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:19.144118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:19.144118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:19.144118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:19.144118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:19.144118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:19.145086 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:19.145086 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:19.145086 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:19.145086 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:19.145086 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:19.145086 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:19.145086 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:19.145086 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:19.145086 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 304/592] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:19.145086 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb386ad8-7d0f-4972-8b85-21b058653f56 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:19.201486 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c155e0-26eb-45df-bc6a-0370037b4f08 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:19.226853 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:19.247821 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159585b6-e3f7-43a2-ac2d-ff75f1b54a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:19.248494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159585b6-e3f7-43a2-ac2d-ff75f1b54a62 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:19.248772 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159585b6-e3f7-43a2-ac2d-ff75f1b54a62 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:19.249045 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159585b6-e3f7-43a2-ac2d-ff75f1b54a62 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:19.259756 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159585b6-e3f7-43a2-ac2d-ff75f1b54a62 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:19.262088 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159585b6-e3f7-43a2-ac2d-ff75f1b54a62 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:19.280804 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-159585b6-e3f7-43a2-ac2d-ff75f1b54a62 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 21:02:19.280804 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:19.280804 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:19.280804 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:19.280804 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:19.280804 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:19.280804 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:19.280804 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:19.280804 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:19.280804 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:19.280804 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:19.280804 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:19.280804 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:19.280804 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:19.280804 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:19.280804 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:19.282180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:19.282180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:19.282180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:19.282180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:19.282180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:19.282180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:19.282180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:19.282180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:19.282180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:19.282180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:19.282180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:19.282180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:19.282180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:19.282180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:19.282180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:19.282180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:19.282180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:19.282180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:19.283232 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:19.283232 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:19.283232 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:19.283232 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:19.283232 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:19.283232 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:19.283232 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:19.283232 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:19.283232 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 21:02:19.283232 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:19.283232 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 289/593] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:02:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:19.284266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159585b6-e3f7-43a2-ac2d-ff75f1b54a62 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:19.286253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb386ad8-7d0f-4972-8b85-21b058653f56 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:19.314206 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:19.344012 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8e406-8ff8-4287-a870-7f4fa25f7fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:19.344906 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8e406-8ff8-4287-a870-7f4fa25f7fc6 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:19.345207 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8e406-8ff8-4287-a870-7f4fa25f7fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:19.345458 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8e406-8ff8-4287-a870-7f4fa25f7fc6 None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:19.346606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8e406-8ff8-4287-a870-7f4fa25f7fc6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:19.347426 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8e406-8ff8-4287-a870-7f4fa25f7fc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:19.349462 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8e406-8ff8-4287-a870-7f4fa25f7fc6 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:19.373937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 305/594] 10.222.0.79 () {56 vars in 1137 bytes} [Fri Sep 2 21:02:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:19.374893 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8e406-8ff8-4287-a870-7f4fa25f7fc6 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:19.412127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159585b6-e3f7-43a2-ac2d-ff75f1b54a62 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:19.450131 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4a3b9-9ea2-487f-8ce5-585f23138bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:19.451251 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4a3b9-9ea2-487f-8ce5-585f23138bc5 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:19.451759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4a3b9-9ea2-487f-8ce5-585f23138bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:19.452299 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4a3b9-9ea2-487f-8ce5-585f23138bc5 None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:19.453330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4a3b9-9ea2-487f-8ce5-585f23138bc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:19.454663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4a3b9-9ea2-487f-8ce5-585f23138bc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:19.456316 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4a3b9-9ea2-487f-8ce5-585f23138bc5 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:19.469717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 290/595] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:19.471535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4a3b9-9ea2-487f-8ce5-585f23138bc5 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:19.490113 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8e406-8ff8-4287-a870-7f4fa25f7fc6 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:19.504520 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:19.527777 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73442f1d-3fef-4c34-9aa5-1bfaec62df1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:19.528690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73442f1d-3fef-4c34-9aa5-1bfaec62df1a None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:19.529118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73442f1d-3fef-4c34-9aa5-1bfaec62df1a None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:19.529563 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73442f1d-3fef-4c34-9aa5-1bfaec62df1a None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:19.530624 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73442f1d-3fef-4c34-9aa5-1bfaec62df1a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:19.531150 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73442f1d-3fef-4c34-9aa5-1bfaec62df1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:19.533427 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73442f1d-3fef-4c34-9aa5-1bfaec62df1a None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:19.552584 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 306/596] 10.222.0.79 () {56 vars in 1139 bytes} [Fri Sep 2 21:02:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:19.553875 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73442f1d-3fef-4c34-9aa5-1bfaec62df1a None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:19.558140 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:19.583800 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4a3b9-9ea2-487f-8ce5-585f23138bc5 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:19.620856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d192e2-14af-4662-94bd-2e75590615c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:19.621927 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d192e2-14af-4662-94bd-2e75590615c2 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:19.622441 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d192e2-14af-4662-94bd-2e75590615c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:19.622920 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d192e2-14af-4662-94bd-2e75590615c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:19.635453 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d192e2-14af-4662-94bd-2e75590615c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:19.637251 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d192e2-14af-4662-94bd-2e75590615c2 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:19.654819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-85d192e2-14af-4662-94bd-2e75590615c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:19.654819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:19.654819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:19.654819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:19.654819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:19.654819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:19.654819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:19.654819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:19.654819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:19.654819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:19.654819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:19.654819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:19.654819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:19.654819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:19.654819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:19.654819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:19.655850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:19.655850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:19.655850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:19.655850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:19.655850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:19.655850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:19.655850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:19.655850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:19.655850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:19.655850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:19.655850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:19.655850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:19.655850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:19.655850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:19.655850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:19.655850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:19.655850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:19.656735 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:19.656735 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:19.656735 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:19.658896 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 291/597] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:19.659905 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d192e2-14af-4662-94bd-2e75590615c2 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:19.671896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73442f1d-3fef-4c34-9aa5-1bfaec62df1a None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:19.709831 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283e758-f990-4503-a8e4-1ac53c131b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:19.710501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283e758-f990-4503-a8e4-1ac53c131b34 None admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:19.710782 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283e758-f990-4503-a8e4-1ac53c131b34 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:19.711088 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283e758-f990-4503-a8e4-1ac53c131b34 None admin] PATH_INFO: `/v3/projects/61c5f56764934c4a90ad38357b46f397/users/72840602ec264a74855b601c8d1ddf89/roles/1c1ddcbda0754702bb016952e90405ca` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:19.728620 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283e758-f990-4503-a8e4-1ac53c131b34 None admin] RBAC: Authorizing `identity:create_grant(project_id=61c5f56764934c4a90ad38357b46f397, user_id=72840602ec264a74855b601c8d1ddf89, role_id=1c1ddcbda0754702bb016952e90405ca)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:19.730300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283e758-f990-4503-a8e4-1ac53c131b34 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:19.785332 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d192e2-14af-4662-94bd-2e75590615c2 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:19.801244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 307/598] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:02:19 2022] PUT /identity/v3/projects/61c5f56764934c4a90ad38357b46f397/users/72840602ec264a74855b601c8d1ddf89/roles/1c1ddcbda0754702bb016952e90405ca => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:02:19.803040 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283e758-f990-4503-a8e4-1ac53c131b34 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:19.823191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:19.831210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cc413-51b6-4f81-8350-65edff183328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:19.831882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cc413-51b6-4f81-8350-65edff183328 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:19.832169 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cc413-51b6-4f81-8350-65edff183328 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:19.832476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cc413-51b6-4f81-8350-65edff183328 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:19.839540 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:19.849919 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1cc413-51b6-4f81-8350-65edff183328 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:19.852255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1cc413-51b6-4f81-8350-65edff183328 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:19.877200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-cd1cc413-51b6-4f81-8350-65edff183328 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:19.877200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:19.877200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:19.877200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:19.877200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:19.877200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:19.877200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:19.877200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:19.877200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:19.877200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:19.877200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:19.877200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:19.877200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:19.877200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:19.877200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:19.877200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:19.878287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:19.878287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:19.878287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:19.878287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:19.878287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:19.878287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:19.878287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:19.878287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:19.878287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:19.878287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:19.878287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:19.878287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:19.878287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:19.878287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:19.878287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:19.878287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:19.878287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:19.879156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:19.879156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:19.879156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:19.879156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 292/599] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:19.887344 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cc413-51b6-4f81-8350-65edff183328 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:19.957246 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283e758-f990-4503-a8e4-1ac53c131b34 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:20.003877 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f2eee-2a5d-4468-95e2-202ed07915ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:20.004881 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f2eee-2a5d-4468-95e2-202ed07915ec None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:20.005395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f2eee-2a5d-4468-95e2-202ed07915ec None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:20.005906 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f2eee-2a5d-4468-95e2-202ed07915ec None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:20.006922 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f2eee-2a5d-4468-95e2-202ed07915ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:20.007437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f2eee-2a5d-4468-95e2-202ed07915ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:20.009368 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f2eee-2a5d-4468-95e2-202ed07915ec None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:20.026005 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 308/600] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:20.036876 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f2eee-2a5d-4468-95e2-202ed07915ec None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:20.081114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cc413-51b6-4f81-8350-65edff183328 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:20.122179 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7e942-9b23-4a9a-952f-ec63b1449069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:20.122714 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7e942-9b23-4a9a-952f-ec63b1449069 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:20.122993 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7e942-9b23-4a9a-952f-ec63b1449069 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:20.123264 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7e942-9b23-4a9a-952f-ec63b1449069 None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:20.124028 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7e942-9b23-4a9a-952f-ec63b1449069 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:20.124357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7e942-9b23-4a9a-952f-ec63b1449069 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:20.125982 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7e942-9b23-4a9a-952f-ec63b1449069 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:20.139565 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 293/601] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:20.145556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7e942-9b23-4a9a-952f-ec63b1449069 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:20.157445 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:20.184734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f2eee-2a5d-4468-95e2-202ed07915ec None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:20.202224 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:20.230817 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54581189-94bc-464f-a3ef-1a253caf1a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:20.231637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54581189-94bc-464f-a3ef-1a253caf1a44 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:20.231993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54581189-94bc-464f-a3ef-1a253caf1a44 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:20.232373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54581189-94bc-464f-a3ef-1a253caf1a44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:20.240338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54581189-94bc-464f-a3ef-1a253caf1a44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:20.242001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54581189-94bc-464f-a3ef-1a253caf1a44 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:20.255132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-54581189-94bc-464f-a3ef-1a253caf1a44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:20.255132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:20.255132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:20.255132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:20.255132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:20.255132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:20.255132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:20.255132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:20.255132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:20.255132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:20.255132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:20.255132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:20.255132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:20.255132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:20.255132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:20.256243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:20.256243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:20.256243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:20.256243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:20.256243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:20.256243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:20.256243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:20.256243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:20.256243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:20.256243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:20.256243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:20.256243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:20.256243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:20.256243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:20.256243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:20.256243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:20.256243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:20.257322 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:20.257322 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:20.257322 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:20.257322 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:20.257322 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:20.257322 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:20.257322 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:20.257322 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:20.259144 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 309/602] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:20.263243 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7e942-9b23-4a9a-952f-ec63b1449069 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:20.264556 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54581189-94bc-464f-a3ef-1a253caf1a44 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:20.303306 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f9ec4-6244-40a9-b984-824698c79adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:20.304249 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f9ec4-6244-40a9-b984-824698c79adb None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:20.304729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f9ec4-6244-40a9-b984-824698c79adb None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:20.305173 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f9ec4-6244-40a9-b984-824698c79adb None admin] PATH_INFO: `/v3/projects/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:20.312578 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f9ec4-6244-40a9-b984-824698c79adb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:20.314501 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f9ec4-6244-40a9-b984-824698c79adb None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:20.326723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-d89f9ec4-6244-40a9-b984-824698c79adb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:20.326723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:20.326723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:20.326723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:20.326723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:20.326723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:20.326723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:20.326723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:20.326723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:20.326723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:20.326723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:20.326723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:20.326723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:20.326723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:20.326723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:20.327713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:20.327713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:20.327713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:20.327713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:20.327713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:20.327713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:20.327713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:20.327713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:20.327713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:20.327713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:20.327713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:20.327713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:20.327713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:20.327713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:20.327713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:20.327713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:20.327713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:20.328614 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:20.328614 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:20.328614 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:20.328614 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:20.328614 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:20.328614 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:20.328614 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:20.328614 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:20.331613 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 294/603] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:20.337517 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f9ec4-6244-40a9-b984-824698c79adb None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:20.450762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f9ec4-6244-40a9-b984-824698c79adb None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:20.452711 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:20.491028 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f2165-b67c-4767-8f79-aa85f0ed14d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:20.492437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f2165-b67c-4767-8f79-aa85f0ed14d9 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:20.492921 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f2165-b67c-4767-8f79-aa85f0ed14d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:20.493477 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f2165-b67c-4767-8f79-aa85f0ed14d9 None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:20.494372 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f2165-b67c-4767-8f79-aa85f0ed14d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:20.494870 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f2165-b67c-4767-8f79-aa85f0ed14d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:20.496535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f2165-b67c-4767-8f79-aa85f0ed14d9 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:20.510715 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 295/604] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:20.517625 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f2165-b67c-4767-8f79-aa85f0ed14d9 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:20.526560 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54581189-94bc-464f-a3ef-1a253caf1a44 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:20.568195 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51767c5d-bf0d-4157-96b5-3c241fc8060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:20.568944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51767c5d-bf0d-4157-96b5-3c241fc8060b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:20.569193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51767c5d-bf0d-4157-96b5-3c241fc8060b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:20.569473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51767c5d-bf0d-4157-96b5-3c241fc8060b None admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:20.570578 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51767c5d-bf0d-4157-96b5-3c241fc8060b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:20.570698 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51767c5d-bf0d-4157-96b5-3c241fc8060b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:20.572172 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51767c5d-bf0d-4157-96b5-3c241fc8060b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:20.583520 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:20.592246 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 310/605] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:20.593963 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26cba-fb76-4852-b8d0-e171bcaa1e83 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:20.594090 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26cba-fb76-4852-b8d0-e171bcaa1e83 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:20.597217 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26cba-fb76-4852-b8d0-e171bcaa1e83 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:20.597217 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 311/606] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:20.600183 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea26cba-fb76-4852-b8d0-e171bcaa1e83 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:20.633549 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f2165-b67c-4767-8f79-aa85f0ed14d9 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:20.671359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f87f5-0e80-4b5f-9a42-309374fc7127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:20.672569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f87f5-0e80-4b5f-9a42-309374fc7127 None admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:20.673686 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f87f5-0e80-4b5f-9a42-309374fc7127 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:20.674219 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f87f5-0e80-4b5f-9a42-309374fc7127 None admin] PATH_INFO: `/v3/projects/61c5f56764934c4a90ad38357b46f397/users/aefaf6998acc4434aab62b9625bd25fa/roles/1c1ddcbda0754702bb016952e90405ca` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:20.694109 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f87f5-0e80-4b5f-9a42-309374fc7127 None admin] RBAC: Authorizing `identity:create_grant(project_id=61c5f56764934c4a90ad38357b46f397, user_id=aefaf6998acc4434aab62b9625bd25fa, role_id=1c1ddcbda0754702bb016952e90405ca)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:20.696648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f87f5-0e80-4b5f-9a42-309374fc7127 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:20.733682 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea26cba-fb76-4852-b8d0-e171bcaa1e83 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:20.772629 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112b9ee-27db-484e-9829-e4d2b70c5e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:20.773291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112b9ee-27db-484e-9829-e4d2b70c5e6e None admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:20.773576 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112b9ee-27db-484e-9829-e4d2b70c5e6e None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:20.773993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112b9ee-27db-484e-9829-e4d2b70c5e6e None admin] PATH_INFO: `/v3/projects/61c5f56764934c4a90ad38357b46f397/users/7fc07c138a414936b2bb95dd3ded9ee7/roles/1c1ddcbda0754702bb016952e90405ca` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:20.793414 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112b9ee-27db-484e-9829-e4d2b70c5e6e None admin] RBAC: Authorizing `identity:create_grant(project_id=61c5f56764934c4a90ad38357b46f397, user_id=7fc07c138a414936b2bb95dd3ded9ee7, role_id=1c1ddcbda0754702bb016952e90405ca)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:20.797856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112b9ee-27db-484e-9829-e4d2b70c5e6e None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:20.798600 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 296/607] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:02:20 2022] PUT /identity/v3/projects/61c5f56764934c4a90ad38357b46f397/users/aefaf6998acc4434aab62b9625bd25fa/roles/1c1ddcbda0754702bb016952e90405ca => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:02:20.801094 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b79390-1b7f-41f0-b946-905c53789505 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:20.801687 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b79390-1b7f-41f0-b946-905c53789505 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:20.802293 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b79390-1b7f-41f0-b946-905c53789505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:20.830246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-75b79390-1b7f-41f0-b946-905c53789505 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:20.831592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-75b79390-1b7f-41f0-b946-905c53789505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:20.841185 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:20.910367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 312/608] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:02:20 2022] PUT /identity/v3/projects/61c5f56764934c4a90ad38357b46f397/users/7fc07c138a414936b2bb95dd3ded9ee7/roles/1c1ddcbda0754702bb016952e90405ca => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:02:20.927664 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 297/609] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:20.968588 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba8de5-fd8f-4e1b-bfd7-d9d7ff5e77ed None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:20.969680 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba8de5-fd8f-4e1b-bfd7-d9d7ff5e77ed None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:20.970485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba8de5-fd8f-4e1b-bfd7-d9d7ff5e77ed None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:20.973767 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 313/610] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:20.978967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa12206-6356-404d-9a4a-298a119800ee None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:20.979575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa12206-6356-404d-9a4a-298a119800ee None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:20.980079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa12206-6356-404d-9a4a-298a119800ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:21.015044 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-7fa12206-6356-404d-9a4a-298a119800ee None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:21.016934 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-7fa12206-6356-404d-9a4a-298a119800ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:21.105152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 298/611] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:21.250253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba8de5-fd8f-4e1b-bfd7-d9d7ff5e77ed None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:21.317454 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:21.380645 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba8de5-fd8f-4e1b-bfd7-d9d7ff5e77ed None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:21.419529 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91708d7-bf0d-4621-ac39-6c4073a7660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:21.420546 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91708d7-bf0d-4621-ac39-6c4073a7660d None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:21.421080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91708d7-bf0d-4621-ac39-6c4073a7660d None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:21.421618 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91708d7-bf0d-4621-ac39-6c4073a7660d None admin] PATH_INFO: `/v3/roles/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:21.433929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91708d7-bf0d-4621-ac39-6c4073a7660d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:21.439920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-d91708d7-bf0d-4621-ac39-6c4073a7660d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:21.439920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:21.439920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:21.439920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:21.439920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:21.439920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:21.439920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:21.439920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:21.439920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:21.439920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:21.439920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:21.439920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:21.439920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:21.439920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:21.439920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:21.439920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:21.440841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:21.440841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:21.440841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:21.440841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:21.440841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:21.440841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:21.440841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:21.440841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:21.440841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:21.440841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:21.440841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:21.440841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:21.440841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:21.440841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:21.440841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:21.440841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:21.441717 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:21.441717 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:21.441717 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:21.441717 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:21.441717 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:21.441717 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:21.441717 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:21.441717 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:21.441717 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:21.441717 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:21.441717 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:21.441717 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:21.444458 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 314/612] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:02:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:21.450053 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa12206-6356-404d-9a4a-298a119800ee None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:21.516933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91708d7-bf0d-4621-ac39-6c4073a7660d None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:21.584305 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:21.617337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa12206-6356-404d-9a4a-298a119800ee None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:21.633710 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91708d7-bf0d-4621-ac39-6c4073a7660d None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:21.650861 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:21.675217 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a81dd3-dbaf-415e-b7c1-e81a015516a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:21.676101 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a81dd3-dbaf-415e-b7c1-e81a015516a4 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:21.676534 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a81dd3-dbaf-415e-b7c1-e81a015516a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:21.676954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a81dd3-dbaf-415e-b7c1-e81a015516a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:21.686530 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155e8dd-30de-4928-bc79-d73ae16bc622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:21.687157 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155e8dd-30de-4928-bc79-d73ae16bc622 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:21.687436 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155e8dd-30de-4928-bc79-d73ae16bc622 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:21.687715 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155e8dd-30de-4928-bc79-d73ae16bc622 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:21.689139 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155e8dd-30de-4928-bc79-d73ae16bc622 None admin] RBAC: Adding query filter params (name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:21.689695 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155e8dd-30de-4928-bc79-d73ae16bc622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:21.693031 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155e8dd-30de-4928-bc79-d73ae16bc622 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:21.701078 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 299/613] 10.222.0.79 () {56 vars in 1103 bytes} [Fri Sep 2 21:02:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:21.710576 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155e8dd-30de-4928-bc79-d73ae16bc622 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:21.726863 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a81dd3-dbaf-415e-b7c1-e81a015516a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:21.732268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-d7a81dd3-dbaf-415e-b7c1-e81a015516a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:21.732268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:21.732268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:21.732268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:21.732268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:21.732268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:21.732268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:21.732268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:21.732268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:21.732268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:21.732268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:21.732268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:21.732268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:21.732268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:21.732268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:21.732268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:21.733201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:21.733201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:21.733201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:21.733201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:21.733201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:21.733201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:21.733201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:21.733201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:21.733201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:21.733201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:21.733201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:21.733201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:21.733201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:21.733201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:21.733201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:21.733201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:21.734047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:21.734047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:21.734047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:21.734047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:21.734047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:21.734047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:21.734047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:21.734047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:21.734047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:21.734047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:21.734047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:21.734047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:21.734047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 315/614] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:02:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:21.742857 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a81dd3-dbaf-415e-b7c1-e81a015516a4 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:21.897988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155e8dd-30de-4928-bc79-d73ae16bc622 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:21.900909 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a81dd3-dbaf-415e-b7c1-e81a015516a4 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:21.950590 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70f31b-9d12-4587-a990-75bece9d0ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:21.951199 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70f31b-9d12-4587-a990-75bece9d0ae8 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:21.951482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70f31b-9d12-4587-a990-75bece9d0ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:21.951758 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70f31b-9d12-4587-a990-75bece9d0ae8 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:21.952425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70f31b-9d12-4587-a990-75bece9d0ae8 None admin] RBAC: Adding query filter params (name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:21.952731 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70f31b-9d12-4587-a990-75bece9d0ae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:21.954483 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70f31b-9d12-4587-a990-75bece9d0ae8 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:21.956576 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3b117-3903-4fba-bfd9-b59d74621455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:21.957226 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3b117-3903-4fba-bfd9-b59d74621455 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:21.957506 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3b117-3903-4fba-bfd9-b59d74621455 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:21.957782 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3b117-3903-4fba-bfd9-b59d74621455 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:21.964921 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:21.974929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 316/615] 10.222.0.79 () {56 vars in 1103 bytes} [Fri Sep 2 21:02:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:21.981126 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70f31b-9d12-4587-a990-75bece9d0ae8 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:21.982827 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3b117-3903-4fba-bfd9-b59d74621455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:21.984286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3b117-3903-4fba-bfd9-b59d74621455 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:22.011356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-59b3b117-3903-4fba-bfd9-b59d74621455 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:22.011356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:22.011356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:22.011356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:22.011356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:22.011356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:22.011356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:22.011356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:22.011356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:22.011356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:22.011356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:22.011356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:22.011356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:22.011356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:22.011356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:22.011356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:22.012366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:22.012366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:22.012366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:22.012366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:22.012366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:22.012366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:22.012366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:22.012366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:22.012366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:22.012366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:22.012366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:22.012366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:22.012366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:22.012366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:22.012366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:22.012366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:22.012366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:22.013243 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:22.013243 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:22.013243 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:22.013243 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 300/616] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:22.020077 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3b117-3903-4fba-bfd9-b59d74621455 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:22.061284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:22.167044 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70f31b-9d12-4587-a990-75bece9d0ae8 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:22.199070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3b117-3903-4fba-bfd9-b59d74621455 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:22.216392 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4ee83-3d18-4b14-8d7d-1b5e5eb4d6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:22.217188 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4ee83-3d18-4b14-8d7d-1b5e5eb4d6c8 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:22.217604 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4ee83-3d18-4b14-8d7d-1b5e5eb4d6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:22.217916 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4ee83-3d18-4b14-8d7d-1b5e5eb4d6c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:22.231752 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4ee83-3d18-4b14-8d7d-1b5e5eb4d6c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:22.234011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4ee83-3d18-4b14-8d7d-1b5e5eb4d6c8 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:22.242368 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bd2af-bfa3-4606-94a2-94655206e49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:22.243148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bd2af-bfa3-4606-94a2-94655206e49a None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:22.244287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bd2af-bfa3-4606-94a2-94655206e49a None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:22.244675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bd2af-bfa3-4606-94a2-94655206e49a None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:22.245999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bd2af-bfa3-4606-94a2-94655206e49a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:22.246428 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bd2af-bfa3-4606-94a2-94655206e49a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:22.248264 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bd2af-bfa3-4606-94a2-94655206e49a None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:22.253341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-3cd4ee83-3d18-4b14-8d7d-1b5e5eb4d6c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:22.253341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:22.253341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:22.253341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:22.253341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:22.253341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:22.253341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:22.253341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:22.253341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:22.253341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:22.253341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:22.253341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:22.253341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:22.253341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:22.253341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:22.253341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:22.254657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:22.254657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:22.254657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:22.254657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:22.254657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:22.254657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:22.254657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:22.254657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:22.254657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:22.254657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:22.254657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:22.254657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:22.254657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:22.254657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:22.254657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:22.254657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:22.254657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:22.255815 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:22.255815 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:22.255815 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:22.255815 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 317/617] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:22.256169 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21a76f-12b4-4785-8a10-c28104a5d8ac None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:22.261847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21a76f-12b4-4785-8a10-c28104a5d8ac None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:22.261847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21a76f-12b4-4785-8a10-c28104a5d8ac None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:22.261847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 318/618] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:22.261847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21a76f-12b4-4785-8a10-c28104a5d8ac None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:22.271039 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 301/619] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:22.272492 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a94dd-ff47-4497-8b5d-74987b05efce None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:22.272786 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a94dd-ff47-4497-8b5d-74987b05efce None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:22.273137 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a94dd-ff47-4497-8b5d-74987b05efce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:22.293237 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-b89a94dd-ff47-4497-8b5d-74987b05efce None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:22.294530 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-b89a94dd-ff47-4497-8b5d-74987b05efce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:22.342811 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:22.368517 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:22.378313 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 302/620] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:22.378313 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a94dd-ff47-4497-8b5d-74987b05efce None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:22.403957 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21a76f-12b4-4785-8a10-c28104a5d8ac None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:22.451734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff49f8-a9b2-402e-afad-b21f39cb108b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:22.455433 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff49f8-a9b2-402e-afad-b21f39cb108b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:22.456790 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff49f8-a9b2-402e-afad-b21f39cb108b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:22.457754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff49f8-a9b2-402e-afad-b21f39cb108b None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:22.458678 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff49f8-a9b2-402e-afad-b21f39cb108b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:22.459238 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff49f8-a9b2-402e-afad-b21f39cb108b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:22.460920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff49f8-a9b2-402e-afad-b21f39cb108b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:22.479177 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 319/621] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:22.481141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff49f8-a9b2-402e-afad-b21f39cb108b None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:22.588209 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff49f8-a9b2-402e-afad-b21f39cb108b None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:22.614101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a94dd-ff47-4497-8b5d-74987b05efce None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:22.627922 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2f8b8-8ebe-43d2-a01a-599c47be1862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:22.629335 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2f8b8-8ebe-43d2-a01a-599c47be1862 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:22.629883 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2f8b8-8ebe-43d2-a01a-599c47be1862 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:22.630380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2f8b8-8ebe-43d2-a01a-599c47be1862 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:22.639540 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2f8b8-8ebe-43d2-a01a-599c47be1862 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:22.642503 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2f8b8-8ebe-43d2-a01a-599c47be1862 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:22.658271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-41b2f8b8-8ebe-43d2-a01a-599c47be1862 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:02:22.658271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:22.658271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:22.658271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:22.658271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:22.658271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:22.658271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:22.658271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:22.658271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:22.658271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:22.658271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:22.658271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:22.658271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:22.658271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:22.658271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:22.658271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:22.659291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:22.659291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:22.659291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:22.659291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:22.659291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:22.659291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:22.659291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:22.659291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:22.659291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:22.659291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:22.659291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:22.659291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:22.659291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:22.659291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:22.659291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:22.659291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:22.659291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:22.659291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:22.660269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:22.660269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:22.660269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:22.660269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:22.660269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:22.660269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:22.660269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:22.660269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:22.660269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:02:22.660269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:22.667777 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 320/622] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:02:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:22.669456 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2f8b8-8ebe-43d2-a01a-599c47be1862 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:22.674147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:22.721104 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8e255-cfbe-4eb6-9154-75f11a5ea0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:22.721925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8e255-cfbe-4eb6-9154-75f11a5ea0ff None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:22.722360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8e255-cfbe-4eb6-9154-75f11a5ea0ff None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:22.722783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8e255-cfbe-4eb6-9154-75f11a5ea0ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:22.736116 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8e255-cfbe-4eb6-9154-75f11a5ea0ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:22.738379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8e255-cfbe-4eb6-9154-75f11a5ea0ff None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:22.758710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-59f8e255-cfbe-4eb6-9154-75f11a5ea0ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:02:22.758710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:22.758710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:22.758710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:22.758710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:22.758710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:22.758710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:22.758710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:22.758710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:22.758710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:22.758710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:22.758710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:22.758710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:22.758710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:22.758710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:22.758710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:22.759691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:22.759691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:22.759691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:22.759691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:22.759691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:22.759691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:22.759691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:22.759691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:22.759691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:22.759691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:22.759691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:22.759691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:22.759691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:22.759691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:22.759691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:22.759691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:22.759691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:22.759691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:22.760616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:22.760616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:22.760616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:22.760616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:22.760616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:22.760616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:22.760616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:22.760616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:22.760616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:02:22.760616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:22.761141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 303/623] 10.222.0.79 () {56 vars in 1093 bytes} [Fri Sep 2 21:02:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:22.765833 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8e255-cfbe-4eb6-9154-75f11a5ea0ff None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:22.801270 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2f8b8-8ebe-43d2-a01a-599c47be1862 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:22.814807 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:22.845399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f45b18-7269-4c2f-97e7-60b27fd2ab7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:22.846486 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f45b18-7269-4c2f-97e7-60b27fd2ab7a None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:22.846780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f45b18-7269-4c2f-97e7-60b27fd2ab7a None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:22.847064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f45b18-7269-4c2f-97e7-60b27fd2ab7a None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:22.848548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f45b18-7269-4c2f-97e7-60b27fd2ab7a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:22.849128 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f45b18-7269-4c2f-97e7-60b27fd2ab7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:22.850934 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f45b18-7269-4c2f-97e7-60b27fd2ab7a None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:22.876838 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 321/624] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Sep 2 21:02:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:22.877716 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f45b18-7269-4c2f-97e7-60b27fd2ab7a None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:22.902180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8e255-cfbe-4eb6-9154-75f11a5ea0ff None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:22.940964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a437bbf-ff82-414c-bf86-03295aef0238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:22.941603 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a437bbf-ff82-414c-bf86-03295aef0238 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:22.941916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a437bbf-ff82-414c-bf86-03295aef0238 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:22.942197 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a437bbf-ff82-414c-bf86-03295aef0238 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:22.953262 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:22.953561 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a437bbf-ff82-414c-bf86-03295aef0238 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:22.959869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-7a437bbf-ff82-414c-bf86-03295aef0238 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:22.959869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:22.959869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:22.959869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:22.959869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:22.959869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:22.959869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:22.959869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:22.959869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:22.959869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:22.959869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:22.959869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:22.959869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:22.959869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:22.959869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:22.959869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:22.960850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:22.960850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:22.960850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:22.960850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:22.960850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:22.960850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:22.960850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:22.960850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:22.960850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:22.960850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:22.960850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:22.960850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:22.960850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:22.960850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:22.960850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:22.960850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:22.961737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:22.961737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:22.961737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:22.961737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:22.961737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:22.961737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:22.961737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:22.961737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:22.961737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:22.961737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:22.961737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:22.961737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:22.961737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 304/625] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:02:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:22.974702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a437bbf-ff82-414c-bf86-03295aef0238 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:23.010605 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f45b18-7269-4c2f-97e7-60b27fd2ab7a None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:23.051835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72421476-2a9d-491d-998b-3c46aeac8295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:23.052601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72421476-2a9d-491d-998b-3c46aeac8295 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:23.052982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72421476-2a9d-491d-998b-3c46aeac8295 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:23.053353 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72421476-2a9d-491d-998b-3c46aeac8295 None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:23.054325 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72421476-2a9d-491d-998b-3c46aeac8295 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:23.054731 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72421476-2a9d-491d-998b-3c46aeac8295 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:23.056478 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72421476-2a9d-491d-998b-3c46aeac8295 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:23.072227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:23.077928 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 322/626] 10.222.0.79 () {56 vars in 1133 bytes} [Fri Sep 2 21:02:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:23.078659 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a437bbf-ff82-414c-bf86-03295aef0238 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:23.080348 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72421476-2a9d-491d-998b-3c46aeac8295 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:23.118437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fb347-2bc0-4f02-ad41-c3958f5c6db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:23.119107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fb347-2bc0-4f02-ad41-c3958f5c6db5 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:23.119391 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fb347-2bc0-4f02-ad41-c3958f5c6db5 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:23.119670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fb347-2bc0-4f02-ad41-c3958f5c6db5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:23.131310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fb347-2bc0-4f02-ad41-c3958f5c6db5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:23.132937 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fb347-2bc0-4f02-ad41-c3958f5c6db5 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:23.150296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-d46fb347-2bc0-4f02-ad41-c3958f5c6db5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:23.150296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:23.150296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:23.150296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:23.150296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:23.150296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:23.150296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:23.150296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:23.150296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:23.150296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:23.150296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:23.150296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:23.150296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:23.150296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:23.150296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:23.150296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:23.151310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:23.151310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:23.151310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:23.151310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:23.151310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:23.151310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:23.151310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:23.151310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:23.151310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:23.151310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:23.151310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:23.151310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:23.151310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:23.151310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:23.151310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:23.151310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:23.151310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:23.152314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:23.152314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:23.152314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:23.156326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 305/627] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:23.157429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fb347-2bc0-4f02-ad41-c3958f5c6db5 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:23.202048 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72421476-2a9d-491d-998b-3c46aeac8295 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:23.224607 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:23.240353 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df770208-985b-4ca8-9fb9-6b22bc8ce729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:23.240886 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df770208-985b-4ca8-9fb9-6b22bc8ce729 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:23.241164 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df770208-985b-4ca8-9fb9-6b22bc8ce729 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:23.241441 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df770208-985b-4ca8-9fb9-6b22bc8ce729 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:23.242213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df770208-985b-4ca8-9fb9-6b22bc8ce729 None admin] RBAC: Adding query filter params (name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:23.242519 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df770208-985b-4ca8-9fb9-6b22bc8ce729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:23.243886 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df770208-985b-4ca8-9fb9-6b22bc8ce729 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:23.254521 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 323/628] 10.222.0.79 () {56 vars in 1103 bytes} [Fri Sep 2 21:02:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:23.255187 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df770208-985b-4ca8-9fb9-6b22bc8ce729 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:23.281276 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fb347-2bc0-4f02-ad41-c3958f5c6db5 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:23.318567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e4533-1c09-4e41-a867-b36b0a2fce36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:23.319143 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e4533-1c09-4e41-a867-b36b0a2fce36 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:23.319479 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e4533-1c09-4e41-a867-b36b0a2fce36 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:23.319755 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e4533-1c09-4e41-a867-b36b0a2fce36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:23.338343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:23.359480 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df770208-985b-4ca8-9fb9-6b22bc8ce729 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:23.397685 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb48fc-2a67-48af-aaf8-16707ae197ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:23.398320 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb48fc-2a67-48af-aaf8-16707ae197ef None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:23.398601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb48fc-2a67-48af-aaf8-16707ae197ef None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:23.398875 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb48fc-2a67-48af-aaf8-16707ae197ef None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:23.399520 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb48fc-2a67-48af-aaf8-16707ae197ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:23.399785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e4533-1c09-4e41-a867-b36b0a2fce36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:23.399894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb48fc-2a67-48af-aaf8-16707ae197ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:23.401190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb48fc-2a67-48af-aaf8-16707ae197ef None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:23.401292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e4533-1c09-4e41-a867-b36b0a2fce36 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:23.416690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 324/629] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:23.418359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db914fb-6aed-4a09-8f9d-0735fe363f56 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:23.418738 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db914fb-6aed-4a09-8f9d-0735fe363f56 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:23.418992 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db914fb-6aed-4a09-8f9d-0735fe363f56 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:23.420471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 325/630] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:23.420900 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db914fb-6aed-4a09-8f9d-0735fe363f56 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:23.468043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:23.510025 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 306/631] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:02:23.511332 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc9b73-4e6b-4adc-ab91-3d1832f3abe8 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:23.511625 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc9b73-4e6b-4adc-ab91-3d1832f3abe8 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:23.511903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc9b73-4e6b-4adc-ab91-3d1832f3abe8 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:23.513514 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 307/632] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:23.514003 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc9b73-4e6b-4adc-ab91-3d1832f3abe8 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:23.530296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db914fb-6aed-4a09-8f9d-0735fe363f56 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:23.565229 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944aacc-e04d-432b-9896-986afb8abed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:23.565886 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944aacc-e04d-432b-9896-986afb8abed0 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:23.566176 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944aacc-e04d-432b-9896-986afb8abed0 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:23.566336 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:23.566434 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944aacc-e04d-432b-9896-986afb8abed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:23.576549 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944aacc-e04d-432b-9896-986afb8abed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:23.578031 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944aacc-e04d-432b-9896-986afb8abed0 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:23.594085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-1944aacc-e04d-432b-9896-986afb8abed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:23.594085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:23.594085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:23.594085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:23.594085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:23.594085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:23.594085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:23.594085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:23.594085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:23.594085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:23.594085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:23.594085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:23.594085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:23.594085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:23.594085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:23.594085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:23.595654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:23.595654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:23.595654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:23.595654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:23.595654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:23.595654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:23.595654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:23.595654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:23.595654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:23.595654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:23.595654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:23.595654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:23.595654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:23.595654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:23.595654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:23.595654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:23.595654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:23.596563 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:23.596563 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:23.596563 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:23.596563 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 326/633] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:23.597227 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f00c5-8c1d-4d68-8537-90a39ce673c2 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:23.597502 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f00c5-8c1d-4d68-8537-90a39ce673c2 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:23.597774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f00c5-8c1d-4d68-8537-90a39ce673c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:23.616450 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-c74f00c5-8c1d-4d68-8537-90a39ce673c2 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:23.617678 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-c74f00c5-8c1d-4d68-8537-90a39ce673c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:23.625889 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc9b73-4e6b-4adc-ab91-3d1832f3abe8 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:23.661685 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528aef92-81e8-44dc-90c8-7cfcf6e5a0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:23.662358 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528aef92-81e8-44dc-90c8-7cfcf6e5a0a5 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:23.662640 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528aef92-81e8-44dc-90c8-7cfcf6e5a0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:23.662916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528aef92-81e8-44dc-90c8-7cfcf6e5a0a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:23.670005 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528aef92-81e8-44dc-90c8-7cfcf6e5a0a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:23.671470 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528aef92-81e8-44dc-90c8-7cfcf6e5a0a5 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:23.686004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-528aef92-81e8-44dc-90c8-7cfcf6e5a0a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:23.686004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:23.686004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:23.686004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:23.686004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:23.686004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:23.686004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:23.686004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:23.686004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:23.686004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:23.686004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:23.686004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:23.686004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:23.686004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:23.686004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:23.687234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:23.687234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:23.687234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:23.687234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:23.687234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:23.687234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:23.687234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:23.687234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:23.687234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:23.687234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:23.687234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:23.687234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:23.687234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:23.687234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:23.687234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:23.687234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:23.687234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:23.688500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:23.688500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:23.688500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:23.688500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:23.688500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:23.688500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:23.688500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:23.688500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:23.688500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 308/634] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:23.688500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528aef92-81e8-44dc-90c8-7cfcf6e5a0a5 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:23.692720 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 327/635] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:23.692720 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b880d-56a6-4960-91a6-9e3628587363 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:23.692720 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b880d-56a6-4960-91a6-9e3628587363 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:23.692720 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b880d-56a6-4960-91a6-9e3628587363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:23.714876 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-e42b880d-56a6-4960-91a6-9e3628587363 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:23.716158 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-e42b880d-56a6-4960-91a6-9e3628587363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:23.736384 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:23.793987 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 328/636] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:23.793987 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b880d-56a6-4960-91a6-9e3628587363 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:23.820741 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528aef92-81e8-44dc-90c8-7cfcf6e5a0a5 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:23.835049 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:23.870259 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf4802-a6d1-47ac-b494-cd997dafd5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:23.870928 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf4802-a6d1-47ac-b494-cd997dafd5fe None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:23.871211 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf4802-a6d1-47ac-b494-cd997dafd5fe None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:23.872535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf4802-a6d1-47ac-b494-cd997dafd5fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:23.891042 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf4802-a6d1-47ac-b494-cd997dafd5fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:23.893182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf4802-a6d1-47ac-b494-cd997dafd5fe None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:23.913542 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b880d-56a6-4960-91a6-9e3628587363 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:23.913900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-34cf4802-a6d1-47ac-b494-cd997dafd5fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:23.913900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:23.913900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:23.913900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:23.913900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:23.913900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:23.913900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:23.913900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:23.913900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:23.913900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:23.913900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:23.913900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:23.913900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:23.913900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:23.913900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:23.913900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:23.914941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:23.914941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:23.914941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:23.914941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:23.914941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:23.914941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:23.914941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:23.914941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:23.914941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:23.914941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:23.914941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:23.914941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:23.914941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:23.914941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:23.914941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:23.914941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:23.914941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:23.916523 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:23.916523 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:23.916523 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:23.916523 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 309/637] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:23.916523 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf4802-a6d1-47ac-b494-cd997dafd5fe None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:23.957119 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a323b0-d5fc-4969-904c-701c47042a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:23.958133 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a323b0-d5fc-4969-904c-701c47042a2e None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:23.958628 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a323b0-d5fc-4969-904c-701c47042a2e None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:23.959101 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a323b0-d5fc-4969-904c-701c47042a2e None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:23.960130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a323b0-d5fc-4969-904c-701c47042a2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:23.960657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a323b0-d5fc-4969-904c-701c47042a2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:23.962292 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a323b0-d5fc-4969-904c-701c47042a2e None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:23.976517 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 329/638] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:23.977769 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a323b0-d5fc-4969-904c-701c47042a2e None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:23.995462 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:24.036956 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf4802-a6d1-47ac-b494-cd997dafd5fe None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:24.075162 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734eecb3-6d6f-4e0c-86f3-0b0a83ce2925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:24.075786 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734eecb3-6d6f-4e0c-86f3-0b0a83ce2925 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:24.076135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734eecb3-6d6f-4e0c-86f3-0b0a83ce2925 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:24.076511 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734eecb3-6d6f-4e0c-86f3-0b0a83ce2925 None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:24.077797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734eecb3-6d6f-4e0c-86f3-0b0a83ce2925 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:24.078327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734eecb3-6d6f-4e0c-86f3-0b0a83ce2925 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:24.080262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734eecb3-6d6f-4e0c-86f3-0b0a83ce2925 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:24.090664 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a323b0-d5fc-4969-904c-701c47042a2e None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:24.093450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 310/639] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:24.095037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734eecb3-6d6f-4e0c-86f3-0b0a83ce2925 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:24.117330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:24.129108 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d1a63-62f7-4435-ade7-e9e844875f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:24.129715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d1a63-62f7-4435-ade7-e9e844875f7c None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:24.136101 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d1a63-62f7-4435-ade7-e9e844875f7c None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:24.136101 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d1a63-62f7-4435-ade7-e9e844875f7c None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:24.136101 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d1a63-62f7-4435-ade7-e9e844875f7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:24.136101 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d1a63-62f7-4435-ade7-e9e844875f7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:24.136101 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d1a63-62f7-4435-ade7-e9e844875f7c None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:24.150664 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 330/640] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:24.150664 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d1a63-62f7-4435-ade7-e9e844875f7c None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:24.199530 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734eecb3-6d6f-4e0c-86f3-0b0a83ce2925 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:24.231551 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:24.238447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d1ef9-cd3d-45be-af0b-8b27c2fa67dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:24.239087 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d1ef9-cd3d-45be-af0b-8b27c2fa67dd None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:24.239370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d1ef9-cd3d-45be-af0b-8b27c2fa67dd None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:24.239646 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d1ef9-cd3d-45be-af0b-8b27c2fa67dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:24.252006 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d1ef9-cd3d-45be-af0b-8b27c2fa67dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:24.256847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-442d1ef9-cd3d-45be-af0b-8b27c2fa67dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:24.256847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:24.256847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:24.256847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:24.256847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:24.256847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:24.256847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:24.256847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:24.256847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:24.256847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:24.256847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:24.256847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:24.256847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:24.256847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:24.256847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:24.256847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:24.258652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:24.258652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:24.258652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:24.258652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:24.258652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:24.258652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:24.258652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:24.258652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:24.258652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:24.258652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:24.258652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:24.258652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:24.258652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:24.258652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:24.258652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:24.258652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:24.259703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:24.259703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:24.259703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:24.259703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:24.259703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:24.259703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:24.259703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:24.259703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:24.259703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:24.259703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:24.259703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:24.259703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:24.260351 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d1a63-62f7-4435-ade7-e9e844875f7c None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:24.260426 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 311/641] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:02:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:24.260426 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d1ef9-cd3d-45be-af0b-8b27c2fa67dd None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:24.294925 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987181d-7540-4416-b965-9a7f90adcb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:24.295870 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987181d-7540-4416-b965-9a7f90adcb34 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:24.296302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987181d-7540-4416-b965-9a7f90adcb34 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:24.296730 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987181d-7540-4416-b965-9a7f90adcb34 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:24.307033 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987181d-7540-4416-b965-9a7f90adcb34 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:24.308536 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987181d-7540-4416-b965-9a7f90adcb34 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:24.322887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-0987181d-7540-4416-b965-9a7f90adcb34 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 02 21:02:24.322887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:24.322887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:24.322887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:24.322887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:24.322887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:24.322887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:24.322887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:24.322887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:24.322887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:24.322887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:24.322887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:24.322887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:24.322887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:24.322887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:24.322887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:24.324205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:24.324205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:24.324205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:24.324205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:24.324205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:24.324205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:24.324205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:24.324205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:24.324205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:24.324205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:24.324205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:24.324205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:24.324205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:24.324205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:24.324205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:24.324205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:24.324205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:24.324205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:24.325411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:24.325411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:24.325411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:24.325411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:24.325411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:24.325411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:24.325411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:24.325411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:24.325411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 02 21:02:24.325411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:24.325411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 331/642] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:02:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:24.325411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987181d-7540-4416-b965-9a7f90adcb34 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:24.357167 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:24.378590 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d1ef9-cd3d-45be-af0b-8b27c2fa67dd None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:24.419588 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2093c-ba50-4913-806f-98280d9fbc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:24.420227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2093c-ba50-4913-806f-98280d9fbc42 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:24.420510 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2093c-ba50-4913-806f-98280d9fbc42 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:24.420786 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2093c-ba50-4913-806f-98280d9fbc42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:24.432163 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2093c-ba50-4913-806f-98280d9fbc42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:24.432371 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987181d-7540-4416-b965-9a7f90adcb34 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:24.437018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-9bb2093c-ba50-4913-806f-98280d9fbc42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:24.437018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:24.437018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:24.437018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:24.437018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:24.437018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:24.437018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:24.437018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:24.437018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:24.437018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:24.437018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:24.437018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:24.437018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:24.437018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:24.437018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:24.437018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:24.438246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:24.438246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:24.438246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:24.438246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:24.438246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:24.438246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:24.438246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:24.438246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:24.438246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:24.438246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:24.438246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:24.438246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:24.438246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:24.438246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:24.438246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:24.438246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:24.439882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:24.439882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:24.439882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:24.439882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:24.439882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:24.439882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:24.439882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:24.439882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:24.439882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:24.439882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:24.439882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:24.439882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:24.439882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 312/643] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:02:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:24.439882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2093c-ba50-4913-806f-98280d9fbc42 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:24.469873 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a285fc-1d7e-4aed-93fd-d80a0c8c6cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:24.470691 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a285fc-1d7e-4aed-93fd-d80a0c8c6cb6 None admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:24.470983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a285fc-1d7e-4aed-93fd-d80a0c8c6cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:24.471267 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a285fc-1d7e-4aed-93fd-d80a0c8c6cb6 None admin] PATH_INFO: `/v3/projects/61c5f56764934c4a90ad38357b46f397/users/3da2b1dc9dae413a8ee63ad67e840f8c/roles/1c1ddcbda0754702bb016952e90405ca` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:24.474160 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:24.488238 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a285fc-1d7e-4aed-93fd-d80a0c8c6cb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=61c5f56764934c4a90ad38357b46f397, user_id=3da2b1dc9dae413a8ee63ad67e840f8c, role_id=1c1ddcbda0754702bb016952e90405ca)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:24.489701 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a285fc-1d7e-4aed-93fd-d80a0c8c6cb6 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:24.546312 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2093c-ba50-4913-806f-98280d9fbc42 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:24.581903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7373a80-b7c2-42b9-a239-1f010391f5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:24.582474 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7373a80-b7c2-42b9-a239-1f010391f5ff None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:24.582756 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7373a80-b7c2-42b9-a239-1f010391f5ff None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:24.583031 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7373a80-b7c2-42b9-a239-1f010391f5ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:24.590001 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7373a80-b7c2-42b9-a239-1f010391f5ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:24.591441 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7373a80-b7c2-42b9-a239-1f010391f5ff None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:24.593983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:24.603160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-e7373a80-b7c2-42b9-a239-1f010391f5ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:24.603160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:24.603160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:24.603160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:24.603160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:24.603160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:24.603160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:24.603160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:24.603160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:24.603160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:24.603160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:24.603160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:24.603160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:24.603160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:24.603160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:24.604222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:24.604222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:24.604222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:24.604222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:24.604222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:24.604222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:24.604222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:24.604222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:24.604222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:24.604222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:24.604222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:24.604222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:24.604222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:24.604222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:24.604222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:24.604222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:24.604222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:24.610705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:24.610705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:24.610705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:24.610705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:24.610705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:24.610705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:24.610705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:24.610705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:24.610705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 313/644] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:24.610705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7373a80-b7c2-42b9-a239-1f010391f5ff None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:24.618972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 332/645] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:02:24 2022] PUT /identity/v3/projects/61c5f56764934c4a90ad38357b46f397/users/3da2b1dc9dae413a8ee63ad67e840f8c/roles/1c1ddcbda0754702bb016952e90405ca => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:02:24.618972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a285fc-1d7e-4aed-93fd-d80a0c8c6cb6 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:24.741040 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7373a80-b7c2-42b9-a239-1f010391f5ff None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:24.742420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a285fc-1d7e-4aed-93fd-d80a0c8c6cb6 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:24.786291 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba1d87-0b9c-4f85-869f-5dc49cfc603e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:24.786642 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba1d87-0b9c-4f85-869f-5dc49cfc603e None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:24.786926 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba1d87-0b9c-4f85-869f-5dc49cfc603e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:24.787201 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba1d87-0b9c-4f85-869f-5dc49cfc603e None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:24.787884 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba1d87-0b9c-4f85-869f-5dc49cfc603e None admin] RBAC: Adding query filter params (name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:24.788185 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba1d87-0b9c-4f85-869f-5dc49cfc603e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:24.789570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba1d87-0b9c-4f85-869f-5dc49cfc603e None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:24.792845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40a039-42f8-4842-8fa2-d734fcf5f9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:24.793658 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40a039-42f8-4842-8fa2-d734fcf5f9c8 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:24.805802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40a039-42f8-4842-8fa2-d734fcf5f9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:24.805802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40a039-42f8-4842-8fa2-d734fcf5f9c8 None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:24.805802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40a039-42f8-4842-8fa2-d734fcf5f9c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:24.805802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40a039-42f8-4842-8fa2-d734fcf5f9c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:24.805802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40a039-42f8-4842-8fa2-d734fcf5f9c8 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:24.806294 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 314/646] 10.222.0.79 () {56 vars in 1103 bytes} [Fri Sep 2 21:02:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:24.806294 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba1d87-0b9c-4f85-869f-5dc49cfc603e None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:24.821843 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 333/647] 10.222.0.79 () {56 vars in 1137 bytes} [Fri Sep 2 21:02:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:24.821843 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40a039-42f8-4842-8fa2-d734fcf5f9c8 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:24.877692 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:24.885014 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:24.926203 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba1d87-0b9c-4f85-869f-5dc49cfc603e None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:24.939885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40a039-42f8-4842-8fa2-d734fcf5f9c8 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:24.963635 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1968c-ca81-4549-ac58-6c6dbefcbfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:24.968411 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1968c-ca81-4549-ac58-6c6dbefcbfdc None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:24.969191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1968c-ca81-4549-ac58-6c6dbefcbfdc None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:24.970479 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1968c-ca81-4549-ac58-6c6dbefcbfdc None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:24.971451 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1968c-ca81-4549-ac58-6c6dbefcbfdc None admin] RBAC: Adding query filter params (name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:24.988320 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1968c-ca81-4549-ac58-6c6dbefcbfdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:24.988320 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1968c-ca81-4549-ac58-6c6dbefcbfdc None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:24.988567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad65bd1-87fa-4971-8054-1e4e84a7e6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:24.988567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad65bd1-87fa-4971-8054-1e4e84a7e6de None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:24.988567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad65bd1-87fa-4971-8054-1e4e84a7e6de None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:24.988567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad65bd1-87fa-4971-8054-1e4e84a7e6de None admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:24.988905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad65bd1-87fa-4971-8054-1e4e84a7e6de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:24.988905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad65bd1-87fa-4971-8054-1e4e84a7e6de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:24.988905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad65bd1-87fa-4971-8054-1e4e84a7e6de None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:24.989132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 315/648] 10.222.0.79 () {56 vars in 1103 bytes} [Fri Sep 2 21:02:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:24.989132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1968c-ca81-4549-ac58-6c6dbefcbfdc None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:25.004144 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 334/649] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:25.005055 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad65bd1-87fa-4971-8054-1e4e84a7e6de None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:25.121125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1968c-ca81-4549-ac58-6c6dbefcbfdc None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:25.121630 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad65bd1-87fa-4971-8054-1e4e84a7e6de None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:25.124368 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:25.146454 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:25.158738 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b01554-ae4f-427f-a61a-bb34ad1bfabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:25.159458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b01554-ae4f-427f-a61a-bb34ad1bfabb None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:25.159826 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b01554-ae4f-427f-a61a-bb34ad1bfabb None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:25.160160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b01554-ae4f-427f-a61a-bb34ad1bfabb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:25.160561 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d6e1d-d1e9-42b4-94ba-f6dd3365d13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:25.161363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d6e1d-d1e9-42b4-94ba-f6dd3365d13b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:25.161965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d6e1d-d1e9-42b4-94ba-f6dd3365d13b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:25.162708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d6e1d-d1e9-42b4-94ba-f6dd3365d13b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:25.171463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b01554-ae4f-427f-a61a-bb34ad1bfabb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:25.173624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b01554-ae4f-427f-a61a-bb34ad1bfabb None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:25.189924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-27b01554-ae4f-427f-a61a-bb34ad1bfabb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:25.189924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:25.189924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:25.189924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:25.189924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:25.189924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:25.189924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:25.189924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:25.189924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:25.189924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:25.189924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:25.189924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:25.189924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:25.189924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:25.189924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:25.189924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:25.191149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:25.191149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:25.191149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:25.191149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:25.191149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:25.191149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:25.191149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:25.191149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:25.191149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:25.191149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:25.191149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:25.191149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:25.191149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:25.191149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:25.191149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:25.191149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:25.191149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:25.192272 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:25.192272 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:25.192272 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:25.193660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 316/650] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:25.194616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b01554-ae4f-427f-a61a-bb34ad1bfabb None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:25.245764 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d6e1d-d1e9-42b4-94ba-f6dd3365d13b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:25.247627 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d6e1d-d1e9-42b4-94ba-f6dd3365d13b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:25.310160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b01554-ae4f-427f-a61a-bb34ad1bfabb None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:25.347886 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df101c-2a5d-45b5-89be-72c311efbf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:25.348509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df101c-2a5d-45b5-89be-72c311efbf7a None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:25.348836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df101c-2a5d-45b5-89be-72c311efbf7a None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:25.349055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df101c-2a5d-45b5-89be-72c311efbf7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:25.360962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df101c-2a5d-45b5-89be-72c311efbf7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:25.363567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df101c-2a5d-45b5-89be-72c311efbf7a None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:25.367946 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 335/651] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:02:25.367946 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d6e1d-d1e9-42b4-94ba-f6dd3365d13b None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:25.369233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:25.390207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-87df101c-2a5d-45b5-89be-72c311efbf7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:25.390207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:25.390207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:25.390207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:25.390207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:25.390207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:25.390207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:25.390207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:25.390207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:25.390207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:25.390207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:25.390207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:25.390207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:25.390207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:25.390207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:25.390207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:25.391513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:25.391513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:25.391513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:25.391513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:25.391513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:25.391513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:25.391513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:25.391513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:25.391513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:25.391513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:25.391513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:25.391513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:25.391513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:25.391513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:25.391513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:25.391513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:25.391513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:25.392458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:25.392458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:25.392458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:25.396437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 317/652] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:25.397399 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df101c-2a5d-45b5-89be-72c311efbf7a None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:25.427751 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:25.477729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d6e1d-d1e9-42b4-94ba-f6dd3365d13b None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:25.508408 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df101c-2a5d-45b5-89be-72c311efbf7a None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:25.515473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1a1b8-138f-4b73-a782-deb43413b4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:25.516078 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1a1b8-138f-4b73-a782-deb43413b4a2 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:25.517067 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1a1b8-138f-4b73-a782-deb43413b4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:25.517270 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1a1b8-138f-4b73-a782-deb43413b4a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:25.518032 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1a1b8-138f-4b73-a782-deb43413b4a2 None admin] RBAC: Adding query filter params (role.id=1c1ddcbda0754702bb016952e90405ca, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=632071470f7d409ab7b0129d120320c7) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:25.518340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1a1b8-138f-4b73-a782-deb43413b4a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:25.519763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1a1b8-138f-4b73-a782-deb43413b4a2 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:25.525763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 336/653] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:25 2022] GET /identity/v3/role_assignments?user.id=632071470f7d409ab7b0129d120320c7&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=1c1ddcbda0754702bb016952e90405ca => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:25.526580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1a1b8-138f-4b73-a782-deb43413b4a2 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:25.558037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b782704-bdd8-473c-a167-0b38f3a2e41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:25.558709 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b782704-bdd8-473c-a167-0b38f3a2e41e None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:25.558990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b782704-bdd8-473c-a167-0b38f3a2e41e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:25.559265 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b782704-bdd8-473c-a167-0b38f3a2e41e None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:25.559944 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b782704-bdd8-473c-a167-0b38f3a2e41e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:25.560255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b782704-bdd8-473c-a167-0b38f3a2e41e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:25.561751 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b782704-bdd8-473c-a167-0b38f3a2e41e None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:25.589551 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 318/654] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:25.590831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b782704-bdd8-473c-a167-0b38f3a2e41e None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:25.626285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:25.666091 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1a1b8-138f-4b73-a782-deb43413b4a2 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:25.708950 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec353a1-3ca5-4a91-a0e3-227ecba8f38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:25.710478 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec353a1-3ca5-4a91-a0e3-227ecba8f38e None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:25.710774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec353a1-3ca5-4a91-a0e3-227ecba8f38e None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:25.711063 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec353a1-3ca5-4a91-a0e3-227ecba8f38e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:25.731715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec353a1-3ca5-4a91-a0e3-227ecba8f38e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:25.733236 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec353a1-3ca5-4a91-a0e3-227ecba8f38e None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:25.741449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:25.749959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-cec353a1-3ca5-4a91-a0e3-227ecba8f38e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:25.749959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:25.749959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:25.749959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:25.749959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:25.749959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:25.749959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:25.749959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:25.749959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:25.749959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:25.749959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:25.749959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:25.749959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:25.749959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:25.749959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:25.749959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:25.751448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:25.751448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:25.751448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:25.751448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:25.751448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:25.751448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:25.751448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:25.751448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:25.751448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:25.751448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:25.751448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:25.751448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:25.751448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:25.751448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:25.751448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:25.751448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:25.751448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:25.752314 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:25.752314 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:25.752314 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:25.752314 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 337/655] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:25.753616 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec353a1-3ca5-4a91-a0e3-227ecba8f38e None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:25.766263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b782704-bdd8-473c-a167-0b38f3a2e41e None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:25.812458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb7ba0-96e9-4ed4-b752-e746d2fd0b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:25.814849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb7ba0-96e9-4ed4-b752-e746d2fd0b69 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:25.815318 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb7ba0-96e9-4ed4-b752-e746d2fd0b69 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:25.816299 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb7ba0-96e9-4ed4-b752-e746d2fd0b69 None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:25.817425 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb7ba0-96e9-4ed4-b752-e746d2fd0b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:25.817740 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb7ba0-96e9-4ed4-b752-e746d2fd0b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:25.819375 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb7ba0-96e9-4ed4-b752-e746d2fd0b69 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:25.836749 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 319/656] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:25.837633 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb7ba0-96e9-4ed4-b752-e746d2fd0b69 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:25.883097 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec353a1-3ca5-4a91-a0e3-227ecba8f38e None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:25.901980 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:25.921924 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabab24e-8a65-4426-be1f-a2e06e85bd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:25.922130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabab24e-8a65-4426-be1f-a2e06e85bd35 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:25.922470 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabab24e-8a65-4426-be1f-a2e06e85bd35 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:25.923538 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabab24e-8a65-4426-be1f-a2e06e85bd35 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:25.933140 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabab24e-8a65-4426-be1f-a2e06e85bd35 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:25.934704 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabab24e-8a65-4426-be1f-a2e06e85bd35 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:25.948488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-dabab24e-8a65-4426-be1f-a2e06e85bd35 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 21:02:25.948488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:25.948488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:25.948488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:25.948488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:25.948488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:25.948488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:25.948488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:25.948488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:25.948488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:25.948488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:25.948488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:25.948488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:25.948488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:25.948488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:25.948488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:25.949489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:25.949489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:25.949489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:25.949489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:25.949489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:25.949489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:25.949489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:25.949489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:25.949489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:25.949489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:25.949489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:25.949489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:25.949489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:25.949489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:25.949489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:25.949489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:25.949489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:25.949489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:25.950495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:25.950495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:25.950495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:25.950495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:25.950495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:25.950495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:25.950495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:25.950495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:25.950495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 02 21:02:25.950495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:25.950495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 338/657] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:02:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:25.951093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabab24e-8a65-4426-be1f-a2e06e85bd35 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:25.962276 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb7ba0-96e9-4ed4-b752-e746d2fd0b69 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:26.001453 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0e657-7a32-424d-92a0-ed480cfca287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:26.002457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0e657-7a32-424d-92a0-ed480cfca287 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:26.002946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0e657-7a32-424d-92a0-ed480cfca287 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:26.003540 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0e657-7a32-424d-92a0-ed480cfca287 None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:26.004458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0e657-7a32-424d-92a0-ed480cfca287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:26.005092 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0e657-7a32-424d-92a0-ed480cfca287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:26.006693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0e657-7a32-424d-92a0-ed480cfca287 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:26.021485 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 320/658] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:26.027348 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0e657-7a32-424d-92a0-ed480cfca287 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:26.040021 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:26.068617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabab24e-8a65-4426-be1f-a2e06e85bd35 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:26.106539 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f693ab-85d1-44ad-b99b-6a026809202b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:26.107736 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f693ab-85d1-44ad-b99b-6a026809202b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:26.108282 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f693ab-85d1-44ad-b99b-6a026809202b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:26.108714 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f693ab-85d1-44ad-b99b-6a026809202b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:26.117385 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f693ab-85d1-44ad-b99b-6a026809202b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:26.119395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f693ab-85d1-44ad-b99b-6a026809202b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:26.132208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-b1f693ab-85d1-44ad-b99b-6a026809202b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 21:02:26.132208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:26.132208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:26.132208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:26.132208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:26.132208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:26.132208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:26.132208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:26.132208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:26.132208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:26.132208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:26.132208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:26.132208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:26.132208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:26.132208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:26.132208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:26.133850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:26.133850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:26.133850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:26.133850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:26.133850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:26.133850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:26.133850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:26.133850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:26.133850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:26.133850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:26.133850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:26.133850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:26.133850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:26.133850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:26.133850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:26.133850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:26.133850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:26.133850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:26.134993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:26.134993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:26.134993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:26.134993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:26.134993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:26.134993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:26.134993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:26.134993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:26.134993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 21:02:26.134993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:26.137309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 339/659] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:02:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:26.138453 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f693ab-85d1-44ad-b99b-6a026809202b None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:26.149496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0e657-7a32-424d-92a0-ed480cfca287 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:26.184938 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:26.191556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4684e-afd1-4019-8d3e-31386b3aa922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:26.192574 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4684e-afd1-4019-8d3e-31386b3aa922 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:26.193136 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4684e-afd1-4019-8d3e-31386b3aa922 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:26.193627 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4684e-afd1-4019-8d3e-31386b3aa922 None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:26.194727 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4684e-afd1-4019-8d3e-31386b3aa922 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:26.195240 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4684e-afd1-4019-8d3e-31386b3aa922 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:26.196942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4684e-afd1-4019-8d3e-31386b3aa922 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:26.217525 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 321/660] 10.222.0.79 () {56 vars in 1139 bytes} [Fri Sep 2 21:02:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:26.218795 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4684e-afd1-4019-8d3e-31386b3aa922 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:26.256625 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f693ab-85d1-44ad-b99b-6a026809202b None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:26.294488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0dd4d3-ad7c-452e-8008-f92d4923b25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:26.295121 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dd4d3-ad7c-452e-8008-f92d4923b25f None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:26.295403 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dd4d3-ad7c-452e-8008-f92d4923b25f None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:26.295678 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dd4d3-ad7c-452e-8008-f92d4923b25f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:26.296943 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:26.305199 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0dd4d3-ad7c-452e-8008-f92d4923b25f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:26.306739 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0dd4d3-ad7c-452e-8008-f92d4923b25f None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:26.322913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-5e0dd4d3-ad7c-452e-8008-f92d4923b25f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:26.322913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:26.322913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:26.322913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:26.322913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:26.322913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:26.322913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:26.322913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:26.322913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:26.322913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:26.322913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:26.322913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:26.322913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:26.322913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:26.322913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:26.324473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:26.324473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:26.324473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:26.324473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:26.324473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:26.324473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:26.324473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:26.324473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:26.324473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:26.324473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:26.324473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:26.324473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:26.324473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:26.324473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:26.324473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:26.324473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:26.324473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:26.325393 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:26.325393 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:26.325393 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:26.325393 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:26.325393 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:26.325393 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:26.325393 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:26.325393 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:26.329695 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 340/661] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:26.330835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0dd4d3-ad7c-452e-8008-f92d4923b25f None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:26.343161 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4684e-afd1-4019-8d3e-31386b3aa922 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:26.383363 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944bc90-bc00-49d7-8f97-04e668fbfc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:26.384338 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944bc90-bc00-49d7-8f97-04e668fbfc7e None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:26.384931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944bc90-bc00-49d7-8f97-04e668fbfc7e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:26.385414 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944bc90-bc00-49d7-8f97-04e668fbfc7e None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:26.386459 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944bc90-bc00-49d7-8f97-04e668fbfc7e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:26.386998 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944bc90-bc00-49d7-8f97-04e668fbfc7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:26.388825 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944bc90-bc00-49d7-8f97-04e668fbfc7e None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:26.410924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 322/662] 10.222.0.79 () {56 vars in 1137 bytes} [Fri Sep 2 21:02:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:26.412255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944bc90-bc00-49d7-8f97-04e668fbfc7e None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:26.438826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:26.442350 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0dd4d3-ad7c-452e-8008-f92d4923b25f None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:26.479342 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d31c28-f943-44b1-aa94-4a7b8bcde319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:26.479929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d31c28-f943-44b1-aa94-4a7b8bcde319 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:26.480172 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d31c28-f943-44b1-aa94-4a7b8bcde319 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:26.480448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d31c28-f943-44b1-aa94-4a7b8bcde319 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:26.528660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944bc90-bc00-49d7-8f97-04e668fbfc7e None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:26.553875 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d31c28-f943-44b1-aa94-4a7b8bcde319 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:26.555390 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d31c28-f943-44b1-aa94-4a7b8bcde319 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:26.558081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:26.570796 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79c162-946b-4fd0-ac1a-42e7c07a94dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:26.571849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79c162-946b-4fd0-ac1a-42e7c07a94dc None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:26.572340 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79c162-946b-4fd0-ac1a-42e7c07a94dc None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:26.572837 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79c162-946b-4fd0-ac1a-42e7c07a94dc None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:26.573880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79c162-946b-4fd0-ac1a-42e7c07a94dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:26.574425 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79c162-946b-4fd0-ac1a-42e7c07a94dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:26.576194 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79c162-946b-4fd0-ac1a-42e7c07a94dc None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:26.591007 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 323/663] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:26.592337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79c162-946b-4fd0-ac1a-42e7c07a94dc None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:26.667315 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:26.677192 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 341/664] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:02:26.678101 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d31c28-f943-44b1-aa94-4a7b8bcde319 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:26.718380 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79c162-946b-4fd0-ac1a-42e7c07a94dc None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:26.757458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa32a91-ff90-4eab-be2c-88101f828471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:26.758123 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa32a91-ff90-4eab-be2c-88101f828471 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:26.758380 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa32a91-ff90-4eab-be2c-88101f828471 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:26.758659 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa32a91-ff90-4eab-be2c-88101f828471 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:26.799213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d31c28-f943-44b1-aa94-4a7b8bcde319 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:26.820690 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:26.838947 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138cd79a-964f-4e1c-85e8-0115d00d8b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:26.839292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa32a91-ff90-4eab-be2c-88101f828471 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:26.839560 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138cd79a-964f-4e1c-85e8-0115d00d8b08 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:26.839845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138cd79a-964f-4e1c-85e8-0115d00d8b08 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:26.840124 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138cd79a-964f-4e1c-85e8-0115d00d8b08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:26.840776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa32a91-ff90-4eab-be2c-88101f828471 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:26.840877 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138cd79a-964f-4e1c-85e8-0115d00d8b08 None admin] RBAC: Adding query filter params (role.id=1c1ddcbda0754702bb016952e90405ca, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=72840602ec264a74855b601c8d1ddf89) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:26.841150 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138cd79a-964f-4e1c-85e8-0115d00d8b08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:26.842617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138cd79a-964f-4e1c-85e8-0115d00d8b08 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:26.856213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 342/665] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:26 2022] GET /identity/v3/role_assignments?user.id=72840602ec264a74855b601c8d1ddf89&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=1c1ddcbda0754702bb016952e90405ca => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:26.856213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb27b6a-68ef-45d9-b82e-ffedd2c97eac None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:26.856213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb27b6a-68ef-45d9-b82e-ffedd2c97eac None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:26.856213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb27b6a-68ef-45d9-b82e-ffedd2c97eac None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:26.856213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 343/666] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:26.856213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb27b6a-68ef-45d9-b82e-ffedd2c97eac None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:26.968186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:26.985453 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 324/667] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:02:26.987096 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c061a7-1187-408f-95a6-a54a6d5fe480 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:26.987394 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c061a7-1187-408f-95a6-a54a6d5fe480 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:26.987678 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c061a7-1187-408f-95a6-a54a6d5fe480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:27.007223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-48c061a7-1187-408f-95a6-a54a6d5fe480 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:27.008809 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-48c061a7-1187-408f-95a6-a54a6d5fe480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:27.023476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb27b6a-68ef-45d9-b82e-ffedd2c97eac None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:27.074544 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dac49-9861-4221-8e82-4c7cf92c87fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:27.075536 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dac49-9861-4221-8e82-4c7cf92c87fb None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:27.076047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dac49-9861-4221-8e82-4c7cf92c87fb None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:27.076642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dac49-9861-4221-8e82-4c7cf92c87fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:27.097855 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4dac49-9861-4221-8e82-4c7cf92c87fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:27.097855 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4dac49-9861-4221-8e82-4c7cf92c87fb None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:27.103837 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 325/668] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:27.105315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c061a7-1187-408f-95a6-a54a6d5fe480 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:27.112842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-aa4dac49-9861-4221-8e82-4c7cf92c87fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:27.112842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:27.112842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:27.112842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:27.112842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:27.112842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:27.112842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:27.112842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:27.112842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:27.112842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:27.112842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:27.112842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:27.112842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:27.112842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:27.112842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:27.112842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:27.114671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:27.114671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:27.114671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:27.114671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:27.114671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:27.114671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:27.114671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:27.114671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:27.114671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:27.114671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:27.114671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:27.114671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:27.114671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:27.114671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:27.114671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:27.114671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:27.114671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:27.116420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:27.116420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:27.116420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:27.116420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 344/669] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:27.119879 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dac49-9861-4221-8e82-4c7cf92c87fb None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:27.129463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:27.239664 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c061a7-1187-408f-95a6-a54a6d5fe480 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:27.290098 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2619a-e966-4895-bd45-d03fc4720074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:27.292129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2619a-e966-4895-bd45-d03fc4720074 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:27.292425 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2619a-e966-4895-bd45-d03fc4720074 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:27.292765 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2619a-e966-4895-bd45-d03fc4720074 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:27.306930 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2619a-e966-4895-bd45-d03fc4720074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:27.307664 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dac49-9861-4221-8e82-4c7cf92c87fb None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:27.308399 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2619a-e966-4895-bd45-d03fc4720074 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:27.340897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-0ff2619a-e966-4895-bd45-d03fc4720074 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:27.340897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:27.340897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:27.340897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:27.340897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:27.340897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:27.340897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:27.340897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:27.340897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:27.340897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:27.340897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:27.340897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:27.340897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:27.340897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:27.340897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:27.340897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:27.341984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:27.341984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:27.341984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:27.341984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:27.341984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:27.341984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:27.341984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:27.341984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:27.341984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:27.341984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:27.341984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:27.341984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:27.341984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:27.341984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:27.341984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:27.341984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:27.341984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:27.342882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:27.342882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:27.342882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:27.343069 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:27.348216 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 326/670] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:27.354101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2619a-e966-4895-bd45-d03fc4720074 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:27.385802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3f2fc-35d7-4b90-be5a-4d233d491073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:27.386516 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3f2fc-35d7-4b90-be5a-4d233d491073 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:27.386842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3f2fc-35d7-4b90-be5a-4d233d491073 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:27.387214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3f2fc-35d7-4b90-be5a-4d233d491073 None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:27.387877 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3f2fc-35d7-4b90-be5a-4d233d491073 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:27.388185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3f2fc-35d7-4b90-be5a-4d233d491073 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:27.389580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3f2fc-35d7-4b90-be5a-4d233d491073 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:27.416081 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 345/671] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:27.423559 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3f2fc-35d7-4b90-be5a-4d233d491073 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:27.462092 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:27.504443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2619a-e966-4895-bd45-d03fc4720074 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:27.545765 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3f2fc-35d7-4b90-be5a-4d233d491073 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:27.546526 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae2c9c-4c72-4ba8-80ec-38f8d1235641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:27.547609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae2c9c-4c72-4ba8-80ec-38f8d1235641 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:27.548150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae2c9c-4c72-4ba8-80ec-38f8d1235641 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:27.548689 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae2c9c-4c72-4ba8-80ec-38f8d1235641 None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:27.549557 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae2c9c-4c72-4ba8-80ec-38f8d1235641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:27.550105 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae2c9c-4c72-4ba8-80ec-38f8d1235641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:27.551803 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae2c9c-4c72-4ba8-80ec-38f8d1235641 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:27.566284 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 327/672] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:27.567578 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae2c9c-4c72-4ba8-80ec-38f8d1235641 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:27.583670 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc16d0-fbc5-451b-897e-2bcdcf5bd6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:27.584355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc16d0-fbc5-451b-897e-2bcdcf5bd6c5 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:27.584635 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc16d0-fbc5-451b-897e-2bcdcf5bd6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:27.584909 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc16d0-fbc5-451b-897e-2bcdcf5bd6c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:27.592360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc16d0-fbc5-451b-897e-2bcdcf5bd6c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:27.593835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc16d0-fbc5-451b-897e-2bcdcf5bd6c5 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:27.607010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-1fcc16d0-fbc5-451b-897e-2bcdcf5bd6c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:27.607010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:27.607010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:27.607010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:27.607010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:27.607010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:27.607010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:27.607010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:27.607010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:27.607010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:27.607010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:27.607010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:27.607010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:27.607010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:27.607010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:27.608059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:27.608059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:27.608059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:27.608059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:27.608059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:27.608059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:27.608059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:27.608059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:27.608059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:27.608059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:27.608059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:27.608059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:27.608059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:27.608059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:27.608059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:27.608059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:27.608059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:27.608944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:27.608944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:27.608944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:27.608944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:27.608944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:27.608944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:27.608944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:27.608944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:27.608944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 346/673] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:27.609425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc16d0-fbc5-451b-897e-2bcdcf5bd6c5 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:27.646185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:27.688023 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae2c9c-4c72-4ba8-80ec-38f8d1235641 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:27.722093 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:27.732569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b082d-00ec-456e-a450-9f791e56f3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:27.735732 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b082d-00ec-456e-a450-9f791e56f3fa None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:27.735843 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc16d0-fbc5-451b-897e-2bcdcf5bd6c5 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:27.735925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b082d-00ec-456e-a450-9f791e56f3fa None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:27.735925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b082d-00ec-456e-a450-9f791e56f3fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:27.748171 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b082d-00ec-456e-a450-9f791e56f3fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:27.753449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-6d4b082d-00ec-456e-a450-9f791e56f3fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:27.753449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:27.753449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:27.753449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:27.753449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:27.753449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:27.753449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:27.753449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:27.753449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:27.753449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:27.753449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:27.753449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:27.753449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:27.753449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:27.753449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:27.753449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:27.754636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:27.754636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:27.754636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:27.754636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:27.754636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:27.754636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:27.754636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:27.754636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:27.754636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:27.754636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:27.754636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:27.754636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:27.754636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:27.754636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:27.754636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:27.754636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:27.755496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:27.755496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:27.755496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:27.755496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:27.755496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:27.755496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:27.755496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:27.755496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:27.755496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:27.755496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:27.755496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:27.755496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:27.755496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 328/674] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:02:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:27.756189 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b082d-00ec-456e-a450-9f791e56f3fa None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:27.780854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff654c9d-91ad-4b66-b0d8-73486c73ffdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:27.781510 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff654c9d-91ad-4b66-b0d8-73486c73ffdd None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:27.781795 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff654c9d-91ad-4b66-b0d8-73486c73ffdd None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:27.782779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff654c9d-91ad-4b66-b0d8-73486c73ffdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:27.793611 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff654c9d-91ad-4b66-b0d8-73486c73ffdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:27.795938 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff654c9d-91ad-4b66-b0d8-73486c73ffdd None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:27.820809 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-ff654c9d-91ad-4b66-b0d8-73486c73ffdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:27.820809 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:27.820809 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:27.820809 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:27.820809 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:27.820809 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:27.820809 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:27.820809 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:27.820809 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:27.820809 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:27.820809 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:27.820809 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:27.820809 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:27.820809 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:27.820809 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:27.821869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:27.821869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:27.821869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:27.821869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:27.821869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:27.821869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:27.821869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:27.821869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:27.821869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:27.821869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:27.821869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:27.821869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:27.821869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:27.821869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:27.821869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:27.821869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:27.821869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:27.822795 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:27.822795 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:27.822795 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:27.822795 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:27.822795 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:27.822795 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:27.822795 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:27.822795 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:27.825956 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 347/675] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:27.827303 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348c5f8-90e5-409d-b08c-564aa8448b15 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:27.827601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348c5f8-90e5-409d-b08c-564aa8448b15 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:27.827947 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348c5f8-90e5-409d-b08c-564aa8448b15 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:27.830152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 348/676] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:27.830994 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348c5f8-90e5-409d-b08c-564aa8448b15 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:27.895131 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b082d-00ec-456e-a450-9f791e56f3fa None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:27.933716 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a2418-096c-4cb1-bff2-cf4af042c209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:27.934346 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a2418-096c-4cb1-bff2-cf4af042c209 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:27.934635 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a2418-096c-4cb1-bff2-cf4af042c209 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:27.934915 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a2418-096c-4cb1-bff2-cf4af042c209 None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:27.935619 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a2418-096c-4cb1-bff2-cf4af042c209 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:27.935931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a2418-096c-4cb1-bff2-cf4af042c209 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:27.937358 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a2418-096c-4cb1-bff2-cf4af042c209 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:27.938696 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:27.946711 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348c5f8-90e5-409d-b08c-564aa8448b15 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:27.957256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 329/677] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:27.957256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a2418-096c-4cb1-bff2-cf4af042c209 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:27.986797 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf7370-0801-493a-8618-76546adb88dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:27.986797 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf7370-0801-493a-8618-76546adb88dd None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:27.986797 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf7370-0801-493a-8618-76546adb88dd None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:27.986797 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf7370-0801-493a-8618-76546adb88dd None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:27.988657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf7370-0801-493a-8618-76546adb88dd None admin] RBAC: Adding query filter params (name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:27.989062 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf7370-0801-493a-8618-76546adb88dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:27.990386 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf7370-0801-493a-8618-76546adb88dd None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:28.004348 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 349/678] 10.222.0.79 () {56 vars in 1103 bytes} [Fri Sep 2 21:02:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:28.005910 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf3624-b936-4e13-b7c8-ac941abbdccf None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:28.006127 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf3624-b936-4e13-b7c8-ac941abbdccf None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:28.006405 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf3624-b936-4e13-b7c8-ac941abbdccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:28.014318 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:28.025959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-ddcf3624-b936-4e13-b7c8-ac941abbdccf None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:28.027429 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ddcf3624-b936-4e13-b7c8-ac941abbdccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:28.082205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a2418-096c-4cb1-bff2-cf4af042c209 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:28.112396 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 350/679] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:28.113537 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf3624-b936-4e13-b7c8-ac941abbdccf None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:28.132864 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a4651-e345-4cee-bfc1-fc5e752daa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:28.133597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a4651-e345-4cee-bfc1-fc5e752daa4b None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:28.134058 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a4651-e345-4cee-bfc1-fc5e752daa4b None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:28.134422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a4651-e345-4cee-bfc1-fc5e752daa4b None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:28.135343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a4651-e345-4cee-bfc1-fc5e752daa4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:28.135723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a4651-e345-4cee-bfc1-fc5e752daa4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:28.137405 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a4651-e345-4cee-bfc1-fc5e752daa4b None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:28.156843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 330/680] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:28.158217 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a4651-e345-4cee-bfc1-fc5e752daa4b None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:28.214553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:28.236515 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf3624-b936-4e13-b7c8-ac941abbdccf None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:28.290021 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0fd3d-4882-4bee-bcd9-5d087d2266c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:28.290917 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a4651-e345-4cee-bfc1-fc5e752daa4b None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:28.291061 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0fd3d-4882-4bee-bcd9-5d087d2266c2 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:28.291489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0fd3d-4882-4bee-bcd9-5d087d2266c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:28.291916 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0fd3d-4882-4bee-bcd9-5d087d2266c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:28.293047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0fd3d-4882-4bee-bcd9-5d087d2266c2 None admin] RBAC: Adding query filter params (role.id=1c1ddcbda0754702bb016952e90405ca, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=aefaf6998acc4434aab62b9625bd25fa) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:28.294227 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0fd3d-4882-4bee-bcd9-5d087d2266c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:28.295702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0fd3d-4882-4bee-bcd9-5d087d2266c2 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:28.302971 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 351/681] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:28 2022] GET /identity/v3/role_assignments?user.id=aefaf6998acc4434aab62b9625bd25fa&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=1c1ddcbda0754702bb016952e90405ca => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:28.303861 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0fd3d-4882-4bee-bcd9-5d087d2266c2 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:28.304450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:28.354611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31fb28-ffb3-414e-9902-b3c191d62df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:28.360731 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31fb28-ffb3-414e-9902-b3c191d62df6 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:28.361652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31fb28-ffb3-414e-9902-b3c191d62df6 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:28.362198 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31fb28-ffb3-414e-9902-b3c191d62df6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:28.390304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31fb28-ffb3-414e-9902-b3c191d62df6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:28.393397 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31fb28-ffb3-414e-9902-b3c191d62df6 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:28.435422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-2b31fb28-ffb3-414e-9902-b3c191d62df6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:28.435422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:28.435422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:28.435422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:28.435422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:28.435422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:28.435422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:28.435422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:28.435422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:28.435422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:28.435422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:28.435422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:28.435422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:28.435422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:28.435422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:28.435422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:28.436433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:28.436433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:28.436433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:28.436433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:28.436433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:28.436433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:28.436433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:28.436433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:28.436433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:28.436433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:28.436433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:28.436433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:28.436433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:28.436433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:28.436433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:28.436433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:28.436433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:28.437443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:28.437443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:28.437443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:28.437443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 331/682] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:28.438719 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31fb28-ffb3-414e-9902-b3c191d62df6 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:28.483340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0fd3d-4882-4bee-bcd9-5d087d2266c2 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:28.530593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3ea7d-427b-469a-ae79-291fc29d06aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:28.531222 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3ea7d-427b-469a-ae79-291fc29d06aa None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:28.531509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3ea7d-427b-469a-ae79-291fc29d06aa None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:28.532317 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3ea7d-427b-469a-ae79-291fc29d06aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:28.533064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3ea7d-427b-469a-ae79-291fc29d06aa None admin] RBAC: Adding query filter params (role.id=1c1ddcbda0754702bb016952e90405ca, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=7fc07c138a414936b2bb95dd3ded9ee7) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:28.533443 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3ea7d-427b-469a-ae79-291fc29d06aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:28.538273 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3ea7d-427b-469a-ae79-291fc29d06aa None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:28.542496 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 352/683] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:28 2022] GET /identity/v3/role_assignments?user.id=7fc07c138a414936b2bb95dd3ded9ee7&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=1c1ddcbda0754702bb016952e90405ca => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:28.543150 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3ea7d-427b-469a-ae79-291fc29d06aa None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:28.562527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:28.572650 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31fb28-ffb3-414e-9902-b3c191d62df6 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:28.626491 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88a30d-ba0f-4128-b8bc-fc5a513c8705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:28.627632 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88a30d-ba0f-4128-b8bc-fc5a513c8705 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:28.629069 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88a30d-ba0f-4128-b8bc-fc5a513c8705 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:28.629550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88a30d-ba0f-4128-b8bc-fc5a513c8705 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:28.644603 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88a30d-ba0f-4128-b8bc-fc5a513c8705 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:28.652433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-3b88a30d-ba0f-4128-b8bc-fc5a513c8705 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:02:28.652433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:28.652433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:28.652433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:28.652433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:28.652433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:28.652433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:28.652433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:28.652433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:28.652433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:28.652433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:28.652433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:28.652433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:28.652433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:28.652433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:28.652433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:28.653379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:28.653379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:28.653379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:28.653379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:28.653379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:28.653379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:28.653379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:28.653379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:28.653379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:28.653379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:28.653379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:28.653379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:28.653379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:28.653379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:28.653379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:28.653379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:28.654298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:28.654298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:28.654298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:28.654298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:28.654298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:28.654298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:28.654298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:28.654298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:28.654298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:28.654298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:28.654298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:02:28.654298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:28.655814 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 332/684] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:02:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:28.665841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88a30d-ba0f-4128-b8bc-fc5a513c8705 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:28.677011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3ea7d-427b-469a-ae79-291fc29d06aa None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:28.710226 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:28.773260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadeeec-f3a4-4e48-9ad8-7b2a45ecf45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:28.774267 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadeeec-f3a4-4e48-9ad8-7b2a45ecf45b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:28.774756 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadeeec-f3a4-4e48-9ad8-7b2a45ecf45b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:28.775225 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadeeec-f3a4-4e48-9ad8-7b2a45ecf45b None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:28.776061 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fadeeec-f3a4-4e48-9ad8-7b2a45ecf45b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:28.776556 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fadeeec-f3a4-4e48-9ad8-7b2a45ecf45b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:28.778267 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fadeeec-f3a4-4e48-9ad8-7b2a45ecf45b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:28.796484 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 353/685] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:28.803100 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadeeec-f3a4-4e48-9ad8-7b2a45ecf45b None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:28.828666 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88a30d-ba0f-4128-b8bc-fc5a513c8705 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:28.874060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96b77b-cc33-4c44-aebe-db23aa557cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:28.875046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96b77b-cc33-4c44-aebe-db23aa557cfb None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:28.876932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96b77b-cc33-4c44-aebe-db23aa557cfb None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:28.876932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96b77b-cc33-4c44-aebe-db23aa557cfb None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:28.876932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96b77b-cc33-4c44-aebe-db23aa557cfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:28.877145 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96b77b-cc33-4c44-aebe-db23aa557cfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:28.878661 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96b77b-cc33-4c44-aebe-db23aa557cfb None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:28.890422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 333/686] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:02:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:28.898280 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96b77b-cc33-4c44-aebe-db23aa557cfb None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:28.903229 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:28.923463 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadeeec-f3a4-4e48-9ad8-7b2a45ecf45b None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:28.965942 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11917511-0644-4e3d-b159-c1344ddd63d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:28.966945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11917511-0644-4e3d-b159-c1344ddd63d5 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:28.967527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11917511-0644-4e3d-b159-c1344ddd63d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:28.968003 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11917511-0644-4e3d-b159-c1344ddd63d5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:28.976138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11917511-0644-4e3d-b159-c1344ddd63d5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:28.977981 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11917511-0644-4e3d-b159-c1344ddd63d5 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:28.990921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-11917511-0644-4e3d-b159-c1344ddd63d5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:02:28.990921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:28.990921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:28.990921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:28.990921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:28.990921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:28.990921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:28.990921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:28.990921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:28.990921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:28.990921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:28.990921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:28.990921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:28.990921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:28.990921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:28.990921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:28.991901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:28.991901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:28.991901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:28.991901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:28.991901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:28.991901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:28.991901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:28.991901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:28.991901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:28.991901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:28.991901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:28.991901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:28.991901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:28.991901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:28.991901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:28.991901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:28.991901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:28.991901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:28.992847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:28.992847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:28.992847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:28.992847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:28.992847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:28.992847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:28.992847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:28.992847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:28.992847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:02:28.992847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:28.995348 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 354/687] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:02:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:29.001782 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11917511-0644-4e3d-b159-c1344ddd63d5 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:29.005031 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:29.031057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96b77b-cc33-4c44-aebe-db23aa557cfb None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:29.069247 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd9dfd-e5d0-4a27-ad5e-006f383a35c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:29.070338 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd9dfd-e5d0-4a27-ad5e-006f383a35c6 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:29.070841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd9dfd-e5d0-4a27-ad5e-006f383a35c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:29.071329 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd9dfd-e5d0-4a27-ad5e-006f383a35c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:29.082771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd9dfd-e5d0-4a27-ad5e-006f383a35c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:29.084588 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd9dfd-e5d0-4a27-ad5e-006f383a35c6 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:29.101343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-e9fd9dfd-e5d0-4a27-ad5e-006f383a35c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:29.101343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:29.101343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:29.101343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:29.101343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:29.101343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:29.101343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:29.101343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:29.101343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:29.101343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:29.101343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:29.101343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:29.101343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:29.101343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:29.101343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:29.101343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:29.102359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:29.102359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:29.102359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:29.102359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:29.102359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:29.102359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:29.102359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:29.102359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:29.102359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:29.102359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:29.102359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:29.102359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:29.102359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:29.102359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:29.102359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:29.102359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:29.102359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:29.103257 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:29.103257 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:29.103257 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:29.105197 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 334/688] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:29.111551 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd9dfd-e5d0-4a27-ad5e-006f383a35c6 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:29.123106 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11917511-0644-4e3d-b159-c1344ddd63d5 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:29.165799 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0e4ff-9997-4394-bcd9-c1921e9855c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:29.166526 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0e4ff-9997-4394-bcd9-c1921e9855c3 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:29.166942 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0e4ff-9997-4394-bcd9-c1921e9855c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:29.167597 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0e4ff-9997-4394-bcd9-c1921e9855c3 None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:29.168433 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0e4ff-9997-4394-bcd9-c1921e9855c3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:29.168925 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0e4ff-9997-4394-bcd9-c1921e9855c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:29.170408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0e4ff-9997-4394-bcd9-c1921e9855c3 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:29.172248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:29.192451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 355/689] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Sep 2 21:02:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:29.198890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0e4ff-9997-4394-bcd9-c1921e9855c3 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:29.288893 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd9dfd-e5d0-4a27-ad5e-006f383a35c6 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:29.314903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0e4ff-9997-4394-bcd9-c1921e9855c3 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:29.328476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2ef7f-e04c-4240-9b7a-51730da08cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:29.330141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2ef7f-e04c-4240-9b7a-51730da08cfd None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:29.330494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2ef7f-e04c-4240-9b7a-51730da08cfd None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:29.330846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2ef7f-e04c-4240-9b7a-51730da08cfd None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:29.331621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2ef7f-e04c-4240-9b7a-51730da08cfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:29.331931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2ef7f-e04c-4240-9b7a-51730da08cfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:29.332415 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:29.338544 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2ef7f-e04c-4240-9b7a-51730da08cfd None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:29.355154 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecded17-f254-4902-acbe-548348c1a64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:29.355776 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecded17-f254-4902-acbe-548348c1a64b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:29.356060 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecded17-f254-4902-acbe-548348c1a64b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:29.356339 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecded17-f254-4902-acbe-548348c1a64b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:29.356455 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 335/690] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:29.357842 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458db97-ae49-48ac-ae2e-dedf377e1ec7 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:29.358138 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458db97-ae49-48ac-ae2e-dedf377e1ec7 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:29.358417 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458db97-ae49-48ac-ae2e-dedf377e1ec7 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:29.362213 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 336/691] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:29.365586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458db97-ae49-48ac-ae2e-dedf377e1ec7 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:29.423970 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:29.433874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecded17-f254-4902-acbe-548348c1a64b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:29.435407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecded17-f254-4902-acbe-548348c1a64b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:29.481640 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458db97-ae49-48ac-ae2e-dedf377e1ec7 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:29.521546 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239708c-f92f-4eb6-b067-ba2817c7c32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:29.522688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239708c-f92f-4eb6-b067-ba2817c7c32a None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:29.523150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239708c-f92f-4eb6-b067-ba2817c7c32a None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:29.523615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239708c-f92f-4eb6-b067-ba2817c7c32a None admin] PATH_INFO: `/v3/users/nova` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:29.533429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239708c-f92f-4eb6-b067-ba2817c7c32a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:29.535306 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239708c-f92f-4eb6-b067-ba2817c7c32a None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:29.546849 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 356/692] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:02:29.548885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdab70-c882-4361-99d4-5d46739e4731 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:29.549186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdab70-c882-4361-99d4-5d46739e4731 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:29.549475 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdab70-c882-4361-99d4-5d46739e4731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:29.552999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-8239708c-f92f-4eb6-b067-ba2817c7c32a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:02:29.552999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:29.552999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:29.552999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:29.552999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:29.552999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:29.552999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:29.552999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:29.552999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:29.552999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:29.552999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:29.552999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:29.552999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:29.552999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:29.552999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:29.552999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:29.554055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:29.554055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:29.554055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:29.554055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:29.554055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:29.554055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:29.554055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:29.554055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:29.554055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:29.554055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:29.554055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:29.554055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:29.554055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:29.554055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:29.554055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:29.554055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:29.554055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:29.554055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:29.555035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:29.555035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:29.555035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:29.555035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:29.555035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:29.555035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:29.555035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:29.555035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:29.555035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:02:29.555035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:29.557824 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 337/693] 10.222.0.79 () {56 vars in 1093 bytes} [Fri Sep 2 21:02:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:29.559026 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239708c-f92f-4eb6-b067-ba2817c7c32a None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:29.569344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-72bdab70-c882-4361-99d4-5d46739e4731 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:29.570593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-72bdab70-c882-4361-99d4-5d46739e4731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:29.632154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:29.653886 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 357/694] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:29.653886 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdab70-c882-4361-99d4-5d46739e4731 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:29.695756 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:29.728104 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239708c-f92f-4eb6-b067-ba2817c7c32a None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:29.802839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a744a0-9c69-4053-b343-7791c3246452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:29.803491 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a744a0-9c69-4053-b343-7791c3246452 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:29.803873 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a744a0-9c69-4053-b343-7791c3246452 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:29.804154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a744a0-9c69-4053-b343-7791c3246452 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:29.820913 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a744a0-9c69-4053-b343-7791c3246452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:29.822412 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a744a0-9c69-4053-b343-7791c3246452 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:29.834713 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdab70-c882-4361-99d4-5d46739e4731 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:29.853535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-63a744a0-9c69-4053-b343-7791c3246452 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:29.853535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:29.853535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:29.853535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:29.853535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:29.853535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:29.853535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:29.853535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:29.853535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:29.853535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:29.853535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:29.853535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:29.853535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:29.853535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:29.853535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:29.853535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:29.854573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:29.854573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:29.854573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:29.854573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:29.854573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:29.854573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:29.854573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:29.854573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:29.854573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:29.854573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:29.854573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:29.854573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:29.854573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:29.854573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:29.854573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:29.854573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:29.854573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:29.856089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:29.856089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:29.856089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:29.856089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 338/695] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:29.860053 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a744a0-9c69-4053-b343-7791c3246452 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:29.898759 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fd1a3-2029-4067-a044-fb0d8960b026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:29.899300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fd1a3-2029-4067-a044-fb0d8960b026 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:29.899584 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fd1a3-2029-4067-a044-fb0d8960b026 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:29.899864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fd1a3-2029-4067-a044-fb0d8960b026 None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:29.900602 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27fd1a3-2029-4067-a044-fb0d8960b026 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:29.900970 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27fd1a3-2029-4067-a044-fb0d8960b026 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:29.902456 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27fd1a3-2029-4067-a044-fb0d8960b026 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:29.939115 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 358/696] 10.222.0.79 () {56 vars in 1133 bytes} [Fri Sep 2 21:02:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:29.942583 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fd1a3-2029-4067-a044-fb0d8960b026 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:30.023394 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a744a0-9c69-4053-b343-7791c3246452 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:30.026094 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:30.075649 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb060b0-3d7d-4505-b1e6-3324623c958e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:30.076694 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb060b0-3d7d-4505-b1e6-3324623c958e None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:30.077312 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb060b0-3d7d-4505-b1e6-3324623c958e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:30.077605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb060b0-3d7d-4505-b1e6-3324623c958e None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:30.078322 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb060b0-3d7d-4505-b1e6-3324623c958e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:30.078711 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb060b0-3d7d-4505-b1e6-3324623c958e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:30.079473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:30.081207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb060b0-3d7d-4505-b1e6-3324623c958e None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:30.097880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 339/697] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:30.098953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb060b0-3d7d-4505-b1e6-3324623c958e None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:30.101041 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fd1a3-2029-4067-a044-fb0d8960b026 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:30.144799 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ecc97-0fa3-4cb2-ab4a-aea45590fe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:30.145670 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ecc97-0fa3-4cb2-ab4a-aea45590fe80 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:30.146148 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ecc97-0fa3-4cb2-ab4a-aea45590fe80 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:30.146752 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ecc97-0fa3-4cb2-ab4a-aea45590fe80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:30.232279 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb060b0-3d7d-4505-b1e6-3324623c958e None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:30.239140 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ecc97-0fa3-4cb2-ab4a-aea45590fe80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:30.240888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ecc97-0fa3-4cb2-ab4a-aea45590fe80 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:30.284879 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38207060-843f-4e2b-b726-42daa8bd9d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:30.285543 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38207060-843f-4e2b-b726-42daa8bd9d36 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:30.285843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38207060-843f-4e2b-b726-42daa8bd9d36 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:30.286144 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38207060-843f-4e2b-b726-42daa8bd9d36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:30.302444 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38207060-843f-4e2b-b726-42daa8bd9d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:30.303999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38207060-843f-4e2b-b726-42daa8bd9d36 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:30.324974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-38207060-843f-4e2b-b726-42daa8bd9d36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:30.324974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:30.324974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:30.324974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:30.324974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:30.324974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:30.324974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:30.324974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:30.324974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:30.324974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:30.324974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:30.324974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:30.324974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:30.324974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:30.324974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:30.324974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:30.326020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:30.326020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:30.326020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:30.326020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:30.326020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:30.326020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:30.326020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:30.326020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:30.326020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:30.326020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:30.326020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:30.326020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:30.326020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:30.326020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:30.326020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:30.326020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:30.326020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:30.326913 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:30.326913 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:30.326913 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:30.331755 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 340/698] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:30.332683 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38207060-843f-4e2b-b726-42daa8bd9d36 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:30.352599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:30.354195 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:30.376236 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 359/699] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:02:30.377605 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ecc97-0fa3-4cb2-ab4a-aea45590fe80 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:30.443497 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38207060-843f-4e2b-b726-42daa8bd9d36 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:30.489182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff544df-5b71-4085-92b2-0df3db0f8b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:30.490748 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff544df-5b71-4085-92b2-0df3db0f8b06 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:30.491183 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff544df-5b71-4085-92b2-0df3db0f8b06 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:30.491609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff544df-5b71-4085-92b2-0df3db0f8b06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:30.496498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ecc97-0fa3-4cb2-ab4a-aea45590fe80 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:30.501637 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff544df-5b71-4085-92b2-0df3db0f8b06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:30.503384 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff544df-5b71-4085-92b2-0df3db0f8b06 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:30.519775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-6ff544df-5b71-4085-92b2-0df3db0f8b06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:30.519775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:30.519775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:30.519775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:30.519775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:30.519775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:30.519775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:30.519775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:30.519775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:30.519775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:30.519775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:30.519775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:30.519775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:30.519775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:30.519775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:30.520910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:30.520910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:30.520910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:30.520910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:30.520910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:30.520910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:30.520910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:30.520910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:30.520910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:30.520910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:30.520910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:30.520910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:30.520910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:30.520910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:30.520910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:30.520910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:30.520910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:30.522080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:30.522080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:30.522080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:30.522080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:30.522080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:30.522080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:30.522080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:30.522080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:30.524939 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 341/700] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:30.526114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff544df-5b71-4085-92b2-0df3db0f8b06 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:30.541102 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3501786-0f0d-4cb3-847f-cbd5bbdb53e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:30.542345 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3501786-0f0d-4cb3-847f-cbd5bbdb53e1 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:30.542705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3501786-0f0d-4cb3-847f-cbd5bbdb53e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:30.543055 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3501786-0f0d-4cb3-847f-cbd5bbdb53e1 None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:30.544196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3501786-0f0d-4cb3-847f-cbd5bbdb53e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:30.544580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3501786-0f0d-4cb3-847f-cbd5bbdb53e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:30.546342 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3501786-0f0d-4cb3-847f-cbd5bbdb53e1 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:30.565896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 360/701] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:30.567559 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3501786-0f0d-4cb3-847f-cbd5bbdb53e1 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:30.629975 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:30.638981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:30.663742 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff544df-5b71-4085-92b2-0df3db0f8b06 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:30.705721 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c49b2a-94d3-4330-88c7-a7bba342d0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:30.706478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c49b2a-94d3-4330-88c7-a7bba342d0d2 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:30.706843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c49b2a-94d3-4330-88c7-a7bba342d0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:30.707347 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c49b2a-94d3-4330-88c7-a7bba342d0d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:30.720686 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3501786-0f0d-4cb3-847f-cbd5bbdb53e1 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:30.720930 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c49b2a-94d3-4330-88c7-a7bba342d0d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:30.722597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c49b2a-94d3-4330-88c7-a7bba342d0d2 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:30.738675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-45c49b2a-94d3-4330-88c7-a7bba342d0d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:30.738675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:30.738675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:30.738675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:30.738675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:30.738675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:30.738675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:30.738675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:30.738675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:30.738675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:30.738675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:30.738675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:30.738675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:30.738675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:30.738675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:30.738675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:30.739717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:30.739717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:30.739717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:30.739717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:30.739717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:30.739717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:30.739717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:30.739717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:30.739717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:30.739717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:30.739717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:30.739717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:30.739717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:30.739717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:30.739717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:30.739717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:30.739717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:30.740621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:30.740621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:30.740621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:30.740621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 342/702] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:30.740621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c49b2a-94d3-4330-88c7-a7bba342d0d2 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:30.765692 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7f6a7-f6f8-487d-97c1-5aebd031d572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:30.766370 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7f6a7-f6f8-487d-97c1-5aebd031d572 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:30.766653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7f6a7-f6f8-487d-97c1-5aebd031d572 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:30.767092 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7f6a7-f6f8-487d-97c1-5aebd031d572 None admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:30.767808 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7f6a7-f6f8-487d-97c1-5aebd031d572 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:30.768123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7f6a7-f6f8-487d-97c1-5aebd031d572 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:30.769591 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7f6a7-f6f8-487d-97c1-5aebd031d572 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:30.784390 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 361/703] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:30.785565 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943ede2-1c94-442b-9cbb-2b70cf326651 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:30.785871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943ede2-1c94-442b-9cbb-2b70cf326651 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:30.786158 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943ede2-1c94-442b-9cbb-2b70cf326651 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:30.787540 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 362/704] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:30.788081 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943ede2-1c94-442b-9cbb-2b70cf326651 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:30.858917 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c49b2a-94d3-4330-88c7-a7bba342d0d2 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:30.887461 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:30.895304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c2c25-6d66-4ecc-be19-363c5f844122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:30.895918 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c2c25-6d66-4ecc-be19-363c5f844122 None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:30.896310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c2c25-6d66-4ecc-be19-363c5f844122 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:30.896496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c2c25-6d66-4ecc-be19-363c5f844122 None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:30.897182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c2c25-6d66-4ecc-be19-363c5f844122 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:30.898724 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c2c25-6d66-4ecc-be19-363c5f844122 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:30.902708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:30.906653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943ede2-1c94-442b-9cbb-2b70cf326651 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:30.944286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071bb0f-242f-420d-a44b-fdb163afa9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:30.944895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071bb0f-242f-420d-a44b-fdb163afa9ac None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:30.945177 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071bb0f-242f-420d-a44b-fdb163afa9ac None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:30.945450 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071bb0f-242f-420d-a44b-fdb163afa9ac None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:30.946126 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071bb0f-242f-420d-a44b-fdb163afa9ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:30.946433 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071bb0f-242f-420d-a44b-fdb163afa9ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:30.947868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071bb0f-242f-420d-a44b-fdb163afa9ac None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:30.959381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 363/705] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:30.960178 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071bb0f-242f-420d-a44b-fdb163afa9ac None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:31.040211 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 343/706] 10.222.0.79 () {60 vars in 1132 bytes} [Fri Sep 2 21:02:30 2022] POST /identity/v3/users => generated 254 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:31.041589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43d25e-1e42-44ab-9956-9276ee46db20 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:31.041997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43d25e-1e42-44ab-9956-9276ee46db20 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:31.042353 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43d25e-1e42-44ab-9956-9276ee46db20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:31.065088 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071bb0f-242f-420d-a44b-fdb163afa9ac None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:31.076634 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-5f43d25e-1e42-44ab-9956-9276ee46db20 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:31.078043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-5f43d25e-1e42-44ab-9956-9276ee46db20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:31.113637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccf6bf-84b4-44f3-a9b2-ca8f30937a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:31.114582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccf6bf-84b4-44f3-a9b2-ca8f30937a62 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:31.115014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccf6bf-84b4-44f3-a9b2-ca8f30937a62 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:31.115465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccf6bf-84b4-44f3-a9b2-ca8f30937a62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:31.116382 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccf6bf-84b4-44f3-a9b2-ca8f30937a62 None admin] RBAC: Adding query filter params (role.id=1c1ddcbda0754702bb016952e90405ca, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=3da2b1dc9dae413a8ee63ad67e840f8c) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:31.116695 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccf6bf-84b4-44f3-a9b2-ca8f30937a62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:31.118195 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccf6bf-84b4-44f3-a9b2-ca8f30937a62 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:31.133619 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 364/707] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:30 2022] GET /identity/v3/role_assignments?user.id=3da2b1dc9dae413a8ee63ad67e840f8c&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=1c1ddcbda0754702bb016952e90405ca => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:31.133619 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303dd9c-89f9-4e23-8ded-e99a485c6d90 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:31.133619 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303dd9c-89f9-4e23-8ded-e99a485c6d90 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:31.133619 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303dd9c-89f9-4e23-8ded-e99a485c6d90 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:31.133619 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 365/708] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:31.133619 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303dd9c-89f9-4e23-8ded-e99a485c6d90 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:31.166881 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:31.171909 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 344/709] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:31.174089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d9ff2-d56b-419f-ba1d-2ba74a8d9f05 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:31.174448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d9ff2-d56b-419f-ba1d-2ba74a8d9f05 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:31.174967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d9ff2-d56b-419f-ba1d-2ba74a8d9f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:31.197975 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-0b3d9ff2-d56b-419f-ba1d-2ba74a8d9f05 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:31.199292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-0b3d9ff2-d56b-419f-ba1d-2ba74a8d9f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:31.271246 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303dd9c-89f9-4e23-8ded-e99a485c6d90 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:31.296076 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 345/710] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:31.328102 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd593c43-fbd1-44c4-87ca-b2c96b5336f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:31.329978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd593c43-fbd1-44c4-87ca-b2c96b5336f2 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:31.330485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd593c43-fbd1-44c4-87ca-b2c96b5336f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:31.330951 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd593c43-fbd1-44c4-87ca-b2c96b5336f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:31.339567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd593c43-fbd1-44c4-87ca-b2c96b5336f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:31.341332 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd593c43-fbd1-44c4-87ca-b2c96b5336f2 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:31.365955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-fd593c43-fbd1-44c4-87ca-b2c96b5336f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:31.365955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:31.365955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:31.365955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:31.365955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:31.365955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:31.365955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:31.365955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:31.365955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:31.365955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:31.365955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:31.365955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:31.365955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:31.365955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:31.365955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:31.366895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:31.366895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:31.366895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:31.366895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:31.366895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:31.366895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:31.366895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:31.366895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:31.366895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:31.366895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:31.366895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:31.366895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:31.366895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:31.366895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:31.366895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:31.366895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:31.366895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:31.367784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:31.367784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:31.367784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:31.367784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:31.367784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:31.367784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:31.367784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:31.367784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:31.367784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 366/711] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:31.374978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d9ff2-d56b-419f-ba1d-2ba74a8d9f05 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:31.435024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:31.485145 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd593c43-fbd1-44c4-87ca-b2c96b5336f2 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:31.500553 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d9ff2-d56b-419f-ba1d-2ba74a8d9f05 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:31.549002 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5ab3d-c779-4e82-ad08-9cae2302f9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:31.549874 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5ab3d-c779-4e82-ad08-9cae2302f9b1 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:31.550167 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5ab3d-c779-4e82-ad08-9cae2302f9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:31.550446 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5ab3d-c779-4e82-ad08-9cae2302f9b1 None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:31.551319 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5ab3d-c779-4e82-ad08-9cae2302f9b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:31.551640 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5ab3d-c779-4e82-ad08-9cae2302f9b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:31.553774 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5ab3d-c779-4e82-ad08-9cae2302f9b1 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:31.573046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 346/712] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:31.579363 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5ab3d-c779-4e82-ad08-9cae2302f9b1 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:31.614301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:31.638015 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd593c43-fbd1-44c4-87ca-b2c96b5336f2 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:31.681007 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb3072-38cc-4321-b3a9-f9f53007ebf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:31.681650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb3072-38cc-4321-b3a9-f9f53007ebf5 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:31.682005 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb3072-38cc-4321-b3a9-f9f53007ebf5 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:31.682244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb3072-38cc-4321-b3a9-f9f53007ebf5 None admin] PATH_INFO: `/v3/services/network` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:31.682841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb3072-38cc-4321-b3a9-f9f53007ebf5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:31.684228 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb3072-38cc-4321-b3a9-f9f53007ebf5 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:31.701637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-a4eb3072-38cc-4321-b3a9-f9f53007ebf5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 21:02:31.701637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:31.701637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:31.701637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:31.701637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:31.701637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:31.701637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:31.701637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:31.701637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 21:02:31.701637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:31.701637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:31.701637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:31.701637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:31.701637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:31.701637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:31.701637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:31.701637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:31.702733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:31.702733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:31.702733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:31.702733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:31.702733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:31.702733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:31.702733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:31.702733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:31.702733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:31.702733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:31.702733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:31.702733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:31.702733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:31.702733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:31.702733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:31.702733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:31.704495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:31.704495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:31.704495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:31.704495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:31.704495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:31.704495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:31.704495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:31.704495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:31.704495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:31.704495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:31.704495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:31.704495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:31.704495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 21:02:31.704495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:31.709421 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 367/713] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:31 2022] GET /identity/v3/services/network => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:31.710450 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb3072-38cc-4321-b3a9-f9f53007ebf5 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:31.711472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5ab3d-c779-4e82-ad08-9cae2302f9b1 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:31.714461 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:31.749553 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e98ba4-3a0b-403f-983d-564831d9dcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:31.750205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e98ba4-3a0b-403f-983d-564831d9dcc3 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:31.751077 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e98ba4-3a0b-403f-983d-564831d9dcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:31.751410 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e98ba4-3a0b-403f-983d-564831d9dcc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:31.752091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e98ba4-3a0b-403f-983d-564831d9dcc3 None admin] RBAC: Adding query filter params (role.id=32e6a7f83b444d1ca9e5891a2b175f9a, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=632071470f7d409ab7b0129d120320c7) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:31.752415 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e98ba4-3a0b-403f-983d-564831d9dcc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:31.753923 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e98ba4-3a0b-403f-983d-564831d9dcc3 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:31.760898 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 347/714] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:31 2022] GET /identity/v3/role_assignments?user.id=632071470f7d409ab7b0129d120320c7&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=32e6a7f83b444d1ca9e5891a2b175f9a => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:31.770118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e98ba4-3a0b-403f-983d-564831d9dcc3 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:31.826915 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb3072-38cc-4321-b3a9-f9f53007ebf5 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:31.870829 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ab6cc-2e5b-4601-91f1-1716bd40e36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:31.871474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ab6cc-2e5b-4601-91f1-1716bd40e36e None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:31.871758 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ab6cc-2e5b-4601-91f1-1716bd40e36e None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:31.872054 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ab6cc-2e5b-4601-91f1-1716bd40e36e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:31.872902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ab6cc-2e5b-4601-91f1-1716bd40e36e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:31.874360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ab6cc-2e5b-4601-91f1-1716bd40e36e None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:31.892571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-b09ab6cc-2e5b-4601-91f1-1716bd40e36e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 21:02:31.892571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:31.892571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:31.892571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:31.892571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:31.892571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:31.892571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:31.892571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:31.892571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 21:02:31.892571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:31.892571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:31.892571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:31.892571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:31.892571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:31.892571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:31.892571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:31.892571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:31.894728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:31.894728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:31.894728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:31.894728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:31.894728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:31.894728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:31.894728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:31.894728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:31.894728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:31.894728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:31.894728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:31.894728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:31.894728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:31.894728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:31.894728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:31.894728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:31.895926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:31.895926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:31.895926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:31.895926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:31.895926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:31.895926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:31.895926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:31.895926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:31.895926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:31.895926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:31.895926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:31.895926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:31.895926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 21:02:31.895926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:31.895926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 368/715] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Sep 2 21:02:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:31.903005 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ab6cc-2e5b-4601-91f1-1716bd40e36e None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:31.929014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:32.004023 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e98ba4-3a0b-403f-983d-564831d9dcc3 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:32.023456 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ab6cc-2e5b-4601-91f1-1716bd40e36e None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:32.063436 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfe2d3-00d6-462c-8724-05a038e82e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:32.064060 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfe2d3-00d6-462c-8724-05a038e82e8d None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:32.064349 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfe2d3-00d6-462c-8724-05a038e82e8d None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:32.064632 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfe2d3-00d6-462c-8724-05a038e82e8d None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:32.065276 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfe2d3-00d6-462c-8724-05a038e82e8d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:32.065585 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfe2d3-00d6-462c-8724-05a038e82e8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:32.067180 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfe2d3-00d6-462c-8724-05a038e82e8d None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:32.072282 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 369/716] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Sep 2 21:02:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:32.078156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfe2d3-00d6-462c-8724-05a038e82e8d None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:32.093276 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a986bc-4d98-4cd6-8e4c-5d4935cbf1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:32.093979 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a986bc-4d98-4cd6-8e4c-5d4935cbf1ba None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:32.094325 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a986bc-4d98-4cd6-8e4c-5d4935cbf1ba None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:32.094604 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a986bc-4d98-4cd6-8e4c-5d4935cbf1ba None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:32.095261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a986bc-4d98-4cd6-8e4c-5d4935cbf1ba None admin] RBAC: Adding query filter params (name=network) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:32.095569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a986bc-4d98-4cd6-8e4c-5d4935cbf1ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:32.096975 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a986bc-4d98-4cd6-8e4c-5d4935cbf1ba None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:32.107707 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 348/717] 10.222.0.79 () {56 vars in 1112 bytes} [Fri Sep 2 21:02:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:32.114275 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a986bc-4d98-4cd6-8e4c-5d4935cbf1ba None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:32.156251 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:32.220164 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:32.265536 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfe2d3-00d6-462c-8724-05a038e82e8d None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:32.286207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a986bc-4d98-4cd6-8e4c-5d4935cbf1ba None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:32.336114 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c01f5-df34-4ec8-9c67-53cc013e315c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:32.336649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c01f5-df34-4ec8-9c67-53cc013e315c None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:32.336934 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c01f5-df34-4ec8-9c67-53cc013e315c None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:32.337213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c01f5-df34-4ec8-9c67-53cc013e315c None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:32.337872 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c01f5-df34-4ec8-9c67-53cc013e315c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:32.338185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c01f5-df34-4ec8-9c67-53cc013e315c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:32.339572 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c01f5-df34-4ec8-9c67-53cc013e315c None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:32.349107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ac5c1-24e8-4059-b90b-8f3b43ba0e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:32.349730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ac5c1-24e8-4059-b90b-8f3b43ba0e22 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:32.350036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ac5c1-24e8-4059-b90b-8f3b43ba0e22 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:32.350310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ac5c1-24e8-4059-b90b-8f3b43ba0e22 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:32.351140 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ac5c1-24e8-4059-b90b-8f3b43ba0e22 None admin] RBAC: Adding query filter params (type=network) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:32.351450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ac5c1-24e8-4059-b90b-8f3b43ba0e22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:32.353081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ac5c1-24e8-4059-b90b-8f3b43ba0e22 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:32.356299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 370/718] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Sep 2 21:02:32 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:32.361942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 349/719] 10.222.0.79 () {56 vars in 1112 bytes} [Fri Sep 2 21:02:32 2022] GET /identity/v3/services?type=network => generated 124 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:33.435275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8e0cf-084d-43b2-8dde-79117302eab6 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:33.436021 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8e0cf-084d-43b2-8dde-79117302eab6 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:33.436021 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8e0cf-084d-43b2-8dde-79117302eab6 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:33.437307 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 371/720] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:33.443521 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff744f0-9cf7-4e18-8c1a-c0e095c6a44f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:33.444058 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff744f0-9cf7-4e18-8c1a-c0e095c6a44f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:33.444230 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff744f0-9cf7-4e18-8c1a-c0e095c6a44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:33.466844 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-1ff744f0-9cf7-4e18-8c1a-c0e095c6a44f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:33.468057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-1ff744f0-9cf7-4e18-8c1a-c0e095c6a44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:33.559486 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 350/721] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:33.895845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1843c0d-29ea-4806-a643-253328ca4973 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:33.896253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1843c0d-29ea-4806-a643-253328ca4973 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:33.896430 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1843c0d-29ea-4806-a643-253328ca4973 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:33.898086 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 372/722] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:33.903794 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af571855-7f46-4db1-b55d-643aab4d871f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:33.904222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af571855-7f46-4db1-b55d-643aab4d871f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:33.904392 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af571855-7f46-4db1-b55d-643aab4d871f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:33.929494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-af571855-7f46-4db1-b55d-643aab4d871f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:33.930705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-af571855-7f46-4db1-b55d-643aab4d871f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:33.960863 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:33.980370 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1843c0d-29ea-4806-a643-253328ca4973 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:34.053135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 351/723] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:34.161606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1843c0d-29ea-4806-a643-253328ca4973 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:34.209988 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd0435-eccb-496b-9b90-e1ce31433180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:34.211043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd0435-eccb-496b-9b90-e1ce31433180 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:34.211523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd0435-eccb-496b-9b90-e1ce31433180 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:34.212018 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd0435-eccb-496b-9b90-e1ce31433180 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:34.224830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b8cf7-ca15-4692-9361-5e1ee3d07bad None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:34.225131 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b8cf7-ca15-4692-9361-5e1ee3d07bad None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:34.225400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b8cf7-ca15-4692-9361-5e1ee3d07bad None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:34.227015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 352/724] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:02:34.228134 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:34.232219 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef51f5-8658-4dad-8746-195ccc0a7eb2 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:34.232524 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef51f5-8658-4dad-8746-195ccc0a7eb2 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:34.232823 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef51f5-8658-4dad-8746-195ccc0a7eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:34.233321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd0435-eccb-496b-9b90-e1ce31433180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:34.239258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-09dd0435-eccb-496b-9b90-e1ce31433180 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:34.239258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:34.239258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:34.239258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:34.239258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:34.239258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:34.239258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:34.239258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:34.239258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:34.239258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:34.239258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:34.239258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:34.239258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:34.239258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:34.239258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:34.239258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:34.246419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:34.246419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:34.246419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:34.246419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:34.246419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:34.246419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:34.246419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:34.246419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:34.246419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:34.246419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:34.246419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:34.246419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:34.246419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:34.246419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:34.246419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:34.246419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:34.247435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:34.247435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:34.247435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:34.247435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:34.247435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:34.247435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:34.247435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:34.247435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:34.247435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:34.247435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:34.247435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:34.247435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:34.247435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 373/725] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:02:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:34.249127 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd0435-eccb-496b-9b90-e1ce31433180 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:34.294920 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-31ef51f5-8658-4dad-8746-195ccc0a7eb2 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:34.296178 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-31ef51f5-8658-4dad-8746-195ccc0a7eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:34.361160 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd0435-eccb-496b-9b90-e1ce31433180 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:34.398716 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e8b5d-8621-4c95-a7a4-05d0d926f9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:34.399753 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e8b5d-8621-4c95-a7a4-05d0d926f9d5 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:34.400297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e8b5d-8621-4c95-a7a4-05d0d926f9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:34.400814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e8b5d-8621-4c95-a7a4-05d0d926f9d5 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:34.401695 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e8b5d-8621-4c95-a7a4-05d0d926f9d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:34.402230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e8b5d-8621-4c95-a7a4-05d0d926f9d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:34.403897 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e8b5d-8621-4c95-a7a4-05d0d926f9d5 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:34.412083 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 353/726] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 02 21:02:34.412938 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef51f5-8658-4dad-8746-195ccc0a7eb2 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:34.419258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 374/727] 10.222.0.79 () {56 vars in 1103 bytes} [Fri Sep 2 21:02:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:34.421105 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e8b5d-8621-4c95-a7a4-05d0d926f9d5 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:34.489461 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:34.561835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e8b5d-8621-4c95-a7a4-05d0d926f9d5 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:34.562035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:34.567389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef51f5-8658-4dad-8746-195ccc0a7eb2 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:34.633911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4f37a-357d-4040-980b-2bebd61d7fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:34.634567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4f37a-357d-4040-980b-2bebd61d7fa4 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:34.634852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4f37a-357d-4040-980b-2bebd61d7fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:34.635130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4f37a-357d-4040-980b-2bebd61d7fa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:34.635714 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b34e85-d38a-4e30-974a-c385f473a738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:34.636625 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b34e85-d38a-4e30-974a-c385f473a738 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:34.637099 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b34e85-d38a-4e30-974a-c385f473a738 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:34.637931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b34e85-d38a-4e30-974a-c385f473a738 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:34.648739 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4f37a-357d-4040-980b-2bebd61d7fa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:34.650509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4f37a-357d-4040-980b-2bebd61d7fa4 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:34.665973 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b34e85-d38a-4e30-974a-c385f473a738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:34.667880 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-2fe4f37a-357d-4040-980b-2bebd61d7fa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:34.667880 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:34.667880 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:34.667880 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:34.667880 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:34.667880 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:34.667880 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:34.667880 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:34.667880 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:34.667880 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:34.667880 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:34.667880 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:34.667880 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:34.667880 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:34.667880 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:34.667880 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:34.668826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:34.668826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:34.668826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:34.668826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:34.668826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:34.668826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:34.668826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:34.668826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:34.668826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:34.668826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:34.668826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:34.668826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:34.668826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:34.668826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:34.668826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:34.668826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:34.668826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:34.670036 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:34.670036 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:34.670036 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:34.670036 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 375/728] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:34.679586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-99b34e85-d38a-4e30-974a-c385f473a738 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:02:34.679586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:34.679586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:34.679586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:34.679586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:34.679586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:34.679586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:34.679586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:34.679586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:34.679586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:34.679586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:34.679586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:34.679586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:34.679586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:34.679586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:34.679586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:34.681000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:34.681000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:34.681000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:34.681000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:34.681000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:34.681000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:34.681000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:34.681000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:34.681000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:34.681000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:34.681000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:34.681000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:34.681000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:34.681000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:34.681000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:34.681000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:34.681931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:34.681931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:34.681931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:34.681931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:34.681931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:34.681931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:34.681931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:34.681931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:34.681931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:34.681931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:34.681931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:02:34.681931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:34.682570 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4f37a-357d-4040-980b-2bebd61d7fa4 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:34.682644 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 354/729] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:02:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:34.684982 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b34e85-d38a-4e30-974a-c385f473a738 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:34.827233 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b34e85-d38a-4e30-974a-c385f473a738 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:34.834625 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4f37a-357d-4040-980b-2bebd61d7fa4 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:34.851000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:34.867081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3bfc5c-69fb-4b5e-b6ae-155151ebac8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:34.867841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bfc5c-69fb-4b5e-b6ae-155151ebac8e None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:34.868105 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bfc5c-69fb-4b5e-b6ae-155151ebac8e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:34.868391 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bfc5c-69fb-4b5e-b6ae-155151ebac8e None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:34.869056 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3bfc5c-69fb-4b5e-b6ae-155151ebac8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:34.869364 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3bfc5c-69fb-4b5e-b6ae-155151ebac8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:34.870767 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3bfc5c-69fb-4b5e-b6ae-155151ebac8e None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:34.872531 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222da37e-3fd6-425d-b4a3-a037706feaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:34.873141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222da37e-3fd6-425d-b4a3-a037706feaee None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:34.873408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222da37e-3fd6-425d-b4a3-a037706feaee None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:34.873681 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222da37e-3fd6-425d-b4a3-a037706feaee None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:34.874357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222da37e-3fd6-425d-b4a3-a037706feaee None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:34.874659 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222da37e-3fd6-425d-b4a3-a037706feaee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:34.876297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222da37e-3fd6-425d-b4a3-a037706feaee None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:34.886389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 355/730] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:02:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:34.886389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3bfc5c-69fb-4b5e-b6ae-155151ebac8e None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:34.892910 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 376/731] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:34.897289 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597da47-52e6-4ec5-a262-4e9773a463be None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:34.897289 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597da47-52e6-4ec5-a262-4e9773a463be None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:34.897289 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597da47-52e6-4ec5-a262-4e9773a463be None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:34.897289 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 377/732] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:34.899032 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597da47-52e6-4ec5-a262-4e9773a463be None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:34.903915 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:35.002573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3bfc5c-69fb-4b5e-b6ae-155151ebac8e None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:35.021354 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597da47-52e6-4ec5-a262-4e9773a463be None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:35.041168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7f438-7603-4550-a723-33288b5cc163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:35.041830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7f438-7603-4550-a723-33288b5cc163 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:35.042115 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7f438-7603-4550-a723-33288b5cc163 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:35.042393 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7f438-7603-4550-a723-33288b5cc163 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:35.054021 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7f438-7603-4550-a723-33288b5cc163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:35.059262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-10b7f438-7603-4550-a723-33288b5cc163 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:02:35.059262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:35.059262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:35.059262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:35.059262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:35.059262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:35.059262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:35.059262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:35.059262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:35.059262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:35.059262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:35.059262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:35.059262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:35.059262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:35.059262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:35.059262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:35.060273 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:35.060273 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:35.060273 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:35.060273 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:35.060273 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:35.060273 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:35.060273 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:35.060273 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:35.060273 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:35.060273 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:35.060273 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:35.060273 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:35.060273 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:35.060273 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:35.060273 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:35.060273 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:35.061127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:35.061127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:35.061127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:35.061127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:35.061127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:35.061127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:35.061127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:35.061127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:35.061127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:35.061127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:35.061127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:02:35.061127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:35.062499 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082f9d5-667f-4de9-b863-9ee6604e63c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:35.062601 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 356/733] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:02:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:35.062689 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082f9d5-667f-4de9-b863-9ee6604e63c7 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:35.062689 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082f9d5-667f-4de9-b863-9ee6604e63c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:35.062689 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082f9d5-667f-4de9-b863-9ee6604e63c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:35.063593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7f438-7603-4550-a723-33288b5cc163 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:35.074388 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082f9d5-667f-4de9-b863-9ee6604e63c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:35.075840 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082f9d5-667f-4de9-b863-9ee6604e63c7 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:35.092344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-8082f9d5-667f-4de9-b863-9ee6604e63c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:35.092344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:35.092344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:35.092344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:35.092344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:35.092344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:35.092344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:35.092344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:35.092344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:35.092344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:35.092344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:35.092344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:35.092344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:35.092344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:35.092344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:35.092344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:35.094623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:35.094623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:35.094623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:35.094623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:35.094623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:35.094623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:35.094623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:35.094623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:35.094623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:35.094623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:35.094623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:35.094623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:35.094623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:35.094623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:35.094623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:35.094623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:35.094623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:35.095853 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:35.095853 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:35.095853 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:35.097056 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 378/734] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:35.098352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd706cda-b3f7-4326-9a7a-96880587ac3e None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:35.098663 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd706cda-b3f7-4326-9a7a-96880587ac3e None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:35.099023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd706cda-b3f7-4326-9a7a-96880587ac3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:35.117820 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-cd706cda-b3f7-4326-9a7a-96880587ac3e None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:35.119055 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-cd706cda-b3f7-4326-9a7a-96880587ac3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:35.131526 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:35.140949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:35.166080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7f438-7603-4550-a723-33288b5cc163 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:35.188517 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 379/735] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:35.189831 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189e126-335e-453c-b755-1147f90c4415 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:35.190125 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189e126-335e-453c-b755-1147f90c4415 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:35.190405 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189e126-335e-453c-b755-1147f90c4415 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:35.193983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 380/736] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:35.193983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189e126-335e-453c-b755-1147f90c4415 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:35.204872 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175365c2-39fd-4e11-a636-9f21992c48ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:35.205747 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175365c2-39fd-4e11-a636-9f21992c48ea None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:35.206209 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175365c2-39fd-4e11-a636-9f21992c48ea None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:35.206628 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175365c2-39fd-4e11-a636-9f21992c48ea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:35.214968 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175365c2-39fd-4e11-a636-9f21992c48ea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:35.216614 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175365c2-39fd-4e11-a636-9f21992c48ea None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:35.230186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-175365c2-39fd-4e11-a636-9f21992c48ea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:02:35.230186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:35.230186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:35.230186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:35.230186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:35.230186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:35.230186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:35.230186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:35.230186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:35.230186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:35.230186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:35.230186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:35.230186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:35.230186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:35.230186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:35.230186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:35.231378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:35.231378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:35.231378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:35.231378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:35.231378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:35.231378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:35.231378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:35.231378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:35.231378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:35.231378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:35.231378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:35.231378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:35.231378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:35.231378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:35.231378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:35.231378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:35.231378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:35.231378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:35.232503 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:35.232503 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:35.232503 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:35.232503 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:35.232503 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:35.232503 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:35.232503 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:35.232503 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:35.232503 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:02:35.232503 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:35.234504 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 357/737] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Sep 2 21:02:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:35.236156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175365c2-39fd-4e11-a636-9f21992c48ea None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:35.318887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189e126-335e-453c-b755-1147f90c4415 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:35.355176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175365c2-39fd-4e11-a636-9f21992c48ea None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:35.364000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa31e4-1700-4bd1-bb7d-ab03b0408375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:35.364601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa31e4-1700-4bd1-bb7d-ab03b0408375 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:35.364886 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa31e4-1700-4bd1-bb7d-ab03b0408375 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:35.365161 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa31e4-1700-4bd1-bb7d-ab03b0408375 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:35.365871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa31e4-1700-4bd1-bb7d-ab03b0408375 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:35.366174 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa31e4-1700-4bd1-bb7d-ab03b0408375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:35.367560 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa31e4-1700-4bd1-bb7d-ab03b0408375 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:35.377133 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 381/738] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:02:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:35.378420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d17cb-d4c9-47dc-b92a-3590011f3d78 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:35.378711 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d17cb-d4c9-47dc-b92a-3590011f3d78 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:35.379120 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d17cb-d4c9-47dc-b92a-3590011f3d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:35.395333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:35.398113 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-e78d17cb-d4c9-47dc-b92a-3590011f3d78 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:35.399485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-e78d17cb-d4c9-47dc-b92a-3590011f3d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:35.407128 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00d65e-da0d-49ae-b441-0d1ad48e46e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:35.408270 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00d65e-da0d-49ae-b441-0d1ad48e46e8 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:35.408560 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00d65e-da0d-49ae-b441-0d1ad48e46e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:35.408872 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00d65e-da0d-49ae-b441-0d1ad48e46e8 None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:35.409561 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00d65e-da0d-49ae-b441-0d1ad48e46e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:35.410273 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00d65e-da0d-49ae-b441-0d1ad48e46e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:35.412037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00d65e-da0d-49ae-b441-0d1ad48e46e8 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:35.414198 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:35.424800 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 358/739] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:35.425483 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00d65e-da0d-49ae-b441-0d1ad48e46e8 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:35.493837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 382/740] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 02 21:02:35.493837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d17cb-d4c9-47dc-b92a-3590011f3d78 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:35.544851 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00d65e-da0d-49ae-b441-0d1ad48e46e8 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:35.582756 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c42df-f8fb-40f5-8219-f0385a7f92b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:35.583812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c42df-f8fb-40f5-8219-f0385a7f92b6 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:35.584073 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c42df-f8fb-40f5-8219-f0385a7f92b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:35.584363 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c42df-f8fb-40f5-8219-f0385a7f92b6 None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:35.585107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c42df-f8fb-40f5-8219-f0385a7f92b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:35.585410 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c42df-f8fb-40f5-8219-f0385a7f92b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:35.587224 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c42df-f8fb-40f5-8219-f0385a7f92b6 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:35.611538 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 359/741] 10.222.0.79 () {56 vars in 1149 bytes} [Fri Sep 2 21:02:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:35.611538 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c42df-f8fb-40f5-8219-f0385a7f92b6 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:35.616698 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d17cb-d4c9-47dc-b92a-3590011f3d78 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:35.654645 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0e2c7-06aa-4800-bb49-c22600224a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:35.655312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0e2c7-06aa-4800-bb49-c22600224a85 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:35.655572 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0e2c7-06aa-4800-bb49-c22600224a85 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:35.655844 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0e2c7-06aa-4800-bb49-c22600224a85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:35.660181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:35.666890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0e2c7-06aa-4800-bb49-c22600224a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:35.668362 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0e2c7-06aa-4800-bb49-c22600224a85 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:35.680564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:35.685391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-bbf0e2c7-06aa-4800-bb49-c22600224a85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:35.685391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:35.685391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:35.685391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:35.685391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:35.685391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:35.685391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:35.685391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:35.685391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:35.685391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:35.685391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:35.685391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:35.685391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:35.685391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:35.685391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:35.685391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:35.686447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:35.686447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:35.686447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:35.686447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:35.686447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:35.686447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:35.686447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:35.686447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:35.686447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:35.686447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:35.686447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:35.686447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:35.686447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:35.686447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:35.686447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:35.686447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:35.686447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:35.687341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:35.687341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:35.687341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:35.687341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 383/742] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:35.687341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0e2c7-06aa-4800-bb49-c22600224a85 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:35.735251 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c42df-f8fb-40f5-8219-f0385a7f92b6 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:35.771781 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dad572-4f3a-4aa4-9586-8f22dd187e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:35.772422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dad572-4f3a-4aa4-9586-8f22dd187e43 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:35.772710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dad572-4f3a-4aa4-9586-8f22dd187e43 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:35.772987 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dad572-4f3a-4aa4-9586-8f22dd187e43 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:35.780610 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dad572-4f3a-4aa4-9586-8f22dd187e43 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:35.782850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dad572-4f3a-4aa4-9586-8f22dd187e43 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:35.794925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-e4dad572-4f3a-4aa4-9586-8f22dd187e43 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:02:35.794925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:35.794925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:35.794925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:35.794925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:35.794925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:35.794925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:35.794925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:35.794925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:35.794925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:35.794925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:35.794925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:35.794925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:35.794925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:35.794925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:35.794925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:35.795962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:35.795962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:35.795962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:35.795962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:35.795962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:35.795962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:35.795962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:35.795962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:35.795962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:35.795962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:35.795962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:35.795962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:35.795962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:35.795962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:35.795962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:35.795962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:35.795962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:35.795962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:35.796911 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:35.796911 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:35.796911 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:35.796911 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:35.796911 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:35.796911 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:35.796911 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:35.796911 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:35.796911 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:02:35.796911 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:35.796911 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 360/743] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:02:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:35.797626 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dad572-4f3a-4aa4-9586-8f22dd187e43 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:35.809762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0e2c7-06aa-4800-bb49-c22600224a85 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:35.846782 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042231f-e480-4b9d-a16e-7557d5de3729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:35.847383 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042231f-e480-4b9d-a16e-7557d5de3729 None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:35.847667 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042231f-e480-4b9d-a16e-7557d5de3729 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:35.847945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042231f-e480-4b9d-a16e-7557d5de3729 None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:35.848592 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042231f-e480-4b9d-a16e-7557d5de3729 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:35.850060 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042231f-e480-4b9d-a16e-7557d5de3729 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:35.899591 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dad572-4f3a-4aa4-9586-8f22dd187e43 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:35.906265 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:35.933462 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100122b-422e-4810-8173-7f9a06d7f183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:35.934127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100122b-422e-4810-8173-7f9a06d7f183 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:35.934418 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100122b-422e-4810-8173-7f9a06d7f183 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:35.934720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100122b-422e-4810-8173-7f9a06d7f183 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:35.965793 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 384/744] 10.222.0.79 () {60 vars in 1141 bytes} [Fri Sep 2 21:02:35 2022] POST /identity/v3/services => generated 240 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:35.966413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042231f-e480-4b9d-a16e-7557d5de3729 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:36.016537 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100122b-422e-4810-8173-7f9a06d7f183 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:36.018295 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100122b-422e-4810-8173-7f9a06d7f183 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:36.044828 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:36.102389 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042231f-e480-4b9d-a16e-7557d5de3729 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:36.143981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 361/745] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 02 21:02:36.143981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100122b-422e-4810-8173-7f9a06d7f183 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:36.145642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03735ebc-e4be-4d0b-bd35-8c5cb68d2269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:36.146290 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735ebc-e4be-4d0b-bd35-8c5cb68d2269 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:36.146581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735ebc-e4be-4d0b-bd35-8c5cb68d2269 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:36.146856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735ebc-e4be-4d0b-bd35-8c5cb68d2269 None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:36.147509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03735ebc-e4be-4d0b-bd35-8c5cb68d2269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:36.147816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03735ebc-e4be-4d0b-bd35-8c5cb68d2269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:36.149216 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03735ebc-e4be-4d0b-bd35-8c5cb68d2269 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:36.153781 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:36.165219 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 385/746] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:36.165219 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03735ebc-e4be-4d0b-bd35-8c5cb68d2269 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:36.259056 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100122b-422e-4810-8173-7f9a06d7f183 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:36.281771 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03735ebc-e4be-4d0b-bd35-8c5cb68d2269 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:36.295134 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236e6e2-9634-417b-8009-f884292694c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:36.295741 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236e6e2-9634-417b-8009-f884292694c4 None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:36.296024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236e6e2-9634-417b-8009-f884292694c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:36.296301 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236e6e2-9634-417b-8009-f884292694c4 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:36.296968 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236e6e2-9634-417b-8009-f884292694c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:36.298563 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236e6e2-9634-417b-8009-f884292694c4 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:36.302235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:36.321589 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887714d-9dfd-414e-a9ba-1e49310df7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:36.322227 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887714d-9dfd-414e-a9ba-1e49310df7bb None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:36.322562 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887714d-9dfd-414e-a9ba-1e49310df7bb None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:36.322845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887714d-9dfd-414e-a9ba-1e49310df7bb None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:36.323572 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887714d-9dfd-414e-a9ba-1e49310df7bb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:36.323881 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887714d-9dfd-414e-a9ba-1e49310df7bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:36.325302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887714d-9dfd-414e-a9ba-1e49310df7bb None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:36.349633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 386/747] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Sep 2 21:02:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:36.349633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887714d-9dfd-414e-a9ba-1e49310df7bb None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:36.366337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 362/748] 10.222.0.79 () {60 vars in 1141 bytes} [Fri Sep 2 21:02:36 2022] POST /identity/v3/services => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:36.367251 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236e6e2-9634-417b-8009-f884292694c4 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:36.468731 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:36.485616 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887714d-9dfd-414e-a9ba-1e49310df7bb None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:36.529272 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236e6e2-9634-417b-8009-f884292694c4 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:36.533019 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c09767-132e-4739-bf5c-2bc3dddc05d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:36.534278 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c09767-132e-4739-bf5c-2bc3dddc05d3 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:36.534706 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c09767-132e-4739-bf5c-2bc3dddc05d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:36.535120 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c09767-132e-4739-bf5c-2bc3dddc05d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:36.547837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c09767-132e-4739-bf5c-2bc3dddc05d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:36.549906 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c09767-132e-4739-bf5c-2bc3dddc05d3 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:36.567093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-c7c09767-132e-4739-bf5c-2bc3dddc05d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:36.567093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:36.567093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:36.567093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:36.567093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:36.567093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:36.567093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:36.567093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:36.567093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:36.567093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:36.567093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:36.567093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:36.567093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:36.567093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:36.567093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:36.567093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:36.568191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:36.568191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:36.568191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:36.568191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:36.568191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:36.568191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:36.568191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:36.568191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:36.568191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:36.568191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:36.568191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:36.568191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:36.568191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:36.568191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:36.568191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:36.568191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:36.568191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:36.569078 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:36.569078 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:36.569078 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:36.571375 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57cd18-79f2-425b-8a3b-8284762644ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:36.571633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 387/749] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:36.572158 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57cd18-79f2-425b-8a3b-8284762644ae None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:36.572505 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57cd18-79f2-425b-8a3b-8284762644ae None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:36.572847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57cd18-79f2-425b-8a3b-8284762644ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:36.573205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c09767-132e-4739-bf5c-2bc3dddc05d3 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:36.588796 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57cd18-79f2-425b-8a3b-8284762644ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:36.590565 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57cd18-79f2-425b-8a3b-8284762644ae None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:36.602540 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:36.607054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-ba57cd18-79f2-425b-8a3b-8284762644ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:02:36.607054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:36.607054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:36.607054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:36.607054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:36.607054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:36.607054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:36.607054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:36.607054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:36.607054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:36.607054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:36.607054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:36.607054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:36.607054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:36.607054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:36.607054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:36.607997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:36.607997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:36.607997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:36.607997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:36.607997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:36.607997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:36.607997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:36.607997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:36.607997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:36.607997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:36.607997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:36.607997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:36.607997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:36.607997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:36.607997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:36.607997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:36.607997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:36.607997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:36.609100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:36.609100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:36.609100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:36.609100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:36.609100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:36.609100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:36.609100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:36.609100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:36.609100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:02:36.609100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:36.609100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 363/750] 10.222.0.79 () {56 vars in 1093 bytes} [Fri Sep 2 21:02:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:36.610351 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57cd18-79f2-425b-8a3b-8284762644ae None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:36.721974 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c09767-132e-4739-bf5c-2bc3dddc05d3 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:36.758109 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57cd18-79f2-425b-8a3b-8284762644ae None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:36.765706 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e528bb-fdc8-4650-9e16-b2e583cb6367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:36.767668 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e528bb-fdc8-4650-9e16-b2e583cb6367 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:36.767955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e528bb-fdc8-4650-9e16-b2e583cb6367 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:36.768238 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e528bb-fdc8-4650-9e16-b2e583cb6367 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:36.785948 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:36.798720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862f65c-679c-4c3b-aed4-55c5a07f01aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:36.799334 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862f65c-679c-4c3b-aed4-55c5a07f01aa None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:36.799616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862f65c-679c-4c3b-aed4-55c5a07f01aa None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:36.799892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862f65c-679c-4c3b-aed4-55c5a07f01aa None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:36.800616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862f65c-679c-4c3b-aed4-55c5a07f01aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:36.800921 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862f65c-679c-4c3b-aed4-55c5a07f01aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:36.802377 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862f65c-679c-4c3b-aed4-55c5a07f01aa None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:36.819783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 364/751] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:36.819783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862f65c-679c-4c3b-aed4-55c5a07f01aa None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:36.917280 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e528bb-fdc8-4650-9e16-b2e583cb6367 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:36.919749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e528bb-fdc8-4650-9e16-b2e583cb6367 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:36.940724 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862f65c-679c-4c3b-aed4-55c5a07f01aa None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:36.951555 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:37.014340 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246c702-6e58-4fb1-83be-dc662f2e90ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:37.015090 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246c702-6e58-4fb1-83be-dc662f2e90ab None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:37.015386 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246c702-6e58-4fb1-83be-dc662f2e90ab None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:37.015669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246c702-6e58-4fb1-83be-dc662f2e90ab None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:37.017298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246c702-6e58-4fb1-83be-dc662f2e90ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:37.017739 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246c702-6e58-4fb1-83be-dc662f2e90ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:37.019430 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246c702-6e58-4fb1-83be-dc662f2e90ab None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:37.052463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 365/752] 10.222.0.79 () {56 vars in 1133 bytes} [Fri Sep 2 21:02:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:37.052463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246c702-6e58-4fb1-83be-dc662f2e90ab None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:37.065164 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 388/753] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:02:37.066299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e528bb-fdc8-4650-9e16-b2e583cb6367 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:37.119405 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:37.184929 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246c702-6e58-4fb1-83be-dc662f2e90ab None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:37.195599 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e528bb-fdc8-4650-9e16-b2e583cb6367 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:37.225733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:37.230008 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe45d06-2eee-456d-9eb8-88934ef7cc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:37.230977 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe45d06-2eee-456d-9eb8-88934ef7cc6c None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:37.231264 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe45d06-2eee-456d-9eb8-88934ef7cc6c None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:37.231680 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe45d06-2eee-456d-9eb8-88934ef7cc6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:37.240048 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe45d06-2eee-456d-9eb8-88934ef7cc6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:37.240475 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85010f-c6fd-4dfa-85f0-3700482c5555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:37.241292 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85010f-c6fd-4dfa-85f0-3700482c5555 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:37.241525 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe45d06-2eee-456d-9eb8-88934ef7cc6c None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:37.242869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85010f-c6fd-4dfa-85f0-3700482c5555 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:37.243294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85010f-c6fd-4dfa-85f0-3700482c5555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:37.255897 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85010f-c6fd-4dfa-85f0-3700482c5555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:37.256830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-6fe45d06-2eee-456d-9eb8-88934ef7cc6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:37.256830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:37.256830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:37.256830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:37.256830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:37.256830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:37.256830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:37.256830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:37.256830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:37.256830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:37.256830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:37.256830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:37.256830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:37.256830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:37.256830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:37.257784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:37.257784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:37.257784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:37.257784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:37.257784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:37.257784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:37.257784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:37.257784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:37.257784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:37.257784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:37.257784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:37.257784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:37.257784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:37.257784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:37.257784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:37.257784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:37.257784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:37.258717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:37.258717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:37.258717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:37.258717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:37.258717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:37.258717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:37.258717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:37.258717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:37.260491 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85010f-c6fd-4dfa-85f0-3700482c5555 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:37.263324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 366/754] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:37.264878 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe45d06-2eee-456d-9eb8-88934ef7cc6c None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:37.280418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-aa85010f-c6fd-4dfa-85f0-3700482c5555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:37.280418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:37.280418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:37.280418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:37.280418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:37.280418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:37.280418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:37.280418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:37.280418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:37.280418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:37.280418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:37.280418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:37.280418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:37.280418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:37.280418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:37.280418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:37.281435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:37.281435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:37.281435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:37.281435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:37.281435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:37.281435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:37.281435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:37.281435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:37.281435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:37.281435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:37.281435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:37.281435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:37.281435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:37.281435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:37.281435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:37.281435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:37.281435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:37.282618 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:37.282618 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:37.282618 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:37.288370 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 389/755] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:37.288370 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85010f-c6fd-4dfa-85f0-3700482c5555 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:37.387595 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:37.393699 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe45d06-2eee-456d-9eb8-88934ef7cc6c None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:37.404612 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85010f-c6fd-4dfa-85f0-3700482c5555 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:37.436164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f37be7-68ce-46f6-aece-27aeb47aae41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:37.437571 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f37be7-68ce-46f6-aece-27aeb47aae41 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:37.438193 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f37be7-68ce-46f6-aece-27aeb47aae41 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:37.438795 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f37be7-68ce-46f6-aece-27aeb47aae41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:37.449979 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d04711-2913-4f57-908c-3a8674474c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:37.450596 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d04711-2913-4f57-908c-3a8674474c88 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:37.450882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d04711-2913-4f57-908c-3a8674474c88 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:37.451165 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d04711-2913-4f57-908c-3a8674474c88 None admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:37.451873 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d04711-2913-4f57-908c-3a8674474c88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:37.452185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d04711-2913-4f57-908c-3a8674474c88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:37.452741 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f37be7-68ce-46f6-aece-27aeb47aae41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:37.454433 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d04711-2913-4f57-908c-3a8674474c88 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:37.455439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f37be7-68ce-46f6-aece-27aeb47aae41 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:37.471531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-39f37be7-68ce-46f6-aece-27aeb47aae41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:37.471531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:37.471531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:37.471531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:37.471531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:37.471531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:37.471531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:37.471531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:37.471531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:37.471531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:37.471531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:37.471531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:37.471531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:37.471531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:37.471531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:37.471531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:37.472509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:37.472509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:37.472509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:37.472509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:37.472509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:37.472509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:37.472509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:37.472509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:37.472509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:37.472509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:37.472509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:37.472509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:37.472509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:37.472509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:37.472509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:37.472509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:37.472509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:37.473390 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:37.473390 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:37.473390 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:37.473559 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 390/756] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:37.474114 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d04711-2913-4f57-908c-3a8674474c88 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:37.475823 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 367/757] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:37.476928 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f37be7-68ce-46f6-aece-27aeb47aae41 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:37.511270 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:37.585191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d04711-2913-4f57-908c-3a8674474c88 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:37.608095 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f37be7-68ce-46f6-aece-27aeb47aae41 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:37.622890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8142a-d334-4fd2-9a5c-5af3eba10bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:37.623467 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8142a-d334-4fd2-9a5c-5af3eba10bae None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:37.623751 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8142a-d334-4fd2-9a5c-5af3eba10bae None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:37.624031 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8142a-d334-4fd2-9a5c-5af3eba10bae None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:37.624683 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8142a-d334-4fd2-9a5c-5af3eba10bae None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:37.624994 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8142a-d334-4fd2-9a5c-5af3eba10bae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:37.626465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8142a-d334-4fd2-9a5c-5af3eba10bae None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:37.643139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 391/758] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:37.643139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8142a-d334-4fd2-9a5c-5af3eba10bae None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:37.657435 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566750f-b578-4cbe-ba71-73f1b3893e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:37.658338 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566750f-b578-4cbe-ba71-73f1b3893e6d None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:37.658778 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566750f-b578-4cbe-ba71-73f1b3893e6d None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:37.659197 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566750f-b578-4cbe-ba71-73f1b3893e6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:37.660170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566750f-b578-4cbe-ba71-73f1b3893e6d None admin] RBAC: Adding query filter params (role.id=1c1ddcbda0754702bb016952e90405ca, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=f45f65dd3a844cb583e42d837d2a58d5) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:37.660622 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566750f-b578-4cbe-ba71-73f1b3893e6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:37.662314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566750f-b578-4cbe-ba71-73f1b3893e6d None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:37.668914 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 368/759] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:37 2022] GET /identity/v3/role_assignments?user.id=f45f65dd3a844cb583e42d837d2a58d5&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=1c1ddcbda0754702bb016952e90405ca => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:37.670070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566750f-b578-4cbe-ba71-73f1b3893e6d None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:37.692974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:37.795018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566750f-b578-4cbe-ba71-73f1b3893e6d None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:37.804753 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:37.823916 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8142a-d334-4fd2-9a5c-5af3eba10bae None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:37.876085 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d86d19-ff50-416e-b09f-0db4b7ed6ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:37.877111 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d86d19-ff50-416e-b09f-0db4b7ed6ce2 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:37.877591 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d86d19-ff50-416e-b09f-0db4b7ed6ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:37.878109 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d86d19-ff50-416e-b09f-0db4b7ed6ce2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:37.886983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d86d19-ff50-416e-b09f-0db4b7ed6ce2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:37.889117 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d86d19-ff50-416e-b09f-0db4b7ed6ce2 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:37.898748 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d34246-6d1b-4466-a14c-566e8d00c4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:37.899358 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d34246-6d1b-4466-a14c-566e8d00c4b0 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:37.899643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d34246-6d1b-4466-a14c-566e8d00c4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:37.899920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d34246-6d1b-4466-a14c-566e8d00c4b0 None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:37.900574 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d34246-6d1b-4466-a14c-566e8d00c4b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:37.900882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d34246-6d1b-4466-a14c-566e8d00c4b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:37.902298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d34246-6d1b-4466-a14c-566e8d00c4b0 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:37.911443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-27d86d19-ff50-416e-b09f-0db4b7ed6ce2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:37.911443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:37.911443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:37.911443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:37.911443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:37.911443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:37.911443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:37.911443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:37.911443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:37.911443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:37.911443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:37.911443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:37.911443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:37.911443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:37.911443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:37.912360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:37.912360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:37.912360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:37.912360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:37.912360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:37.912360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:37.912360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:37.912360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:37.912360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:37.912360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:37.912360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:37.912360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:37.912360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:37.912360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:37.912360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:37.912360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:37.912360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:37.913391 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:37.913391 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:37.913391 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:37.913391 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:37.913391 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:37.913391 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:37.913391 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:37.913391 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:37.915692 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 369/760] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:37.921305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 392/761] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:37.922541 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d86d19-ff50-416e-b09f-0db4b7ed6ce2 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:37.927975 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d34246-6d1b-4466-a14c-566e8d00c4b0 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:38.046510 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:38.053688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d34246-6d1b-4466-a14c-566e8d00c4b0 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:38.092214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56000c7c-ed01-4328-a3e5-3198db3a7a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:38.092845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56000c7c-ed01-4328-a3e5-3198db3a7a83 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:38.093128 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56000c7c-ed01-4328-a3e5-3198db3a7a83 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:38.093404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56000c7c-ed01-4328-a3e5-3198db3a7a83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:38.098061 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d86d19-ff50-416e-b09f-0db4b7ed6ce2 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:38.105938 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56000c7c-ed01-4328-a3e5-3198db3a7a83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:38.105938 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56000c7c-ed01-4328-a3e5-3198db3a7a83 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:38.125490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-56000c7c-ed01-4328-a3e5-3198db3a7a83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:38.125490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:38.125490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:38.125490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:38.125490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:38.125490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:38.125490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:38.125490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:38.125490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:38.125490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:38.125490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:38.125490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:38.125490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:38.125490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:38.125490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:38.127059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:38.127059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:38.127059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:38.127059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:38.127059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:38.127059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:38.127059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:38.127059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:38.127059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:38.127059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:38.127059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:38.127059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:38.127059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:38.127059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:38.127059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:38.127059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:38.127059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:38.128156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:38.128156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:38.128156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:38.128156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:38.128156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:38.128156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:38.128156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:38.128156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:38.141933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 393/762] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:38.146846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56000c7c-ed01-4328-a3e5-3198db3a7a83 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:38.165977 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644114f3-110d-4344-a3f4-1d0906f68ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:38.166997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644114f3-110d-4344-a3f4-1d0906f68ce8 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:38.167870 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644114f3-110d-4344-a3f4-1d0906f68ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:38.168356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644114f3-110d-4344-a3f4-1d0906f68ce8 None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:38.169261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644114f3-110d-4344-a3f4-1d0906f68ce8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:38.169769 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644114f3-110d-4344-a3f4-1d0906f68ce8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:38.171880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644114f3-110d-4344-a3f4-1d0906f68ce8 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:38.177911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:38.195781 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 370/763] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:38.197300 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644114f3-110d-4344-a3f4-1d0906f68ce8 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:38.304144 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56000c7c-ed01-4328-a3e5-3198db3a7a83 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:38.345997 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618964d-7467-4b5d-8f67-31da5c9209da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:38.346994 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618964d-7467-4b5d-8f67-31da5c9209da None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:38.347484 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618964d-7467-4b5d-8f67-31da5c9209da None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:38.347985 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618964d-7467-4b5d-8f67-31da5c9209da None admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:38.348910 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618964d-7467-4b5d-8f67-31da5c9209da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:38.349485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618964d-7467-4b5d-8f67-31da5c9209da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:38.351213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618964d-7467-4b5d-8f67-31da5c9209da None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:38.365795 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 394/764] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:38.367457 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0a52b-c810-4095-b58b-6f37b1d35463 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:38.367984 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0a52b-c810-4095-b58b-6f37b1d35463 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:38.368557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0a52b-c810-4095-b58b-6f37b1d35463 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:38.373952 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 395/765] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:38.375133 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0a52b-c810-4095-b58b-6f37b1d35463 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:38.450114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644114f3-110d-4344-a3f4-1d0906f68ce8 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:38.466156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:38.487427 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345e96f-b715-4eeb-acd7-285ae76d9b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:38.488163 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345e96f-b715-4eeb-acd7-285ae76d9b90 None admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:38.488450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345e96f-b715-4eeb-acd7-285ae76d9b90 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:38.488730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345e96f-b715-4eeb-acd7-285ae76d9b90 None admin] PATH_INFO: `/v3/projects/61c5f56764934c4a90ad38357b46f397/users/632071470f7d409ab7b0129d120320c7/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:38.490773 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f345e96f-b715-4eeb-acd7-285ae76d9b90 None admin] RBAC: Authorizing `identity:create_grant(project_id=61c5f56764934c4a90ad38357b46f397, user_id=632071470f7d409ab7b0129d120320c7, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:38.492210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f345e96f-b715-4eeb-acd7-285ae76d9b90 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:38.492752 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0a52b-c810-4095-b58b-6f37b1d35463 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:38.495933 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:38.528089 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae2ee5-c9a8-4ff1-972b-74496d8a8ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:38.528685 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae2ee5-c9a8-4ff1-972b-74496d8a8ce8 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:38.528964 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae2ee5-c9a8-4ff1-972b-74496d8a8ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:38.529239 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae2ee5-c9a8-4ff1-972b-74496d8a8ce8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:38.530000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae2ee5-c9a8-4ff1-972b-74496d8a8ce8 None admin] RBAC: Adding query filter params (role.id=32e6a7f83b444d1ca9e5891a2b175f9a, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=3da2b1dc9dae413a8ee63ad67e840f8c) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:38.530308 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae2ee5-c9a8-4ff1-972b-74496d8a8ce8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:38.531810 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae2ee5-c9a8-4ff1-972b-74496d8a8ce8 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:38.537247 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 396/766] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:38 2022] GET /identity/v3/role_assignments?user.id=3da2b1dc9dae413a8ee63ad67e840f8c&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=32e6a7f83b444d1ca9e5891a2b175f9a => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:38.538422 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11815c86-f62a-4df3-a047-130b4f94b562 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:38.538709 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11815c86-f62a-4df3-a047-130b4f94b562 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:38.538988 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11815c86-f62a-4df3-a047-130b4f94b562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:38.558965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-11815c86-f62a-4df3-a047-130b4f94b562 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:38.559961 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-11815c86-f62a-4df3-a047-130b4f94b562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:38.610339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 371/767] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:02:38 2022] PUT /identity/v3/projects/61c5f56764934c4a90ad38357b46f397/users/632071470f7d409ab7b0129d120320c7/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:02:38.612942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf6d1a-6815-482d-96f3-b97596f36af9 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:38.612942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf6d1a-6815-482d-96f3-b97596f36af9 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:38.613470 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf6d1a-6815-482d-96f3-b97596f36af9 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:38.619854 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 372/768] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:38.622958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5798ff9-ef60-4c22-a836-43e4a94244f6 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:38.623402 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5798ff9-ef60-4c22-a836-43e4a94244f6 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:38.623780 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5798ff9-ef60-4c22-a836-43e4a94244f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:38.682747 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-b5798ff9-ef60-4c22-a836-43e4a94244f6 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:38.685866 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-b5798ff9-ef60-4c22-a836-43e4a94244f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:38.690227 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 397/769] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:38.788491 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 373/770] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:39.055625 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11815c86-f62a-4df3-a047-130b4f94b562 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:39.131334 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:39.173029 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11815c86-f62a-4df3-a047-130b4f94b562 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:39.212865 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9afce6-e533-450b-90b5-fd5f7c279add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:39.213501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9afce6-e533-450b-90b5-fd5f7c279add None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:39.213782 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9afce6-e533-450b-90b5-fd5f7c279add None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:39.218152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9afce6-e533-450b-90b5-fd5f7c279add None admin] PATH_INFO: `/v3/services/network` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:39.218766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9afce6-e533-450b-90b5-fd5f7c279add None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:39.220941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9afce6-e533-450b-90b5-fd5f7c279add None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:39.228620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5798ff9-ef60-4c22-a836-43e4a94244f6 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:39.230527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-1c9afce6-e533-450b-90b5-fd5f7c279add None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 21:02:39.230527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:39.230527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:39.230527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:39.230527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:39.230527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:39.230527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:39.230527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:39.230527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 21:02:39.230527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:39.230527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:39.230527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:39.230527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:39.230527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:39.230527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:39.230527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:39.230527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:39.231500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:39.231500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:39.231500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:39.231500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:39.231500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:39.231500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:39.231500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:39.231500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:39.231500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:39.231500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:39.231500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:39.231500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:39.231500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:39.231500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:39.231500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:39.231500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:39.232331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:39.232331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:39.232331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:39.232331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:39.232331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:39.232331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:39.232331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:39.232331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:39.232331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:39.232331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:39.232331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:39.232331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:39.232331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 21:02:39.232331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:39.232331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 398/771] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:39 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:39.237680 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9afce6-e533-450b-90b5-fd5f7c279add None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:39.377507 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5798ff9-ef60-4c22-a836-43e4a94244f6 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:39.406062 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9afce6-e533-450b-90b5-fd5f7c279add None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:39.407935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:39.430956 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75687de-4fc8-4a02-be2f-79f7be2fefef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:39.431602 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75687de-4fc8-4a02-be2f-79f7be2fefef None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:39.431887 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75687de-4fc8-4a02-be2f-79f7be2fefef None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:39.432165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75687de-4fc8-4a02-be2f-79f7be2fefef None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:39.432772 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75687de-4fc8-4a02-be2f-79f7be2fefef None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:39.434174 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75687de-4fc8-4a02-be2f-79f7be2fefef None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:39.455112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-d75687de-4fc8-4a02-be2f-79f7be2fefef None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 21:02:39.455112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:39.455112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:39.455112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:39.455112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:39.455112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:39.455112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:39.455112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:39.455112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 21:02:39.455112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:39.455112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:39.455112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:39.455112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:39.455112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:39.455112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:39.455112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:39.455112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:39.456182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:39.456182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:39.456182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:39.456182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:39.456182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:39.456182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:39.456182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:39.456182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:39.456182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:39.456182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:39.456182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:39.456182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:39.456182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:39.456182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:39.456182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:39.456182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:39.457024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:39.457024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:39.457024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:39.457024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:39.457024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:39.457024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:39.457024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:39.457024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:39.457024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:39.457024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:39.457024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:39.457024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:39.457024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 21:02:39.457024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:39.457024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 374/772] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Sep 2 21:02:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:39.472411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:39.473039 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75687de-4fc8-4a02-be2f-79f7be2fefef None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:39.485072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f1fa3-ff88-4263-b3d8-b4ed890b43ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:39.485846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f1fa3-ff88-4263-b3d8-b4ed890b43ed None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:39.486144 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f1fa3-ff88-4263-b3d8-b4ed890b43ed None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:39.486423 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f1fa3-ff88-4263-b3d8-b4ed890b43ed None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:39.487066 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f1fa3-ff88-4263-b3d8-b4ed890b43ed None admin] RBAC: Adding query filter params (name=network) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:39.487374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f1fa3-ff88-4263-b3d8-b4ed890b43ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:39.488814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f1fa3-ff88-4263-b3d8-b4ed890b43ed None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:39.497759 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 399/773] 10.222.0.79 () {56 vars in 1112 bytes} [Fri Sep 2 21:02:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:39.503869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f1fa3-ff88-4263-b3d8-b4ed890b43ed None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:39.618118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f1fa3-ff88-4263-b3d8-b4ed890b43ed None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:39.653885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501f500-c25f-4af9-a810-3d684f8d65bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:39.654577 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501f500-c25f-4af9-a810-3d684f8d65bd None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:39.654868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501f500-c25f-4af9-a810-3d684f8d65bd None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:39.655147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501f500-c25f-4af9-a810-3d684f8d65bd None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:39.655787 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501f500-c25f-4af9-a810-3d684f8d65bd None admin] RBAC: Adding query filter params (type=network) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:39.656667 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501f500-c25f-4af9-a810-3d684f8d65bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:39.658544 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501f500-c25f-4af9-a810-3d684f8d65bd None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:39.665085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 400/774] 10.222.0.79 () {56 vars in 1112 bytes} [Fri Sep 2 21:02:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:39.674880 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501f500-c25f-4af9-a810-3d684f8d65bd None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:39.751614 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:39.775835 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75687de-4fc8-4a02-be2f-79f7be2fefef None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:39.797006 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501f500-c25f-4af9-a810-3d684f8d65bd None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:39.839999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e57673-1389-4ac5-bf23-b59e819c43c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:39.841077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e57673-1389-4ac5-bf23-b59e819c43c0 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:39.841573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e57673-1389-4ac5-bf23-b59e819c43c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:39.842279 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e57673-1389-4ac5-bf23-b59e819c43c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:39.843217 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e57673-1389-4ac5-bf23-b59e819c43c0 None admin] RBAC: Adding query filter params (interface=public, service_id=6c70a9473d42452aa711dcbad2602e50, region_id=RegionOne) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:39.843989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e57673-1389-4ac5-bf23-b59e819c43c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:39.845658 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e57673-1389-4ac5-bf23-b59e819c43c0 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:39.856178 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 401/775] 10.222.0.79 () {56 vars in 1251 bytes} [Fri Sep 2 21:02:39 2022] GET /identity/v3/endpoints?service_id=6c70a9473d42452aa711dcbad2602e50&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:39.862022 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e57673-1389-4ac5-bf23-b59e819c43c0 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:39.869915 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08620f39-e3ba-45a5-b85c-09ae3159b050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:39.870582 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08620f39-e3ba-45a5-b85c-09ae3159b050 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:39.870861 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08620f39-e3ba-45a5-b85c-09ae3159b050 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:39.871134 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08620f39-e3ba-45a5-b85c-09ae3159b050 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:39.872935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08620f39-e3ba-45a5-b85c-09ae3159b050 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:39.873058 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08620f39-e3ba-45a5-b85c-09ae3159b050 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:39.878009 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08620f39-e3ba-45a5-b85c-09ae3159b050 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:39.885088 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 375/776] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Sep 2 21:02:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:39.886642 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8904b-b244-41cf-a5bb-5c66f880b5aa None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:39.887140 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8904b-b244-41cf-a5bb-5c66f880b5aa None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:39.887621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8904b-b244-41cf-a5bb-5c66f880b5aa None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:39.889278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 376/777] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:39.894890 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8904b-b244-41cf-a5bb-5c66f880b5aa None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:39.973043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:39.993391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e57673-1389-4ac5-bf23-b59e819c43c0 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:40.021774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:40.036305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce61b5-04f6-4972-a2f3-d5cdf4f5e03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:40.036987 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce61b5-04f6-4972-a2f3-d5cdf4f5e03f None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:40.037268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce61b5-04f6-4972-a2f3-d5cdf4f5e03f None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:40.037580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce61b5-04f6-4972-a2f3-d5cdf4f5e03f None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:40.038222 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce61b5-04f6-4972-a2f3-d5cdf4f5e03f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:40.039914 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce61b5-04f6-4972-a2f3-d5cdf4f5e03f None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:40.041233 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8904b-b244-41cf-a5bb-5c66f880b5aa None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:40.047648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 402/778] 10.222.0.79 () {56 vars in 1087 bytes} [Fri Sep 2 21:02:39 2022] GET /identity/v3/services => generated 772 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:40.048596 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9692eb-0743-4ab6-830a-61b59e144742 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:40.048894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9692eb-0743-4ab6-830a-61b59e144742 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:40.049163 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9692eb-0743-4ab6-830a-61b59e144742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:40.071714 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-fd9692eb-0743-4ab6-830a-61b59e144742 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:40.073122 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-fd9692eb-0743-4ab6-830a-61b59e144742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:40.091437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e9cb5-3ae7-4f18-be29-1d344ae6097b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:40.092423 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e9cb5-3ae7-4f18-be29-1d344ae6097b None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:40.093042 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e9cb5-3ae7-4f18-be29-1d344ae6097b None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:40.093875 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e9cb5-3ae7-4f18-be29-1d344ae6097b None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:40.095522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e9cb5-3ae7-4f18-be29-1d344ae6097b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:40.096068 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e9cb5-3ae7-4f18-be29-1d344ae6097b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:40.098389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e9cb5-3ae7-4f18-be29-1d344ae6097b None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:40.106477 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 377/779] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Sep 2 21:02:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:40.118050 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e9cb5-3ae7-4f18-be29-1d344ae6097b None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:40.214091 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 403/780] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:40.280474 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e9cb5-3ae7-4f18-be29-1d344ae6097b None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:40.302994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:40.322110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83aa16-e1d9-4797-9655-575e556ac491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:40.331533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83aa16-e1d9-4797-9655-575e556ac491 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:40.331533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83aa16-e1d9-4797-9655-575e556ac491 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:40.331533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83aa16-e1d9-4797-9655-575e556ac491 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:40.331533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83aa16-e1d9-4797-9655-575e556ac491 None admin] RBAC: Adding query filter params (interface=public, service_id=7958db0680bc45e2bff9604fa9a66812, region_id=RegionOne) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:40.331533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83aa16-e1d9-4797-9655-575e556ac491 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:40.331533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83aa16-e1d9-4797-9655-575e556ac491 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:40.340620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 378/781] 10.222.0.79 () {56 vars in 1251 bytes} [Fri Sep 2 21:02:40 2022] GET /identity/v3/endpoints?service_id=7958db0680bc45e2bff9604fa9a66812&interface=public®ion_id=RegionOne => generated 194 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:40.342031 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9692eb-0743-4ab6-830a-61b59e144742 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:40.460414 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9692eb-0743-4ab6-830a-61b59e144742 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:40.479760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:40.500056 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8aefb-106b-435e-a21e-f95adf81d5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:40.502885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8aefb-106b-435e-a21e-f95adf81d5cc None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:40.502885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8aefb-106b-435e-a21e-f95adf81d5cc None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:40.502885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8aefb-106b-435e-a21e-f95adf81d5cc None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:40.502885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8aefb-106b-435e-a21e-f95adf81d5cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:40.504072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8aefb-106b-435e-a21e-f95adf81d5cc None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:40.514056 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 404/782] 10.222.0.79 () {56 vars in 1087 bytes} [Fri Sep 2 21:02:40 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:40.595477 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83aa16-e1d9-4797-9655-575e556ac491 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:40.731992 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f659177-aa64-41f5-b340-b892e930e0de None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:40.732277 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f659177-aa64-41f5-b340-b892e930e0de None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:40.732556 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f659177-aa64-41f5-b340-b892e930e0de None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:40.735572 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 405/783] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:02:40.742515 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121c333-470b-4f42-b7a4-5fb5a31464f4 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:40.742803 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121c333-470b-4f42-b7a4-5fb5a31464f4 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:40.743145 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121c333-470b-4f42-b7a4-5fb5a31464f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:40.751482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83aa16-e1d9-4797-9655-575e556ac491 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:40.779172 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-7121c333-470b-4f42-b7a4-5fb5a31464f4 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:40.780493 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-7121c333-470b-4f42-b7a4-5fb5a31464f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:40.794297 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d060fd-b9e5-46ad-aa3a-f568328d9541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:40.795860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d060fd-b9e5-46ad-aa3a-f568328d9541 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:40.797089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d060fd-b9e5-46ad-aa3a-f568328d9541 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:40.797555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d060fd-b9e5-46ad-aa3a-f568328d9541 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:40.813386 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d060fd-b9e5-46ad-aa3a-f568328d9541 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:40.820274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-c0d060fd-b9e5-46ad-aa3a-f568328d9541 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:40.820274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:40.820274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:40.820274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:40.820274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:40.820274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:40.820274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:40.820274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:40.820274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:40.820274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:40.820274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:40.820274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:40.820274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:40.820274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:40.820274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:40.820274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:40.821359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:40.821359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:40.821359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:40.821359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:40.821359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:40.821359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:40.821359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:40.821359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:40.821359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:40.821359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:40.821359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:40.821359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:40.821359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:40.821359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:40.821359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:40.821359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:40.822222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:40.822222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:40.822222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:40.822222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:40.822222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:40.822222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:40.822222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:40.822222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:40.822222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:40.822222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:40.822222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:40.822222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:40.823512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 379/784] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:02:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:40.831494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d060fd-b9e5-46ad-aa3a-f568328d9541 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:40.869688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 406/785] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:40.910196 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:40.939678 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94893951-8466-4a6f-9fe2-8db03818cfef None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:40.940015 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94893951-8466-4a6f-9fe2-8db03818cfef None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:40.940251 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94893951-8466-4a6f-9fe2-8db03818cfef None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:40.945763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 407/786] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:02:40.947028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529a497-42eb-4c27-9cb6-e940bbc63ac6 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:40.947318 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529a497-42eb-4c27-9cb6-e940bbc63ac6 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:40.947597 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529a497-42eb-4c27-9cb6-e940bbc63ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:40.969143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-7529a497-42eb-4c27-9cb6-e940bbc63ac6 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:40.970379 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-7529a497-42eb-4c27-9cb6-e940bbc63ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:41.010425 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d060fd-b9e5-46ad-aa3a-f568328d9541 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:41.085308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105761a-b7c1-4975-a740-42cec22f26ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:41.086037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105761a-b7c1-4975-a740-42cec22f26ac None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:41.086388 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105761a-b7c1-4975-a740-42cec22f26ac None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:41.086741 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105761a-b7c1-4975-a740-42cec22f26ac None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:41.087497 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105761a-b7c1-4975-a740-42cec22f26ac None admin] RBAC: Adding query filter params (name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:41.087807 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105761a-b7c1-4975-a740-42cec22f26ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:41.089172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105761a-b7c1-4975-a740-42cec22f26ac None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:41.092111 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 408/787] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:02:41.099794 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 380/788] 10.222.0.79 () {56 vars in 1103 bytes} [Fri Sep 2 21:02:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:41.111505 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529a497-42eb-4c27-9cb6-e940bbc63ac6 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:41.229612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105761a-b7c1-4975-a740-42cec22f26ac None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:41.277282 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:41.348456 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529a497-42eb-4c27-9cb6-e940bbc63ac6 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:41.385953 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc4504-96ef-415c-8abc-af351fd5c289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:41.386599 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc4504-96ef-415c-8abc-af351fd5c289 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:41.386883 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc4504-96ef-415c-8abc-af351fd5c289 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:41.387160 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc4504-96ef-415c-8abc-af351fd5c289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:41.398415 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc4504-96ef-415c-8abc-af351fd5c289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:41.400044 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc4504-96ef-415c-8abc-af351fd5c289 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:41.416464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-48dc4504-96ef-415c-8abc-af351fd5c289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:41.416464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:41.416464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:41.416464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:41.416464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:41.416464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:41.416464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:41.416464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:41.416464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:41.416464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:41.416464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:41.416464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:41.416464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:41.416464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:41.416464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:41.416464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:41.417451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:41.417451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:41.417451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:41.417451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:41.417451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:41.417451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:41.417451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:41.417451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:41.417451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:41.417451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:41.417451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:41.417451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:41.417451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:41.417451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:41.417451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:41.417451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:41.417451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:41.418365 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:41.418365 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:41.418365 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:41.422031 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 409/789] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:41.423698 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc4504-96ef-415c-8abc-af351fd5c289 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:41.457798 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105761a-b7c1-4975-a740-42cec22f26ac None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:41.460324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:41.501545 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b14a29-c073-4524-ab44-a95bbc7eb13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:41.502141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b14a29-c073-4524-ab44-a95bbc7eb13d None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:41.502426 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b14a29-c073-4524-ab44-a95bbc7eb13d None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:41.502702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b14a29-c073-4524-ab44-a95bbc7eb13d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:41.513420 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b14a29-c073-4524-ab44-a95bbc7eb13d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:41.518608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-42b14a29-c073-4524-ab44-a95bbc7eb13d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:02:41.518608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:41.518608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:41.518608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:41.518608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:41.518608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:41.518608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:41.518608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:41.518608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:41.518608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:41.518608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:41.518608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:41.518608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:41.518608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:41.518608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:41.518608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:41.519554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:41.519554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:41.519554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:41.519554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:41.519554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:41.519554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:41.519554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:41.519554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:41.519554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:41.519554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:41.519554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:41.519554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:41.519554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:41.519554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:41.519554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:41.519554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:41.520407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:41.520407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:41.520407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:41.520407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:41.520407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:41.520407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:41.520407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:41.520407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:41.520407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:41.520407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:41.520407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:02:41.520407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:41.520407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 381/790] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:02:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:41.521122 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b14a29-c073-4524-ab44-a95bbc7eb13d None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:41.530166 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:41.538610 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc4504-96ef-415c-8abc-af351fd5c289 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:41.583905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dfd7c-85f5-44e0-905e-b3b0d70f051c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:41.584765 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dfd7c-85f5-44e0-905e-b3b0d70f051c None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:41.585114 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dfd7c-85f5-44e0-905e-b3b0d70f051c None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:41.585700 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dfd7c-85f5-44e0-905e-b3b0d70f051c None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:41.586959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dfd7c-85f5-44e0-905e-b3b0d70f051c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:41.587608 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dfd7c-85f5-44e0-905e-b3b0d70f051c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:41.589729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dfd7c-85f5-44e0-905e-b3b0d70f051c None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:41.609939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 410/791] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:41.610966 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dfd7c-85f5-44e0-905e-b3b0d70f051c None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:41.637746 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b14a29-c073-4524-ab44-a95bbc7eb13d None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:41.696114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632a3d0-d95b-42b1-86fb-3d0b1f9f15d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:41.697223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632a3d0-d95b-42b1-86fb-3d0b1f9f15d4 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:41.697497 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632a3d0-d95b-42b1-86fb-3d0b1f9f15d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:41.697764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632a3d0-d95b-42b1-86fb-3d0b1f9f15d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:41.715369 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632a3d0-d95b-42b1-86fb-3d0b1f9f15d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:41.720615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-1632a3d0-d95b-42b1-86fb-3d0b1f9f15d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:02:41.720615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:41.720615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:41.720615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:41.720615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:41.720615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:41.720615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:41.720615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:41.720615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:41.720615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:41.720615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:41.720615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:41.720615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:41.720615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:41.720615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:41.720615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:41.721856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:41.721856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:41.721856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:41.721856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:41.721856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:41.721856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:41.721856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:41.721856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:41.721856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:41.721856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:41.721856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:41.721856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:41.721856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:41.721856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:41.721856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:41.721856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:41.722760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:41.722760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:41.722760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:41.722760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:41.722760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:41.722760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:41.722760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:41.722760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:41.722760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:41.722760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:41.722760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:02:41.722760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:41.726897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 382/792] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:02:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:41.727798 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632a3d0-d95b-42b1-86fb-3d0b1f9f15d4 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:41.756361 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:41.772683 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dfd7c-85f5-44e0-905e-b3b0d70f051c None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:41.811940 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d6044-7536-41cf-afdc-d1cc6f2df7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:41.812916 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d6044-7536-41cf-afdc-d1cc6f2df7ab None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:41.813440 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d6044-7536-41cf-afdc-d1cc6f2df7ab None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:41.813957 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d6044-7536-41cf-afdc-d1cc6f2df7ab None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:41.814824 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d6044-7536-41cf-afdc-d1cc6f2df7ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:41.815236 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d6044-7536-41cf-afdc-d1cc6f2df7ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:41.816955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d6044-7536-41cf-afdc-d1cc6f2df7ab None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:41.829129 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 411/793] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:02:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:41.830444 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d6044-7536-41cf-afdc-d1cc6f2df7ab None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:41.850698 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:41.863433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632a3d0-d95b-42b1-86fb-3d0b1f9f15d4 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:41.910491 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20b3de-4204-4451-96f6-dcd0b516cfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:41.911210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20b3de-4204-4451-96f6-dcd0b516cfe8 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:41.911500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20b3de-4204-4451-96f6-dcd0b516cfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:41.911785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20b3de-4204-4451-96f6-dcd0b516cfe8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:41.921889 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20b3de-4204-4451-96f6-dcd0b516cfe8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:41.924989 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20b3de-4204-4451-96f6-dcd0b516cfe8 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:41.942146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-3a20b3de-4204-4451-96f6-dcd0b516cfe8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:02:41.942146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:41.942146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:41.942146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:41.942146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:41.942146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:41.942146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:41.942146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:41.942146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:41.942146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:41.942146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:41.942146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:41.942146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:41.942146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:41.942146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:41.942146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:41.943498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:41.943498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:41.943498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:41.943498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:41.943498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:41.943498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:41.943498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:41.943498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:41.943498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:41.943498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:41.943498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:41.943498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:41.943498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:41.943498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:41.943498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:41.943498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:41.943498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:41.943498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:41.944654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:41.944654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:41.944654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:41.944654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:41.944654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:41.944654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:41.944654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:41.944654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:41.944654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:02:41.944654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:41.945277 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d6044-7536-41cf-afdc-d1cc6f2df7ab None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:41.954089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 383/794] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Sep 2 21:02:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:41.954089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20b3de-4204-4451-96f6-dcd0b516cfe8 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:41.998876 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287fbd9-6409-487a-8dc6-08d05fb9337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:41.999493 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287fbd9-6409-487a-8dc6-08d05fb9337e None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:41.999782 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287fbd9-6409-487a-8dc6-08d05fb9337e None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:42.000061 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287fbd9-6409-487a-8dc6-08d05fb9337e None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:42.001328 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287fbd9-6409-487a-8dc6-08d05fb9337e None admin] RBAC: Adding query filter params (name=admin) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:42.001648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287fbd9-6409-487a-8dc6-08d05fb9337e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:42.003668 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287fbd9-6409-487a-8dc6-08d05fb9337e None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:42.014807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 412/795] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:02:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:42.015591 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287fbd9-6409-487a-8dc6-08d05fb9337e None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:42.061255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:42.083124 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20b3de-4204-4451-96f6-dcd0b516cfe8 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:42.115390 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:42.126322 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50007e6-0e4f-4b3c-8a22-f62a1071e839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:42.127732 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50007e6-0e4f-4b3c-8a22-f62a1071e839 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:42.128186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50007e6-0e4f-4b3c-8a22-f62a1071e839 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:42.128756 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50007e6-0e4f-4b3c-8a22-f62a1071e839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:42.138335 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287fbd9-6409-487a-8dc6-08d05fb9337e None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:42.143405 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50007e6-0e4f-4b3c-8a22-f62a1071e839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:42.145121 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50007e6-0e4f-4b3c-8a22-f62a1071e839 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:42.167150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-e50007e6-0e4f-4b3c-8a22-f62a1071e839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:42.167150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:42.167150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:42.167150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:42.167150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:42.167150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:42.167150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:42.167150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:42.167150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:42.167150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:42.167150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:42.167150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:42.167150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:42.167150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:42.167150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:42.167150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:42.168141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:42.168141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:42.168141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:42.168141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:42.168141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:42.168141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:42.168141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:42.168141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:42.168141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:42.168141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:42.168141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:42.168141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:42.168141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:42.168141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:42.168141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:42.168141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:42.168141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:42.169024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:42.169024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:42.169024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:42.171537 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 384/796] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:42.172822 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50007e6-0e4f-4b3c-8a22-f62a1071e839 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:42.180320 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436af67-0106-4eb1-8479-011e75d35202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:42.181068 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436af67-0106-4eb1-8479-011e75d35202 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:42.181450 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436af67-0106-4eb1-8479-011e75d35202 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:42.181834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436af67-0106-4eb1-8479-011e75d35202 None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:42.182702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436af67-0106-4eb1-8479-011e75d35202 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:42.183152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436af67-0106-4eb1-8479-011e75d35202 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:42.184754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436af67-0106-4eb1-8479-011e75d35202 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:42.209528 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 413/797] 10.222.0.79 () {56 vars in 1149 bytes} [Fri Sep 2 21:02:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:42.209528 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436af67-0106-4eb1-8479-011e75d35202 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:42.292987 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50007e6-0e4f-4b3c-8a22-f62a1071e839 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:42.330571 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0cd93-4d69-41bb-acdc-766420145f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:42.331372 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0cd93-4d69-41bb-acdc-766420145f16 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:42.331753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0cd93-4d69-41bb-acdc-766420145f16 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:42.332131 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0cd93-4d69-41bb-acdc-766420145f16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:42.335602 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:42.342957 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436af67-0106-4eb1-8479-011e75d35202 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:42.346797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0cd93-4d69-41bb-acdc-766420145f16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:42.348531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0cd93-4d69-41bb-acdc-766420145f16 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:42.363839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-d1e0cd93-4d69-41bb-acdc-766420145f16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:42.363839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:42.363839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:42.363839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:42.363839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:42.363839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:42.363839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:42.363839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:42.363839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:42.363839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:42.363839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:42.363839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:42.363839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:42.363839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:42.363839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:42.363839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:42.364871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:42.364871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:42.364871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:42.364871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:42.364871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:42.364871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:42.364871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:42.364871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:42.364871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:42.364871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:42.364871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:42.364871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:42.364871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:42.364871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:42.364871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:42.364871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:42.364871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:42.365769 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:42.365769 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:42.365769 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:42.372521 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 385/798] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:42.373667 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0cd93-4d69-41bb-acdc-766420145f16 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:42.384321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f657ed-c92a-4250-8734-179eb3b4812c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:42.384928 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f657ed-c92a-4250-8734-179eb3b4812c None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:42.385211 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f657ed-c92a-4250-8734-179eb3b4812c None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:42.385484 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f657ed-c92a-4250-8734-179eb3b4812c None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:42.386157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f657ed-c92a-4250-8734-179eb3b4812c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:42.386633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f657ed-c92a-4250-8734-179eb3b4812c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:42.387945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f657ed-c92a-4250-8734-179eb3b4812c None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:42.392104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:42.413118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 414/799] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:42.413118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f657ed-c92a-4250-8734-179eb3b4812c None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:42.512538 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0cd93-4d69-41bb-acdc-766420145f16 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:42.529584 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f657ed-c92a-4250-8734-179eb3b4812c None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:42.560341 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78875381-0e70-4d6f-8234-17786f4d17c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:42.561334 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78875381-0e70-4d6f-8234-17786f4d17c3 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:42.561858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78875381-0e70-4d6f-8234-17786f4d17c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:42.562335 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78875381-0e70-4d6f-8234-17786f4d17c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:42.574359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78875381-0e70-4d6f-8234-17786f4d17c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:42.576155 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78875381-0e70-4d6f-8234-17786f4d17c3 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:42.576401 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d8955-698d-41e3-ac72-349e09d30027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:42.577110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d8955-698d-41e3-ac72-349e09d30027 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:42.577479 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d8955-698d-41e3-ac72-349e09d30027 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:42.577763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d8955-698d-41e3-ac72-349e09d30027 None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:42.579489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d8955-698d-41e3-ac72-349e09d30027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:42.579800 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d8955-698d-41e3-ac72-349e09d30027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:42.581843 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d8955-698d-41e3-ac72-349e09d30027 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:42.594570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-78875381-0e70-4d6f-8234-17786f4d17c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:42.594570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:42.594570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:42.594570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:42.594570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:42.594570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:42.594570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:42.594570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:42.594570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:42.594570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:42.594570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:42.594570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:42.594570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:42.594570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:42.594570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:42.594570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:42.595583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:42.595583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:42.595583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:42.595583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:42.595583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:42.595583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:42.595583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:42.595583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:42.595583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:42.595583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:42.595583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:42.595583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:42.595583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:42.595583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:42.595583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:42.595583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:42.595583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:42.596468 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:42.596468 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:42.596468 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:42.602906 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 415/801] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:42.602906 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d8955-698d-41e3-ac72-349e09d30027 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:42.603268 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 386/801] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:42.604371 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78875381-0e70-4d6f-8234-17786f4d17c3 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:42.651592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:42.670847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:42.717988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78875381-0e70-4d6f-8234-17786f4d17c3 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:42.719197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d8955-698d-41e3-ac72-349e09d30027 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:42.754897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877b0e9-ea6f-4bc3-b22c-f57f20a2167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:42.755540 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877b0e9-ea6f-4bc3-b22c-f57f20a2167b None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:42.755818 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877b0e9-ea6f-4bc3-b22c-f57f20a2167b None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:42.756094 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877b0e9-ea6f-4bc3-b22c-f57f20a2167b None admin] PATH_INFO: `/v3/users/nova` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:42.759461 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21ca25-dafa-4bb9-a6b0-43cdf71867c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:42.760094 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21ca25-dafa-4bb9-a6b0-43cdf71867c5 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:42.760376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21ca25-dafa-4bb9-a6b0-43cdf71867c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:42.760656 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21ca25-dafa-4bb9-a6b0-43cdf71867c5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:42.766898 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877b0e9-ea6f-4bc3-b22c-f57f20a2167b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:42.768338 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877b0e9-ea6f-4bc3-b22c-f57f20a2167b None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:42.769243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21ca25-dafa-4bb9-a6b0-43cdf71867c5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:42.770726 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21ca25-dafa-4bb9-a6b0-43cdf71867c5 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:42.780065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-1877b0e9-ea6f-4bc3-b22c-f57f20a2167b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:02:42.780065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:42.780065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:42.780065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:42.780065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:42.780065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:42.780065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:42.780065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:42.780065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:42.780065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:42.780065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:42.780065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:42.780065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:42.780065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:42.780065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:42.780065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:42.781060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:42.781060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:42.781060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:42.781060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:42.781060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:42.781060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:42.781060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:42.781060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:42.781060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:42.781060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:42.781060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:42.781060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:42.781060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:42.781060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:42.781060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:42.781060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:42.781060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:42.781060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:42.787108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:42.787108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:42.787108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:42.787108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:42.787108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:42.787108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:42.787108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:42.787108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:42.787108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:02:42.787108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:42.787108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 387/802] 10.222.0.79 () {56 vars in 1093 bytes} [Fri Sep 2 21:02:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:42.787108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877b0e9-ea6f-4bc3-b22c-f57f20a2167b None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:42.787770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-9f21ca25-dafa-4bb9-a6b0-43cdf71867c5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:02:42.787770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:42.787770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:42.787770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:42.787770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:42.787770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:42.787770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:42.787770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:42.787770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:42.787770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:42.787770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:42.787770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:42.787770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:42.787770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:42.787770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:42.787770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:42.788601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:42.788601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:42.788601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:42.788601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:42.788601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:42.788601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:42.788601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:42.788601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:42.788601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:42.788601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:42.788601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:42.788601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:42.788601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:42.788601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:42.788601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:42.788601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:42.788601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:42.788601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:42.789527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:42.789527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:42.789527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:42.789527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:42.789527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:42.789527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:42.789527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:42.789527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:42.789527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:02:42.789527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:42.789527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 416/803] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:02:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:42.789527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fedc9c-85a2-4ace-ba95-b0be5dfeb975 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:42.789527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fedc9c-85a2-4ace-ba95-b0be5dfeb975 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:42.792172 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fedc9c-85a2-4ace-ba95-b0be5dfeb975 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:42.792172 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 417/804] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:42.792943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fedc9c-85a2-4ace-ba95-b0be5dfeb975 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:42.905714 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fedc9c-85a2-4ace-ba95-b0be5dfeb975 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:42.907961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:42.910909 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877b0e9-ea6f-4bc3-b22c-f57f20a2167b None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:42.922859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:42.941005 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5b00d-b830-4d4f-8ff8-d5540f30618c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:42.941610 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5b00d-b830-4d4f-8ff8-d5540f30618c None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:42.941910 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5b00d-b830-4d4f-8ff8-d5540f30618c None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:42.942184 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5b00d-b830-4d4f-8ff8-d5540f30618c None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:42.942904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5b00d-b830-4d4f-8ff8-d5540f30618c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:42.943212 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5b00d-b830-4d4f-8ff8-d5540f30618c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:42.944631 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5b00d-b830-4d4f-8ff8-d5540f30618c None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:42.945554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbdd3f-e62d-4b68-8f99-c0951df1e89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:42.946191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbdd3f-e62d-4b68-8f99-c0951df1e89e None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:42.946473 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbdd3f-e62d-4b68-8f99-c0951df1e89e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:42.946748 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbdd3f-e62d-4b68-8f99-c0951df1e89e None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:42.947394 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbdd3f-e62d-4b68-8f99-c0951df1e89e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:42.947704 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbdd3f-e62d-4b68-8f99-c0951df1e89e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:42.949045 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbdd3f-e62d-4b68-8f99-c0951df1e89e None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:42.966211 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 388/805] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:42.966211 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbdd3f-e62d-4b68-8f99-c0951df1e89e None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:42.966455 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 418/806] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Sep 2 21:02:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:42.966455 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d332a-f1a9-497d-83d7-92e205dcb7e1 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:42.966455 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d332a-f1a9-497d-83d7-92e205dcb7e1 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:42.966455 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d332a-f1a9-497d-83d7-92e205dcb7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:42.983073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-7c3d332a-f1a9-497d-83d7-92e205dcb7e1 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:42.984256 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-7c3d332a-f1a9-497d-83d7-92e205dcb7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:43.053591 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 419/807] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:43.054945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d0faa-3969-485a-983b-0a321aa4522f None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:43.055251 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d0faa-3969-485a-983b-0a321aa4522f None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:43.055505 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d0faa-3969-485a-983b-0a321aa4522f None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:43.061064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 420/808] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:43.061687 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d0faa-3969-485a-983b-0a321aa4522f None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:43.071554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbdd3f-e62d-4b68-8f99-c0951df1e89e None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:43.111871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d876c18-f15f-4bcd-9f3a-d10fc83c276d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:43.112488 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d876c18-f15f-4bcd-9f3a-d10fc83c276d None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:43.112772 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d876c18-f15f-4bcd-9f3a-d10fc83c276d None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:43.113051 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d876c18-f15f-4bcd-9f3a-d10fc83c276d None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:43.114313 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d876c18-f15f-4bcd-9f3a-d10fc83c276d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:43.114624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d876c18-f15f-4bcd-9f3a-d10fc83c276d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:43.116439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d876c18-f15f-4bcd-9f3a-d10fc83c276d None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:43.140399 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 389/809] 10.222.0.79 () {56 vars in 1133 bytes} [Fri Sep 2 21:02:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:43.140399 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d876c18-f15f-4bcd-9f3a-d10fc83c276d None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:43.158081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:43.190678 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d0faa-3969-485a-983b-0a321aa4522f None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:43.193246 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:43.227083 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06f35a-0520-400f-8b0d-cb9bdb4f5964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:43.228187 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06f35a-0520-400f-8b0d-cb9bdb4f5964 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:43.228537 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06f35a-0520-400f-8b0d-cb9bdb4f5964 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:43.228805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06f35a-0520-400f-8b0d-cb9bdb4f5964 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:43.236868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06f35a-0520-400f-8b0d-cb9bdb4f5964 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:43.238688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06f35a-0520-400f-8b0d-cb9bdb4f5964 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:43.247594 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d876c18-f15f-4bcd-9f3a-d10fc83c276d None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:43.251580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-1d06f35a-0520-400f-8b0d-cb9bdb4f5964 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:43.251580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:43.251580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:43.251580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:43.251580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:43.251580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:43.251580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:43.251580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:43.251580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:43.251580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:43.251580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:43.251580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:43.251580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:43.251580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:43.251580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:43.252465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:43.252465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:43.252465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:43.252465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:43.252465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:43.252465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:43.252465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:43.252465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:43.252465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:43.252465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:43.252465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:43.252465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:43.252465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:43.252465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:43.252465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:43.252465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:43.252465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:43.253509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:43.253509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:43.253509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:43.253509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:43.253509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:43.253509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:43.253509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:43.253509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:43.257675 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 421/810] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:43.259244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ba6fa-b948-4768-9393-14657d9bfe9e None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:43.259532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ba6fa-b948-4768-9393-14657d9bfe9e None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:43.259806 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ba6fa-b948-4768-9393-14657d9bfe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:43.279584 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-0b2ba6fa-b948-4768-9393-14657d9bfe9e None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:43.280761 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-0b2ba6fa-b948-4768-9393-14657d9bfe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:43.284727 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6d9f0-a9fa-48a5-bf49-0931412c904c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:43.285372 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6d9f0-a9fa-48a5-bf49-0931412c904c None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:43.285653 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6d9f0-a9fa-48a5-bf49-0931412c904c None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:43.285977 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6d9f0-a9fa-48a5-bf49-0931412c904c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:43.298162 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6d9f0-a9fa-48a5-bf49-0931412c904c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:43.299779 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6d9f0-a9fa-48a5-bf49-0931412c904c None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:43.314953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-b9d6d9f0-a9fa-48a5-bf49-0931412c904c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:43.314953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:43.314953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:43.314953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:43.314953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:43.314953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:43.314953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:43.314953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:43.314953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:43.314953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:43.314953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:43.314953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:43.314953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:43.314953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:43.314953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:43.314953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:43.315961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:43.315961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:43.315961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:43.315961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:43.315961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:43.315961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:43.315961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:43.315961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:43.315961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:43.315961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:43.315961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:43.315961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:43.315961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:43.315961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:43.315961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:43.315961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:43.315961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:43.316883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:43.316883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:43.316883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:43.320888 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 390/811] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:43.322043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6d9f0-a9fa-48a5-bf49-0931412c904c None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:43.353817 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 422/812] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:43.358169 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ba6fa-b948-4768-9393-14657d9bfe9e None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:43.398504 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:43.431491 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6d9f0-a9fa-48a5-bf49-0931412c904c None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:43.459334 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:43.465860 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ba6fa-b948-4768-9393-14657d9bfe9e None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:43.470418 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfa5e3-bf6b-40c5-acde-8e7ac3c69fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:43.474620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfa5e3-bf6b-40c5-acde-8e7ac3c69fc0 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:43.474620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfa5e3-bf6b-40c5-acde-8e7ac3c69fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:43.474620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfa5e3-bf6b-40c5-acde-8e7ac3c69fc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:43.504533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebbed2-4f27-4574-b35e-b4fa08a49f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:43.505150 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebbed2-4f27-4574-b35e-b4fa08a49f3b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:43.505437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebbed2-4f27-4574-b35e-b4fa08a49f3b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:43.505715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebbed2-4f27-4574-b35e-b4fa08a49f3b None admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:43.506465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebbed2-4f27-4574-b35e-b4fa08a49f3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:43.506778 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebbed2-4f27-4574-b35e-b4fa08a49f3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:43.508250 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebbed2-4f27-4574-b35e-b4fa08a49f3b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:43.525838 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 423/813] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:43.525838 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebbed2-4f27-4574-b35e-b4fa08a49f3b None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:43.548638 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfa5e3-bf6b-40c5-acde-8e7ac3c69fc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:43.550219 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfa5e3-bf6b-40c5-acde-8e7ac3c69fc0 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:43.631641 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:43.643585 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebbed2-4f27-4574-b35e-b4fa08a49f3b None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:43.668185 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 391/814] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:02:43.669176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfa5e3-bf6b-40c5-acde-8e7ac3c69fc0 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:43.679905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cca9df-0d09-44d0-b660-d70f0955d6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:43.680558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cca9df-0d09-44d0-b660-d70f0955d6be None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:43.680835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cca9df-0d09-44d0-b660-d70f0955d6be None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:43.681111 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cca9df-0d09-44d0-b660-d70f0955d6be None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:43.681864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cca9df-0d09-44d0-b660-d70f0955d6be None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:43.682102 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cca9df-0d09-44d0-b660-d70f0955d6be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:43.683476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cca9df-0d09-44d0-b660-d70f0955d6be None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:43.696914 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 424/815] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:43.697779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cca9df-0d09-44d0-b660-d70f0955d6be None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:43.713584 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:43.785183 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfa5e3-bf6b-40c5-acde-8e7ac3c69fc0 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:43.800214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cca9df-0d09-44d0-b660-d70f0955d6be None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:43.824086 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa1bc8-2a42-4929-9b5a-445d1afc79cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:43.824743 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa1bc8-2a42-4929-9b5a-445d1afc79cd None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:43.825029 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa1bc8-2a42-4929-9b5a-445d1afc79cd None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:43.825340 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa1bc8-2a42-4929-9b5a-445d1afc79cd None admin] PATH_INFO: `/v3/services/network` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:43.826050 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa1bc8-2a42-4929-9b5a-445d1afc79cd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:43.827429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa1bc8-2a42-4929-9b5a-445d1afc79cd None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:43.840327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-bbfa1bc8-2a42-4929-9b5a-445d1afc79cd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 21:02:43.840327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:43.840327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:43.840327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:43.840327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:43.840327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:43.840327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:43.840327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:43.840327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 21:02:43.840327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:43.840327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:43.840327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:43.840327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:43.840327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:43.840327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:43.840327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:43.840327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:43.846223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:43.846223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:43.846223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:43.846223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:43.846223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:43.846223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:43.846223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:43.846223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:43.846223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:43.846223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:43.846223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:43.846223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:43.846223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:43.846223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:43.846223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:43.846223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:43.847170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:43.847170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:43.847170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:43.847170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:43.847170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:43.847170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:43.847170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:43.847170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:43.847170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:43.847170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:43.847170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:43.847170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:43.847170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 02 21:02:43.847170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:43.848008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe820b9-812d-4b6b-be31-55da17391536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:43.848116 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 392/816] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:43 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:43.848196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe820b9-812d-4b6b-be31-55da17391536 None admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:43.848196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe820b9-812d-4b6b-be31-55da17391536 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:43.848196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe820b9-812d-4b6b-be31-55da17391536 None admin] PATH_INFO: `/v3/projects/61c5f56764934c4a90ad38357b46f397/users/f45f65dd3a844cb583e42d837d2a58d5/roles/1c1ddcbda0754702bb016952e90405ca` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:43.848401 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa1bc8-2a42-4929-9b5a-445d1afc79cd None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:43.859491 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe820b9-812d-4b6b-be31-55da17391536 None admin] RBAC: Authorizing `identity:create_grant(project_id=61c5f56764934c4a90ad38357b46f397, user_id=f45f65dd3a844cb583e42d837d2a58d5, role_id=1c1ddcbda0754702bb016952e90405ca)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:43.861215 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe820b9-812d-4b6b-be31-55da17391536 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:43.880179 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:43.948157 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa1bc8-2a42-4929-9b5a-445d1afc79cd None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:43.964918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 425/817] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:02:43 2022] PUT /identity/v3/projects/61c5f56764934c4a90ad38357b46f397/users/f45f65dd3a844cb583e42d837d2a58d5/roles/1c1ddcbda0754702bb016952e90405ca => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:02:43.965753 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe820b9-812d-4b6b-be31-55da17391536 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:43.990417 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88570d8b-044c-452a-8f88-beeaa4460dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:43.991214 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88570d8b-044c-452a-8f88-beeaa4460dee None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:43.991443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88570d8b-044c-452a-8f88-beeaa4460dee None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:43.991651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88570d8b-044c-452a-8f88-beeaa4460dee None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:43.992298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88570d8b-044c-452a-8f88-beeaa4460dee None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:43.993782 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88570d8b-044c-452a-8f88-beeaa4460dee None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:44.004465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-88570d8b-044c-452a-8f88-beeaa4460dee None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 21:02:44.004465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:44.004465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:44.004465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:44.004465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:44.004465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:44.004465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:44.004465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:44.004465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 21:02:44.004465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:44.004465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:44.004465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:44.004465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:44.004465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:44.004465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:44.004465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:44.004465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:44.005597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:44.005597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:44.005597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:44.005597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:44.005597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:44.005597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:44.005597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:44.005597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:44.005597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:44.005597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:44.005597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:44.005597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:44.005597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:44.005597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:44.005597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:44.005597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:44.006812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:44.006812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:44.006812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:44.006812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:44.006812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:44.006812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:44.006812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:44.006812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:44.006812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:44.006812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:44.006812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:44.006812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:44.006812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 02 21:02:44.006812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:44.006812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 393/818] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Sep 2 21:02:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:44.007694 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88570d8b-044c-452a-8f88-beeaa4460dee None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:44.046393 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:44.091391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe820b9-812d-4b6b-be31-55da17391536 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:44.133219 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:44.136745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b22856-1566-4db5-8de0-b0993bb828ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:44.137385 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b22856-1566-4db5-8de0-b0993bb828ee None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:44.137505 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88570d8b-044c-452a-8f88-beeaa4460dee None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:44.137682 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b22856-1566-4db5-8de0-b0993bb828ee None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:44.138029 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b22856-1566-4db5-8de0-b0993bb828ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:44.150063 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b22856-1566-4db5-8de0-b0993bb828ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:44.151600 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b22856-1566-4db5-8de0-b0993bb828ee None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:44.167242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-94b22856-1566-4db5-8de0-b0993bb828ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:44.167242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:44.167242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:44.167242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:44.167242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:44.167242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:44.167242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:44.167242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:44.167242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:44.167242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:44.167242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:44.167242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:44.167242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:44.167242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:44.167242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:44.167242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:44.168275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:44.168275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:44.168275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:44.168275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:44.168275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:44.168275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:44.168275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:44.168275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:44.168275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:44.168275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:44.168275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:44.168275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:44.168275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:44.168275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:44.168275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:44.168275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:44.168275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:44.169971 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:44.169971 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:44.169971 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:44.169971 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 426/819] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:44.169971 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b22856-1566-4db5-8de0-b0993bb828ee None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:44.177476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7cb1d-54a4-4f12-bf3b-a4688330c2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:44.178155 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7cb1d-54a4-4f12-bf3b-a4688330c2ff None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:44.178441 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7cb1d-54a4-4f12-bf3b-a4688330c2ff None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:44.179074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7cb1d-54a4-4f12-bf3b-a4688330c2ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:44.185841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7cb1d-54a4-4f12-bf3b-a4688330c2ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:44.187400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7cb1d-54a4-4f12-bf3b-a4688330c2ff None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:44.199670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-8ce7cb1d-54a4-4f12-bf3b-a4688330c2ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:44.199670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:44.199670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:44.199670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:44.199670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:44.199670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:44.199670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:44.199670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:44.199670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:44.199670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:44.199670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:44.199670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:44.199670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:44.199670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:44.199670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:44.200577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:44.200577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:44.200577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:44.200577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:44.200577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:44.200577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:44.200577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:44.200577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:44.200577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:44.200577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:44.200577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:44.200577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:44.200577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:44.200577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:44.200577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:44.200577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:44.200577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:44.201458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:44.201458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:44.201458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:44.201458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:44.201458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:44.201458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:44.201458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:44.201458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:44.201458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 394/820] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:44.201458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7cb1d-54a4-4f12-bf3b-a4688330c2ff None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:44.289517 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b22856-1566-4db5-8de0-b0993bb828ee None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:44.307366 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:44.315716 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7cb1d-54a4-4f12-bf3b-a4688330c2ff None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:44.327156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd91f43-5c6b-47aa-91b7-aeae79610574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:44.327927 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd91f43-5c6b-47aa-91b7-aeae79610574 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:44.328281 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd91f43-5c6b-47aa-91b7-aeae79610574 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:44.328722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd91f43-5c6b-47aa-91b7-aeae79610574 None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:44.329852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd91f43-5c6b-47aa-91b7-aeae79610574 None admin] RBAC: Adding query filter params (name=network) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:44.330172 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd91f43-5c6b-47aa-91b7-aeae79610574 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:44.331628 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd91f43-5c6b-47aa-91b7-aeae79610574 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:44.341401 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 427/821] 10.222.0.79 () {56 vars in 1112 bytes} [Fri Sep 2 21:02:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:44.342306 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd91f43-5c6b-47aa-91b7-aeae79610574 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:44.352653 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bafddd-7189-4739-8aab-2ce475b5ca30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:44.353271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bafddd-7189-4739-8aab-2ce475b5ca30 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:44.353553 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bafddd-7189-4739-8aab-2ce475b5ca30 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:44.353856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bafddd-7189-4739-8aab-2ce475b5ca30 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:44.354498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bafddd-7189-4739-8aab-2ce475b5ca30 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:44.354806 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bafddd-7189-4739-8aab-2ce475b5ca30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:44.356221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bafddd-7189-4739-8aab-2ce475b5ca30 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:44.362107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 395/822] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Sep 2 21:02:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:44.367325 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bafddd-7189-4739-8aab-2ce475b5ca30 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:44.396369 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:44.455219 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd91f43-5c6b-47aa-91b7-aeae79610574 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:44.487038 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bafddd-7189-4739-8aab-2ce475b5ca30 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:44.491462 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906306f1-adce-40db-9b8a-19070c697dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:44.492173 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906306f1-adce-40db-9b8a-19070c697dd3 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:44.492524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906306f1-adce-40db-9b8a-19070c697dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:44.492867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906306f1-adce-40db-9b8a-19070c697dd3 None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:44.493579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906306f1-adce-40db-9b8a-19070c697dd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:44.493990 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906306f1-adce-40db-9b8a-19070c697dd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:44.495439 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906306f1-adce-40db-9b8a-19070c697dd3 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:44.512076 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 428/823] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:44.512076 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906306f1-adce-40db-9b8a-19070c697dd3 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:44.530351 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d25b3-2fcf-4af0-8572-081b4980d5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:44.532206 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d25b3-2fcf-4af0-8572-081b4980d5ad None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:44.532603 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d25b3-2fcf-4af0-8572-081b4980d5ad None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:44.533230 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d25b3-2fcf-4af0-8572-081b4980d5ad None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:44.534031 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d25b3-2fcf-4af0-8572-081b4980d5ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:44.534816 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d25b3-2fcf-4af0-8572-081b4980d5ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:44.536953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d25b3-2fcf-4af0-8572-081b4980d5ad None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:44.552853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 396/824] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:44.553697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d25b3-2fcf-4af0-8572-081b4980d5ad None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:44.561036 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:44.627431 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906306f1-adce-40db-9b8a-19070c697dd3 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:44.640838 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:44.662108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d25b3-2fcf-4af0-8572-081b4980d5ad None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:44.670241 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5919f-978f-4f2b-ad70-94f410795e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:44.671010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5919f-978f-4f2b-ad70-94f410795e8a None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:44.671308 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5919f-978f-4f2b-ad70-94f410795e8a None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:44.671649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5919f-978f-4f2b-ad70-94f410795e8a None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:44.673045 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5919f-978f-4f2b-ad70-94f410795e8a None admin] RBAC: Adding query filter params (type=network) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:44.673381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5919f-978f-4f2b-ad70-94f410795e8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:44.674992 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5919f-978f-4f2b-ad70-94f410795e8a None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:44.680272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 429/825] 10.222.0.79 () {56 vars in 1112 bytes} [Fri Sep 2 21:02:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:44.681086 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5919f-978f-4f2b-ad70-94f410795e8a None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:44.714224 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790845ce-55e0-43e1-a2bb-292dd0a321b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:44.714764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790845ce-55e0-43e1-a2bb-292dd0a321b3 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:44.715039 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790845ce-55e0-43e1-a2bb-292dd0a321b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:44.715313 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790845ce-55e0-43e1-a2bb-292dd0a321b3 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:44.715958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790845ce-55e0-43e1-a2bb-292dd0a321b3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:44.716260 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790845ce-55e0-43e1-a2bb-292dd0a321b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:44.721671 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790845ce-55e0-43e1-a2bb-292dd0a321b3 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:44.726698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 397/826] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Sep 2 21:02:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:44.726987 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790845ce-55e0-43e1-a2bb-292dd0a321b3 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:44.809663 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5919f-978f-4f2b-ad70-94f410795e8a None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:44.812363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:44.844444 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790845ce-55e0-43e1-a2bb-292dd0a321b3 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:44.848511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9b1f0-3d2a-404c-b7ef-2ce6475cea1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:44.855692 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9b1f0-3d2a-404c-b7ef-2ce6475cea1b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:44.855692 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9b1f0-3d2a-404c-b7ef-2ce6475cea1b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:44.855692 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9b1f0-3d2a-404c-b7ef-2ce6475cea1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:44.857072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9b1f0-3d2a-404c-b7ef-2ce6475cea1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:44.858568 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9b1f0-3d2a-404c-b7ef-2ce6475cea1b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:44.871077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-b2f9b1f0-3d2a-404c-b7ef-2ce6475cea1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:44.871077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:44.871077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:44.871077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:44.871077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:44.871077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:44.871077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:44.871077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:44.871077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:44.871077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:44.871077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:44.871077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:44.871077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:44.871077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:44.871077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:44.872004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:44.872004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:44.872004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:44.872004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:44.872004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:44.872004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:44.872004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:44.872004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:44.872004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:44.872004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:44.872004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:44.872004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:44.872004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:44.872004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:44.872004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:44.872004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:44.872004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:44.872894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:44.872894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:44.872894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:44.872894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:44.872894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:44.872894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:44.872894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:44.872894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:44.872894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 430/827] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:44.873380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9b1f0-3d2a-404c-b7ef-2ce6475cea1b None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:44.889523 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aff02b-5166-4fd7-b6d7-735a3fa8f47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:44.890229 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aff02b-5166-4fd7-b6d7-735a3fa8f47a None admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:44.890509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aff02b-5166-4fd7-b6d7-735a3fa8f47a None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:44.891429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aff02b-5166-4fd7-b6d7-735a3fa8f47a None admin] PATH_INFO: `/v3/projects/61c5f56764934c4a90ad38357b46f397/users/3da2b1dc9dae413a8ee63ad67e840f8c/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:44.893499 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aff02b-5166-4fd7-b6d7-735a3fa8f47a None admin] RBAC: Authorizing `identity:create_grant(project_id=61c5f56764934c4a90ad38357b46f397, user_id=3da2b1dc9dae413a8ee63ad67e840f8c, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:44.895048 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aff02b-5166-4fd7-b6d7-735a3fa8f47a None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:44.979882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9b1f0-3d2a-404c-b7ef-2ce6475cea1b None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:45.016264 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20ba1d-f3de-48c9-95e9-4b6ca1449aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:45.016843 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20ba1d-f3de-48c9-95e9-4b6ca1449aa1 None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:45.017156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20ba1d-f3de-48c9-95e9-4b6ca1449aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:45.017394 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20ba1d-f3de-48c9-95e9-4b6ca1449aa1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:45.018089 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20ba1d-f3de-48c9-95e9-4b6ca1449aa1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:45.018892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 398/828] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:02:44 2022] PUT /identity/v3/projects/61c5f56764934c4a90ad38357b46f397/users/3da2b1dc9dae413a8ee63ad67e840f8c/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:02:45.030590 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aff02b-5166-4fd7-b6d7-735a3fa8f47a None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:45.030684 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20ba1d-f3de-48c9-95e9-4b6ca1449aa1 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:45.040494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:45.140745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 431/829] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:02:44 2022] POST /identity/v3/endpoints => generated 337 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:45.146649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20ba1d-f3de-48c9-95e9-4b6ca1449aa1 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:45.175859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aff02b-5166-4fd7-b6d7-735a3fa8f47a None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:45.190827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:45.237352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03034d5f-e002-4e5b-ade5-86f6d3c9db2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:45.238423 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03034d5f-e002-4e5b-ade5-86f6d3c9db2f None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:45.238879 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03034d5f-e002-4e5b-ade5-86f6d3c9db2f None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:45.239508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03034d5f-e002-4e5b-ade5-86f6d3c9db2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:45.240839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03034d5f-e002-4e5b-ade5-86f6d3c9db2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:45.242940 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03034d5f-e002-4e5b-ade5-86f6d3c9db2f None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:45.295196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20ba1d-f3de-48c9-95e9-4b6ca1449aa1 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:45.335823 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b3c72-32e1-4f70-b047-b7963e83f61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:45.336608 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b3c72-32e1-4f70-b047-b7963e83f61e None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:45.337044 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b3c72-32e1-4f70-b047-b7963e83f61e None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:45.337414 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b3c72-32e1-4f70-b047-b7963e83f61e None admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:45.338248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b3c72-32e1-4f70-b047-b7963e83f61e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:45.338650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b3c72-32e1-4f70-b047-b7963e83f61e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:45.340185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b3c72-32e1-4f70-b047-b7963e83f61e None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:45.353326 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 432/830] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:45.356611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 399/831] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:02:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:45.363058 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b3c72-32e1-4f70-b047-b7963e83f61e None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:45.469008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:45.491396 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b3c72-32e1-4f70-b047-b7963e83f61e None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:45.537902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58995c-48e9-48c8-9bdd-9f553761b6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:45.538442 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58995c-48e9-48c8-9bdd-9f553761b6c6 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:45.538728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58995c-48e9-48c8-9bdd-9f553761b6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:45.539003 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58995c-48e9-48c8-9bdd-9f553761b6c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:45.539726 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58995c-48e9-48c8-9bdd-9f553761b6c6 None admin] RBAC: Adding query filter params (role.id=32e6a7f83b444d1ca9e5891a2b175f9a, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=632071470f7d409ab7b0129d120320c7) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:45.540041 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58995c-48e9-48c8-9bdd-9f553761b6c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:45.541472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58995c-48e9-48c8-9bdd-9f553761b6c6 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:45.549781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 433/832] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:45 2022] GET /identity/v3/role_assignments?user.id=632071470f7d409ab7b0129d120320c7&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=32e6a7f83b444d1ca9e5891a2b175f9a => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:45.969175 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd20cd0-06c6-4193-bb42-efdff5e11639 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:45.969673 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd20cd0-06c6-4193-bb42-efdff5e11639 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:45.970180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd20cd0-06c6-4193-bb42-efdff5e11639 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:45.971787 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 400/833] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:45.977329 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd6582-a55b-4c46-85e8-a7b6ff2102f4 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:45.977610 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd6582-a55b-4c46-85e8-a7b6ff2102f4 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:45.977920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd6582-a55b-4c46-85e8-a7b6ff2102f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:45.998199 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-acbd6582-a55b-4c46-85e8-a7b6ff2102f4 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:45.999403 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-acbd6582-a55b-4c46-85e8-a7b6ff2102f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:46.078008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 434/834] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:02:46.424628 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd20cd0-06c6-4193-bb42-efdff5e11639 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:46.509853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:46.567750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd20cd0-06c6-4193-bb42-efdff5e11639 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:46.612514 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2399d2f-8b90-46a9-ab57-8f21509736a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:46.613171 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2399d2f-8b90-46a9-ab57-8f21509736a8 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:46.613455 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2399d2f-8b90-46a9-ab57-8f21509736a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:46.613763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2399d2f-8b90-46a9-ab57-8f21509736a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:46.626826 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2399d2f-8b90-46a9-ab57-8f21509736a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:46.632996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-f2399d2f-8b90-46a9-ab57-8f21509736a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:46.632996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:46.632996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:46.632996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:46.632996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:46.632996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:46.632996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:46.632996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:46.632996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:46.632996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:46.632996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:46.632996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:46.632996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:46.632996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:46.632996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:46.632996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:46.634611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:46.634611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:46.634611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:46.634611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:46.634611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:46.634611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:46.634611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:46.634611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:46.634611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:46.634611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:46.634611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:46.634611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:46.634611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:46.634611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:46.634611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:46.634611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:46.636564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:46.636564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:46.636564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:46.636564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:46.636564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:46.636564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:46.636564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:46.636564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:46.636564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:46.636564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:46.636564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:02:46.636564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:46.636564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 401/835] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:02:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:46.640428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd6582-a55b-4c46-85e8-a7b6ff2102f4 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:46.758254 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:46.794448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd6582-a55b-4c46-85e8-a7b6ff2102f4 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:46.848611 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d214f2-5f8a-45ad-be5a-9fe6b751fac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:46.849226 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d214f2-5f8a-45ad-be5a-9fe6b751fac6 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:46.849510 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d214f2-5f8a-45ad-be5a-9fe6b751fac6 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:46.849779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d214f2-5f8a-45ad-be5a-9fe6b751fac6 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:46.850470 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d214f2-5f8a-45ad-be5a-9fe6b751fac6 None admin] RBAC: Adding query filter params (name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:46.850774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d214f2-5f8a-45ad-be5a-9fe6b751fac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:46.852146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d214f2-5f8a-45ad-be5a-9fe6b751fac6 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:46.864367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 435/836] 10.222.0.79 () {56 vars in 1103 bytes} [Fri Sep 2 21:02:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:46.870491 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2399d2f-8b90-46a9-ab57-8f21509736a8 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:47.004573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2399d2f-8b90-46a9-ab57-8f21509736a8 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:47.037980 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:47.060857 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3ac05-b255-4b20-9ef5-43718e9c276b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:47.061538 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3ac05-b255-4b20-9ef5-43718e9c276b None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:47.061835 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3ac05-b255-4b20-9ef5-43718e9c276b None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:47.062195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3ac05-b255-4b20-9ef5-43718e9c276b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:47.077423 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3ac05-b255-4b20-9ef5-43718e9c276b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:47.080931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3ac05-b255-4b20-9ef5-43718e9c276b None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:47.100908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-8dc3ac05-b255-4b20-9ef5-43718e9c276b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:47.100908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:47.100908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:47.100908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:47.100908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:47.100908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:47.100908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:47.100908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:47.100908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:47.100908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:47.100908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:47.100908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:47.100908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:47.100908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:47.100908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:47.100908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:47.104292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:47.104292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:47.104292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:47.104292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:47.104292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:47.104292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:47.104292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:47.104292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:47.104292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:47.104292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:47.104292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:47.104292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:47.104292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:47.104292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:47.104292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:47.104292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:47.104292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:47.106494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:47.106494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:47.106494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:47.106494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 402/837] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:47.109846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d214f2-5f8a-45ad-be5a-9fe6b751fac6 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:47.232099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d214f2-5f8a-45ad-be5a-9fe6b751fac6 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:47.263831 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:47.268805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50396dad-b3d9-425d-a78c-a511b25b2a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:47.269449 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50396dad-b3d9-425d-a78c-a511b25b2a89 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:47.269744 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50396dad-b3d9-425d-a78c-a511b25b2a89 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:47.270053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50396dad-b3d9-425d-a78c-a511b25b2a89 None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:47.270694 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50396dad-b3d9-425d-a78c-a511b25b2a89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:47.270997 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50396dad-b3d9-425d-a78c-a511b25b2a89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:47.272424 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50396dad-b3d9-425d-a78c-a511b25b2a89 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:47.286002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 436/838] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:47.291596 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3ac05-b255-4b20-9ef5-43718e9c276b None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:47.403429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3ac05-b255-4b20-9ef5-43718e9c276b None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:47.414318 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0edfa7-0e16-4584-b314-b4eb7860871e None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:47.414637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0edfa7-0e16-4584-b314-b4eb7860871e None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:47.414851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0edfa7-0e16-4584-b314-b4eb7860871e None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:47.417218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 437/839] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:02:47.423283 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc057bc-9d0e-4fb5-96bd-05b2d6bef06c None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:47.423967 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc057bc-9d0e-4fb5-96bd-05b2d6bef06c None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:47.424455 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc057bc-9d0e-4fb5-96bd-05b2d6bef06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:47.443609 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-bfc057bc-9d0e-4fb5-96bd-05b2d6bef06c None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:47.444244 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8761d-0008-48f6-9551-08ff21c1e2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:47.444798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-bfc057bc-9d0e-4fb5-96bd-05b2d6bef06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:47.445651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8761d-0008-48f6-9551-08ff21c1e2ce None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:47.446166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8761d-0008-48f6-9551-08ff21c1e2ce None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:47.446768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8761d-0008-48f6-9551-08ff21c1e2ce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:47.455889 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8761d-0008-48f6-9551-08ff21c1e2ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:47.457750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8761d-0008-48f6-9551-08ff21c1e2ce None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:47.471357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-a6a8761d-0008-48f6-9551-08ff21c1e2ce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:02:47.471357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:47.471357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:47.471357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:47.471357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:47.471357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:47.471357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:47.471357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:47.471357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:47.471357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:47.471357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:47.471357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:47.471357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:47.471357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:47.471357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:47.471357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:47.472381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:47.472381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:47.472381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:47.472381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:47.472381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:47.472381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:47.472381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:47.472381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:47.472381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:47.472381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:47.472381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:47.472381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:47.472381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:47.472381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:47.472381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:47.472381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:47.472381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:47.472381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:47.473437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:47.473437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:47.473437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:47.473437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:47.473437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:47.473437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:47.473437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:47.473437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:47.473437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:02:47.473437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:47.476170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 403/840] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Sep 2 21:02:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:47.482331 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8761d-0008-48f6-9551-08ff21c1e2ce None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:47.520088 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:47.533963 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 438/841] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:47.599290 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8761d-0008-48f6-9551-08ff21c1e2ce None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:47.612744 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb9db8-520e-438d-9222-ec0e8012a849 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:47.613383 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb9db8-520e-438d-9222-ec0e8012a849 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:47.613911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb9db8-520e-438d-9222-ec0e8012a849 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:47.616721 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 439/842] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:02:47.621087 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a15e5-dc5d-4e48-900d-1f9ff07f2a71 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:47.621601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a15e5-dc5d-4e48-900d-1f9ff07f2a71 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:47.622105 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a15e5-dc5d-4e48-900d-1f9ff07f2a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:47.637140 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d933c3d-475a-48b8-af85-a89d0a9db7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:47.637886 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d933c3d-475a-48b8-af85-a89d0a9db7db None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:47.638099 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d933c3d-475a-48b8-af85-a89d0a9db7db None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:47.638343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d933c3d-475a-48b8-af85-a89d0a9db7db None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:47.639093 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d933c3d-475a-48b8-af85-a89d0a9db7db None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:47.639400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d933c3d-475a-48b8-af85-a89d0a9db7db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:47.640958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d933c3d-475a-48b8-af85-a89d0a9db7db None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:47.646183 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-791a15e5-dc5d-4e48-900d-1f9ff07f2a71 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:47.648971 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-791a15e5-dc5d-4e48-900d-1f9ff07f2a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:47.663243 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 404/843] 10.222.0.79 () {56 vars in 1149 bytes} [Fri Sep 2 21:02:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:47.669198 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d933c3d-475a-48b8-af85-a89d0a9db7db None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:47.733963 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 440/844] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:02:47.736058 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc870aba-bde0-4fed-8585-b824d2073f45 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:47.736759 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc870aba-bde0-4fed-8585-b824d2073f45 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:47.737064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc870aba-bde0-4fed-8585-b824d2073f45 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:47.742179 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 441/845] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:47.745200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c605c-1868-49d8-b724-2609c92bcb87 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:47.745722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c605c-1868-49d8-b724-2609c92bcb87 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:47.750671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c605c-1868-49d8-b724-2609c92bcb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:47.773936 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-bd4c605c-1868-49d8-b724-2609c92bcb87 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:47.775420 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:47.775974 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-bd4c605c-1868-49d8-b724-2609c92bcb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:47.791200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d933c3d-475a-48b8-af85-a89d0a9db7db None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:47.835658 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd447c1a-b6a3-4e3a-995f-adfb7a8a2d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:47.836628 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd447c1a-b6a3-4e3a-995f-adfb7a8a2d92 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:47.837244 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd447c1a-b6a3-4e3a-995f-adfb7a8a2d92 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:47.837828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd447c1a-b6a3-4e3a-995f-adfb7a8a2d92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:47.843332 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:47.870272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 442/846] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:47.878806 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c605c-1868-49d8-b724-2609c92bcb87 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:47.916484 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd447c1a-b6a3-4e3a-995f-adfb7a8a2d92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:47.918109 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd447c1a-b6a3-4e3a-995f-adfb7a8a2d92 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:47.994244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c605c-1868-49d8-b724-2609c92bcb87 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:48.013104 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:48.031946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 405/847] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:47 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 02 21:02:48.032817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd447c1a-b6a3-4e3a-995f-adfb7a8a2d92 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:48.033231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9226c-da78-42b5-84f7-036bf8c2280e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:48.034089 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9226c-da78-42b5-84f7-036bf8c2280e None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:48.034376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9226c-da78-42b5-84f7-036bf8c2280e None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:48.034768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9226c-da78-42b5-84f7-036bf8c2280e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:48.046457 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9226c-da78-42b5-84f7-036bf8c2280e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:48.051286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-c7e9226c-da78-42b5-84f7-036bf8c2280e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:02:48.051286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:48.051286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:48.051286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:48.051286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:48.051286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:48.051286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:48.051286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:48.051286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:48.051286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:48.051286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:48.051286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:48.051286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:48.051286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:48.051286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:48.051286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:48.052428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:48.052428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:48.052428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:48.052428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:48.052428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:48.052428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:48.052428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:48.052428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:48.052428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:48.052428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:48.052428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:48.052428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:48.052428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:48.052428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:48.052428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:48.052428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:48.053272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:48.053272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:48.053272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:48.053272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:48.053272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:48.053272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:48.053272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:48.053272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:48.053272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:48.053272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:48.053272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:02:48.053272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:48.053272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 443/848] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:02:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:48.054012 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9226c-da78-42b5-84f7-036bf8c2280e None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:48.104071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:48.150887 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd447c1a-b6a3-4e3a-995f-adfb7a8a2d92 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:48.164130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9226c-da78-42b5-84f7-036bf8c2280e None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:48.186598 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafb505-0de3-4697-bcc7-3fe895f973b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:48.187232 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafb505-0de3-4697-bcc7-3fe895f973b3 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:48.188078 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafb505-0de3-4697-bcc7-3fe895f973b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:48.188361 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafb505-0de3-4697-bcc7-3fe895f973b3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:48.188959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafb505-0de3-4697-bcc7-3fe895f973b3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:48.190362 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafb505-0de3-4697-bcc7-3fe895f973b3 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:48.198771 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af07abf-a310-480e-a149-eb9d074bd954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:48.199091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-5dafb505-0de3-4697-bcc7-3fe895f973b3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 21:02:48.199091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:48.199091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:48.199091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:48.199091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:48.199091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:48.199091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:48.199091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:48.199091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 21:02:48.199091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:48.199091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:48.199091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:48.199091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:48.199091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:48.199091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:48.199091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:48.199091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:48.201935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:48.201935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:48.201935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:48.201935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:48.201935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:48.201935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:48.201935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:48.201935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:48.201935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:48.201935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:48.201935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:48.201935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:48.201935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:48.201935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:48.201935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:48.201935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:48.202805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:48.202805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:48.202805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:48.202805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:48.202805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:48.202805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:48.202805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:48.202805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:48.202805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:48.202805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:48.202805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:48.202805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:48.202805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 21:02:48.202805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:48.204405 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af07abf-a310-480e-a149-eb9d074bd954 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:48.204405 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af07abf-a310-480e-a149-eb9d074bd954 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:48.204405 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af07abf-a310-480e-a149-eb9d074bd954 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:48.204602 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 406/849] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Sep 2 21:02:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:48.204602 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafb505-0de3-4697-bcc7-3fe895f973b3 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:48.213123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af07abf-a310-480e-a149-eb9d074bd954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:48.214619 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af07abf-a310-480e-a149-eb9d074bd954 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:48.231512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-7af07abf-a310-480e-a149-eb9d074bd954 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:48.231512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:48.231512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:48.231512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:48.231512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:48.231512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:48.231512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:48.231512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:48.231512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:48.231512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:48.231512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:48.231512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:48.231512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:48.231512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:48.231512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:48.231512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:48.232523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:48.232523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:48.232523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:48.232523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:48.232523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:48.232523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:48.232523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:48.232523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:48.232523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:48.232523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:48.232523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:48.232523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:48.232523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:48.232523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:48.232523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:48.232523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:48.232523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:48.233418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:48.233418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:48.233418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:48.233418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 444/850] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:48.233418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af07abf-a310-480e-a149-eb9d074bd954 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:48.262878 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:48.312244 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafb505-0de3-4697-bcc7-3fe895f973b3 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:48.328522 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:48.335107 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af07abf-a310-480e-a149-eb9d074bd954 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:48.347118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b3be0-936a-406e-9a3f-449be6254843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:48.347729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b3be0-936a-406e-9a3f-449be6254843 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:48.348011 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b3be0-936a-406e-9a3f-449be6254843 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:48.348285 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b3be0-936a-406e-9a3f-449be6254843 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:48.348960 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b3be0-936a-406e-9a3f-449be6254843 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:48.349267 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b3be0-936a-406e-9a3f-449be6254843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:48.350666 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b3be0-936a-406e-9a3f-449be6254843 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:48.360093 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 407/851] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:02:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:48.361242 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b3be0-936a-406e-9a3f-449be6254843 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:48.371670 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4ea2c-3a9b-42b1-9ce2-edd8f0c04649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:48.372310 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4ea2c-3a9b-42b1-9ce2-edd8f0c04649 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:48.372596 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4ea2c-3a9b-42b1-9ce2-edd8f0c04649 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:48.372868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4ea2c-3a9b-42b1-9ce2-edd8f0c04649 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:48.373459 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4ea2c-3a9b-42b1-9ce2-edd8f0c04649 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:48.374895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4ea2c-3a9b-42b1-9ce2-edd8f0c04649 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:48.385000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-5da4ea2c-3a9b-42b1-9ce2-edd8f0c04649 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 21:02:48.385000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:48.385000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:48.385000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:48.385000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:48.385000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:48.385000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:48.385000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:48.385000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 21:02:48.385000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:48.385000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:48.385000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:48.385000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:48.385000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:48.385000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:48.385000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:48.386233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:48.386233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:48.386233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:48.386233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:48.386233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:48.386233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:48.386233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:48.386233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:48.386233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:48.386233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:48.386233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:48.386233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:48.386233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:48.386233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:48.386233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:48.386233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:48.386233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:48.387249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:48.387249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:48.387249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:48.387249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:48.387249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:48.387249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:48.387249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:48.387249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:48.387249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:48.387249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:48.387249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:48.387249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:48.387249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 21:02:48.387249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:48.387249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 445/852] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Sep 2 21:02:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:48.388252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4ea2c-3a9b-42b1-9ce2-edd8f0c04649 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:48.478792 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b3be0-936a-406e-9a3f-449be6254843 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:48.492353 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4ea2c-3a9b-42b1-9ce2-edd8f0c04649 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:48.493292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:48.514079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3158e05-5a3b-4796-bf93-3873f03a2d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:48.514698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3158e05-5a3b-4796-bf93-3873f03a2d04 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:48.515022 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3158e05-5a3b-4796-bf93-3873f03a2d04 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:48.515247 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3158e05-5a3b-4796-bf93-3873f03a2d04 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:48.516622 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3158e05-5a3b-4796-bf93-3873f03a2d04 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:48.516843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3158e05-5a3b-4796-bf93-3873f03a2d04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:48.518284 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3158e05-5a3b-4796-bf93-3873f03a2d04 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:48.525855 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 408/853] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Sep 2 21:02:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:48.525855 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3158e05-5a3b-4796-bf93-3873f03a2d04 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:48.532039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180c3c6-bbe2-4a47-aa89-cb17e718bd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:48.532658 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180c3c6-bbe2-4a47-aa89-cb17e718bd17 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:48.532941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180c3c6-bbe2-4a47-aa89-cb17e718bd17 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:48.533221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180c3c6-bbe2-4a47-aa89-cb17e718bd17 None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:48.533905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180c3c6-bbe2-4a47-aa89-cb17e718bd17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:48.534221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180c3c6-bbe2-4a47-aa89-cb17e718bd17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:48.535644 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180c3c6-bbe2-4a47-aa89-cb17e718bd17 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:48.548199 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 446/854] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:48.549033 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180c3c6-bbe2-4a47-aa89-cb17e718bd17 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:48.571363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:48.627945 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3158e05-5a3b-4796-bf93-3873f03a2d04 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:48.656069 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180c3c6-bbe2-4a47-aa89-cb17e718bd17 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:48.662279 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48336e74-ade3-4aba-8aec-426d6f0ed9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:48.662914 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48336e74-ade3-4aba-8aec-426d6f0ed9d8 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:48.663300 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48336e74-ade3-4aba-8aec-426d6f0ed9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:48.663917 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48336e74-ade3-4aba-8aec-426d6f0ed9d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:48.675033 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48336e74-ade3-4aba-8aec-426d6f0ed9d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:48.676492 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48336e74-ade3-4aba-8aec-426d6f0ed9d8 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:48.694606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-48336e74-ade3-4aba-8aec-426d6f0ed9d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:48.694606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:48.694606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:48.694606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:48.694606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:48.694606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:48.694606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:48.694606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:48.694606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:48.694606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:48.694606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:48.694606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:48.694606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:48.694606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:48.694606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:48.694606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:48.695581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:48.695581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:48.695581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:48.695581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:48.695581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:48.695581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:48.695581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:48.695581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:48.695581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:48.695581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:48.695581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:48.695581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:48.695581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:48.695581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:48.695581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:48.695581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:48.695581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:48.696476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:48.696476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:48.696476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:48.696476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 409/855] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:48.696714 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48336e74-ade3-4aba-8aec-426d6f0ed9d8 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:48.707211 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c84580-4e18-4bcc-a23c-1792e58f8c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:48.707848 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c84580-4e18-4bcc-a23c-1792e58f8c9b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:48.708133 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c84580-4e18-4bcc-a23c-1792e58f8c9b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:48.708412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c84580-4e18-4bcc-a23c-1792e58f8c9b None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:48.709047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c84580-4e18-4bcc-a23c-1792e58f8c9b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:48.709355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c84580-4e18-4bcc-a23c-1792e58f8c9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:48.710773 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c84580-4e18-4bcc-a23c-1792e58f8c9b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:48.716490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 447/856] 10.222.0.79 () {56 vars in 1126 bytes} [Fri Sep 2 21:02:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:48.717397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c84580-4e18-4bcc-a23c-1792e58f8c9b None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:48.729595 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:48.801561 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48336e74-ade3-4aba-8aec-426d6f0ed9d8 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:48.802819 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:48.821243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c84580-4e18-4bcc-a23c-1792e58f8c9b None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:48.835702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac484b2-603b-422f-9457-e0edc3255c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:48.836243 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac484b2-603b-422f-9457-e0edc3255c3a None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:48.836524 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac484b2-603b-422f-9457-e0edc3255c3a None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:48.836803 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac484b2-603b-422f-9457-e0edc3255c3a None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:48.837443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac484b2-603b-422f-9457-e0edc3255c3a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:48.837753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac484b2-603b-422f-9457-e0edc3255c3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:48.839147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac484b2-603b-422f-9457-e0edc3255c3a None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:48.843638 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 410/857] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Sep 2 21:02:48 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:48.845235 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac484b2-603b-422f-9457-e0edc3255c3a None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:48.875883 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5a41e-a950-457e-8a1b-b2c19b81c723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:48.876806 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5a41e-a950-457e-8a1b-b2c19b81c723 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:48.877090 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5a41e-a950-457e-8a1b-b2c19b81c723 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:48.877373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5a41e-a950-457e-8a1b-b2c19b81c723 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:48.885938 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5a41e-a950-457e-8a1b-b2c19b81c723 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:48.887474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5a41e-a950-457e-8a1b-b2c19b81c723 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:48.901095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-f3e5a41e-a950-457e-8a1b-b2c19b81c723 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:48.901095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:48.901095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:48.901095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:48.901095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:48.901095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:48.901095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:48.901095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:48.901095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:48.901095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:48.901095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:48.901095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:48.901095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:48.901095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:48.901095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:48.902143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:48.902143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:48.902143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:48.902143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:48.902143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:48.902143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:48.902143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:48.902143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:48.902143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:48.902143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:48.902143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:48.902143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:48.902143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:48.902143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:48.902143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:48.902143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:48.902143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:48.903073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:48.903073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:48.903073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:48.903073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:48.903073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:48.903073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:48.903073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:48.903073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:48.903073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 448/858] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:48.903563 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5a41e-a950-457e-8a1b-b2c19b81c723 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:48.964665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:48.973547 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac484b2-603b-422f-9457-e0edc3255c3a None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:49.021767 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3161fd8-9fc2-40d1-b272-88bd9bcb19ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:49.022508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3161fd8-9fc2-40d1-b272-88bd9bcb19ed None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:49.022800 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3161fd8-9fc2-40d1-b272-88bd9bcb19ed None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:49.023083 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3161fd8-9fc2-40d1-b272-88bd9bcb19ed None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:49.023750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3161fd8-9fc2-40d1-b272-88bd9bcb19ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:49.024080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3161fd8-9fc2-40d1-b272-88bd9bcb19ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:49.025441 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3161fd8-9fc2-40d1-b272-88bd9bcb19ed None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:49.026375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5a41e-a950-457e-8a1b-b2c19b81c723 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:49.040954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 411/859] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:49.041974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3161fd8-9fc2-40d1-b272-88bd9bcb19ed None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:49.071129 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bef77e-f4ba-4ae3-a79e-c9c1edac655d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:49.071751 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bef77e-f4ba-4ae3-a79e-c9c1edac655d None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:49.072035 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bef77e-f4ba-4ae3-a79e-c9c1edac655d None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:49.072314 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bef77e-f4ba-4ae3-a79e-c9c1edac655d None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:49.072954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bef77e-f4ba-4ae3-a79e-c9c1edac655d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:49.073265 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bef77e-f4ba-4ae3-a79e-c9c1edac655d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:49.074686 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bef77e-f4ba-4ae3-a79e-c9c1edac655d None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:49.080679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 449/860] 10.222.0.79 () {56 vars in 1126 bytes} [Fri Sep 2 21:02:48 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:49.081512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bef77e-f4ba-4ae3-a79e-c9c1edac655d None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:49.099666 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:49.179266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3161fd8-9fc2-40d1-b272-88bd9bcb19ed None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:49.220420 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea478107-60c3-4bf1-bc21-14b2c58c3920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:49.220893 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea478107-60c3-4bf1-bc21-14b2c58c3920 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:49.221206 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea478107-60c3-4bf1-bc21-14b2c58c3920 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:49.221488 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea478107-60c3-4bf1-bc21-14b2c58c3920 None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:49.222358 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea478107-60c3-4bf1-bc21-14b2c58c3920 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:49.222709 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea478107-60c3-4bf1-bc21-14b2c58c3920 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:49.224143 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea478107-60c3-4bf1-bc21-14b2c58c3920 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:49.243453 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 412/861] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:49.244592 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bef77e-f4ba-4ae3-a79e-c9c1edac655d None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:49.245026 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea478107-60c3-4bf1-bc21-14b2c58c3920 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:49.271824 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:49.291661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325872e3-844e-43c8-a71d-f61fe54b8b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:49.292838 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325872e3-844e-43c8-a71d-f61fe54b8b73 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:49.293379 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325872e3-844e-43c8-a71d-f61fe54b8b73 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:49.293894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325872e3-844e-43c8-a71d-f61fe54b8b73 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:49.302929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325872e3-844e-43c8-a71d-f61fe54b8b73 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:49.304759 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325872e3-844e-43c8-a71d-f61fe54b8b73 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:49.317231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-325872e3-844e-43c8-a71d-f61fe54b8b73 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:02:49.317231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:49.317231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:49.317231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:49.317231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:49.317231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:49.317231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:49.317231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:49.317231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:49.317231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:49.317231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:49.317231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:49.317231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:49.317231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:49.317231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:49.317231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:49.318781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:49.318781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:49.318781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:49.318781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:49.318781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:49.318781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:49.318781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:49.318781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:49.318781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:49.318781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:49.318781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:49.318781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:49.318781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:49.318781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:49.318781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:49.318781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:49.318781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:49.318781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:49.319729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:49.319729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:49.319729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:49.319729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:49.319729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:49.319729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:49.319729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:49.319729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:49.319729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 02 21:02:49.319729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:49.322462 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 450/862] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:02:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:49.329571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325872e3-844e-43c8-a71d-f61fe54b8b73 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:49.386343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea478107-60c3-4bf1-bc21-14b2c58c3920 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:49.431457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a70d39-725a-45e3-a7a3-38979894f464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:49.432377 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a70d39-725a-45e3-a7a3-38979894f464 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:49.432848 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a70d39-725a-45e3-a7a3-38979894f464 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:49.433305 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a70d39-725a-45e3-a7a3-38979894f464 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:49.434271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a70d39-725a-45e3-a7a3-38979894f464 None admin] RBAC: Adding query filter params (role.id=1c1ddcbda0754702bb016952e90405ca, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=f45f65dd3a844cb583e42d837d2a58d5) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:49.434800 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a70d39-725a-45e3-a7a3-38979894f464 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:49.436413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a70d39-725a-45e3-a7a3-38979894f464 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:49.436534 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:49.450110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 413/863] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:49 2022] GET /identity/v3/role_assignments?user.id=f45f65dd3a844cb583e42d837d2a58d5&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=1c1ddcbda0754702bb016952e90405ca => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:49.481323 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325872e3-844e-43c8-a71d-f61fe54b8b73 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:49.522932 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a7143-d63b-46de-8ce4-55509dcff024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:49.523550 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a7143-d63b-46de-8ce4-55509dcff024 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:49.523831 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a7143-d63b-46de-8ce4-55509dcff024 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:49.524104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a7143-d63b-46de-8ce4-55509dcff024 None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:49.524843 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a7143-d63b-46de-8ce4-55509dcff024 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:49.525149 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a7143-d63b-46de-8ce4-55509dcff024 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:49.526647 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a7143-d63b-46de-8ce4-55509dcff024 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:49.549712 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 451/864] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Sep 2 21:02:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:49.555577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a70d39-725a-45e3-a7a3-38979894f464 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:49.648321 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:49.672973 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a70d39-725a-45e3-a7a3-38979894f464 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:49.717016 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047fb81-93f6-47a6-8e60-7a32610deffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:49.725235 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047fb81-93f6-47a6-8e60-7a32610deffd None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:49.725235 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047fb81-93f6-47a6-8e60-7a32610deffd None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:49.725235 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047fb81-93f6-47a6-8e60-7a32610deffd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:49.802044 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047fb81-93f6-47a6-8e60-7a32610deffd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:49.803879 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047fb81-93f6-47a6-8e60-7a32610deffd None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:49.889541 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:49.913458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 414/865] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:49 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:02:49.919456 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a7143-d63b-46de-8ce4-55509dcff024 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:50.027086 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a7143-d63b-46de-8ce4-55509dcff024 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:50.052948 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:50.064622 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c36fc8-12ef-439a-b9b2-345900c4731b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:50.065270 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c36fc8-12ef-439a-b9b2-345900c4731b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:50.065553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c36fc8-12ef-439a-b9b2-345900c4731b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:50.069442 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c36fc8-12ef-439a-b9b2-345900c4731b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:50.079138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c36fc8-12ef-439a-b9b2-345900c4731b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:50.080752 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c36fc8-12ef-439a-b9b2-345900c4731b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:50.097412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-28c36fc8-12ef-439a-b9b2-345900c4731b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:50.097412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:50.097412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:50.097412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:50.097412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:50.097412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:50.097412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:50.097412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:50.097412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:50.097412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:50.097412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:50.097412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:50.097412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:50.097412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:50.097412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:50.097412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:50.098485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:50.098485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:50.098485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:50.098485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:50.098485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:50.098485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:50.098485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:50.098485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:50.098485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:50.098485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:50.098485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:50.098485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:50.098485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:50.098485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:50.098485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:50.098485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:50.098485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:50.099599 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:50.099599 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:50.099599 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:50.099599 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 452/866] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:50.106468 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047fb81-93f6-47a6-8e60-7a32610deffd None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:50.213712 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047fb81-93f6-47a6-8e60-7a32610deffd None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:50.252440 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee01b5e-0760-4b9a-b959-fcdd9a4c7620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:50.253066 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee01b5e-0760-4b9a-b959-fcdd9a4c7620 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:50.253354 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee01b5e-0760-4b9a-b959-fcdd9a4c7620 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:50.253617 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee01b5e-0760-4b9a-b959-fcdd9a4c7620 None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:50.254306 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee01b5e-0760-4b9a-b959-fcdd9a4c7620 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:50.254606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee01b5e-0760-4b9a-b959-fcdd9a4c7620 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:50.256040 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee01b5e-0760-4b9a-b959-fcdd9a4c7620 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:50.269758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 415/867] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:50.275692 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c36fc8-12ef-439a-b9b2-345900c4731b None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:50.387999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c36fc8-12ef-439a-b9b2-345900c4731b None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:50.423930 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7c44a-ea5b-48ee-80c2-a6d7bfb0db4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:50.424557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7c44a-ea5b-48ee-80c2-a6d7bfb0db4b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:50.424839 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7c44a-ea5b-48ee-80c2-a6d7bfb0db4b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:50.425115 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7c44a-ea5b-48ee-80c2-a6d7bfb0db4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:50.432109 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7c44a-ea5b-48ee-80c2-a6d7bfb0db4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:50.433651 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7c44a-ea5b-48ee-80c2-a6d7bfb0db4b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:50.445937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-d2c7c44a-ea5b-48ee-80c2-a6d7bfb0db4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:50.445937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:50.445937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:50.445937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:50.445937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:50.445937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:50.445937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:50.445937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:50.445937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:50.445937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:50.445937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:50.445937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:50.445937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:50.445937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:50.445937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:50.446874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:50.446874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:50.446874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:50.446874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:50.446874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:50.446874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:50.446874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:50.446874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:50.446874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:50.446874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:50.446874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:50.446874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:50.446874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:50.446874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:50.446874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:50.446874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:50.446874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:50.448146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:50.448146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:50.448146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:50.448146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:50.448146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:50.448146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:50.448146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:50.448146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:50.448146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 453/868] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:50.462961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee01b5e-0760-4b9a-b959-fcdd9a4c7620 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:50.506592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:50.576184 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee01b5e-0760-4b9a-b959-fcdd9a4c7620 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:50.612926 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe492ffe-e366-4aa0-8999-8466cf5d6a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:50.613544 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe492ffe-e366-4aa0-8999-8466cf5d6a04 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:50.613867 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe492ffe-e366-4aa0-8999-8466cf5d6a04 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:50.614154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe492ffe-e366-4aa0-8999-8466cf5d6a04 None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:50.614856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe492ffe-e366-4aa0-8999-8466cf5d6a04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:50.615164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe492ffe-e366-4aa0-8999-8466cf5d6a04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:50.616583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe492ffe-e366-4aa0-8999-8466cf5d6a04 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:50.630430 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 416/869] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:50.636544 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7c44a-ea5b-48ee-80c2-a6d7bfb0db4b None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:50.675728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:50.745866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7c44a-ea5b-48ee-80c2-a6d7bfb0db4b None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:50.782445 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f7390-8baa-4704-8551-7de794a0e124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:50.782983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f7390-8baa-4704-8551-7de794a0e124 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:50.783273 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f7390-8baa-4704-8551-7de794a0e124 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:50.783557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f7390-8baa-4704-8551-7de794a0e124 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:50.784296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f7390-8baa-4704-8551-7de794a0e124 None admin] RBAC: Adding query filter params (role.id=32e6a7f83b444d1ca9e5891a2b175f9a, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=3da2b1dc9dae413a8ee63ad67e840f8c) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:50.784613 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f7390-8baa-4704-8551-7de794a0e124 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:50.786109 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f7390-8baa-4704-8551-7de794a0e124 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:50.793397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 454/870] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:50 2022] GET /identity/v3/role_assignments?user.id=3da2b1dc9dae413a8ee63ad67e840f8c&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=32e6a7f83b444d1ca9e5891a2b175f9a => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:50.898103 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754596f6-0d0e-4e2f-9dc3-ea6d2934efcd None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:50.898579 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754596f6-0d0e-4e2f-9dc3-ea6d2934efcd None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:50.898965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754596f6-0d0e-4e2f-9dc3-ea6d2934efcd None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:50.900707 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 417/871] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:50.906514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca41dc-ada8-41ee-a8fd-02b11b413bec None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:50.906838 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca41dc-ada8-41ee-a8fd-02b11b413bec None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:50.907094 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca41dc-ada8-41ee-a8fd-02b11b413bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:50.927683 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-66ca41dc-ada8-41ee-a8fd-02b11b413bec None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:50.928888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-66ca41dc-ada8-41ee-a8fd-02b11b413bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:51.004179 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 455/872] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:51.205074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288219e-86d2-44e7-9f75-570f4448b085 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:51.205685 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288219e-86d2-44e7-9f75-570f4448b085 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:51.206246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288219e-86d2-44e7-9f75-570f4448b085 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:51.208111 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 418/873] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:51.213453 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e098cb-80ee-4de5-b99a-162bf326d066 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:51.213741 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e098cb-80ee-4de5-b99a-162bf326d066 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:51.214062 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e098cb-80ee-4de5-b99a-162bf326d066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:51.233828 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-55e098cb-80ee-4de5-b99a-162bf326d066 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:51.236699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-55e098cb-80ee-4de5-b99a-162bf326d066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:51.261963 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:51.300907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288219e-86d2-44e7-9f75-570f4448b085 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:51.319419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 456/874] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:51.414584 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:51.419178 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288219e-86d2-44e7-9f75-570f4448b085 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:51.456306 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7b62f-cd4d-45b8-bbe3-1a01c1c272d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:51.456841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7b62f-cd4d-45b8-bbe3-1a01c1c272d8 None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:51.457121 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7b62f-cd4d-45b8-bbe3-1a01c1c272d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:51.457400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7b62f-cd4d-45b8-bbe3-1a01c1c272d8 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:51.458098 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7b62f-cd4d-45b8-bbe3-1a01c1c272d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:51.459471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7b62f-cd4d-45b8-bbe3-1a01c1c272d8 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:51.538529 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 419/875] 10.222.0.79 () {60 vars in 1141 bytes} [Fri Sep 2 21:02:51 2022] POST /identity/v3/services => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:51.609793 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e098cb-80ee-4de5-b99a-162bf326d066 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:51.693722 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf679cd-3a5d-4a5a-81ca-7147db00ccb0 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:51.694343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf679cd-3a5d-4a5a-81ca-7147db00ccb0 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:51.694343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf679cd-3a5d-4a5a-81ca-7147db00ccb0 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:51.701124 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 420/876] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:51.709017 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d21048-03dc-44ca-b17b-38743bc04983 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:51.709288 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d21048-03dc-44ca-b17b-38743bc04983 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:51.709571 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d21048-03dc-44ca-b17b-38743bc04983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:51.731429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-f4d21048-03dc-44ca-b17b-38743bc04983 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:51.732660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f4d21048-03dc-44ca-b17b-38743bc04983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:51.738599 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e098cb-80ee-4de5-b99a-162bf326d066 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:51.789084 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473c725-4e6e-4a9c-947d-a9b5615ea717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:51.789983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473c725-4e6e-4a9c-947d-a9b5615ea717 None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:51.790095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473c725-4e6e-4a9c-947d-a9b5615ea717 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:51.790288 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473c725-4e6e-4a9c-947d-a9b5615ea717 None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:51.790954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473c725-4e6e-4a9c-947d-a9b5615ea717 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:51.792852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473c725-4e6e-4a9c-947d-a9b5615ea717 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:51.833828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 421/877] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:51 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:51.915226 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 457/878] 10.222.0.79 () {60 vars in 1141 bytes} [Fri Sep 2 21:02:51 2022] POST /identity/v3/services => generated 269 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:52.116245 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d21048-03dc-44ca-b17b-38743bc04983 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:52.217296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:52.230215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d21048-03dc-44ca-b17b-38743bc04983 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:52.272821 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b2c14-36a6-4512-a738-63a745e2152e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:52.273667 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b2c14-36a6-4512-a738-63a745e2152e None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:52.274049 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b2c14-36a6-4512-a738-63a745e2152e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:52.274469 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b2c14-36a6-4512-a738-63a745e2152e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:52.286136 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b2c14-36a6-4512-a738-63a745e2152e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:52.290949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-d81b2c14-36a6-4512-a738-63a745e2152e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:02:52.290949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:52.290949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:52.290949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:52.290949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:52.290949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:52.290949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:52.290949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:52.290949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:52.290949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:52.290949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:52.290949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:52.290949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:52.290949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:52.290949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:52.290949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:52.291904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:52.291904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:52.291904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:52.291904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:52.291904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:52.291904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:52.291904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:52.291904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:52.291904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:52.291904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:52.291904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:52.291904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:52.291904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:52.291904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:52.291904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:52.291904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:52.292768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:52.292768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:52.292768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:52.292768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:52.292768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:52.292768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:52.292768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:52.292768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:52.292768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:52.292768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:52.292768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:02:52.292768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:52.292768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 422/879] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Sep 2 21:02:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:52.300762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473c725-4e6e-4a9c-947d-a9b5615ea717 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:52.322497 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:52.414235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473c725-4e6e-4a9c-947d-a9b5615ea717 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:52.449578 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82513a9-4573-497a-b1ca-58dd37eaf608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:52.450604 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82513a9-4573-497a-b1ca-58dd37eaf608 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:52.451091 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82513a9-4573-497a-b1ca-58dd37eaf608 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:52.451563 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82513a9-4573-497a-b1ca-58dd37eaf608 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:52.452446 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82513a9-4573-497a-b1ca-58dd37eaf608 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:52.453509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82513a9-4573-497a-b1ca-58dd37eaf608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:52.455529 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82513a9-4573-497a-b1ca-58dd37eaf608 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:52.464821 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 458/880] 10.222.0.79 () {56 vars in 1115 bytes} [Fri Sep 2 21:02:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:52.471552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b2c14-36a6-4512-a738-63a745e2152e None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:52.581319 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b2c14-36a6-4512-a738-63a745e2152e None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:52.618011 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bf28d-64fb-4fd4-9187-2730ab9eb9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:52.618648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bf28d-64fb-4fd4-9187-2730ab9eb9f9 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:52.618924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bf28d-64fb-4fd4-9187-2730ab9eb9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:52.619194 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bf28d-64fb-4fd4-9187-2730ab9eb9f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:52.630543 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bf28d-64fb-4fd4-9187-2730ab9eb9f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:52.631984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bf28d-64fb-4fd4-9187-2730ab9eb9f9 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:52.639497 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:52.648849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-b06bf28d-64fb-4fd4-9187-2730ab9eb9f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:52.648849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:52.648849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:52.648849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:52.648849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:52.648849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:52.648849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:52.648849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:52.648849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:52.648849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:52.648849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:52.648849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:52.648849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:52.648849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:52.648849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:52.648849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:52.657605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:52.657605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:52.657605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:52.657605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:52.657605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:52.657605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:52.657605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:52.657605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:52.657605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:52.657605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:52.657605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:52.657605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:52.657605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:52.657605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:52.657605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:52.657605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:52.657605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:52.658543 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:52.658543 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:52.658543 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:52.658543 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 423/881] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:52.658787 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82513a9-4573-497a-b1ca-58dd37eaf608 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:52.771681 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:52.795571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82513a9-4573-497a-b1ca-58dd37eaf608 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:52.819689 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad796e0-9087-4f4e-8be5-f8e302063f45 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:52.820260 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad796e0-9087-4f4e-8be5-f8e302063f45 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:52.820260 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad796e0-9087-4f4e-8be5-f8e302063f45 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:52.821698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 424/882] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:52.829571 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5473637-c8a1-4088-b63e-75cc5778faff None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:52.830365 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5473637-c8a1-4088-b63e-75cc5778faff None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:52.831186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5473637-c8a1-4088-b63e-75cc5778faff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:52.834755 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189917fb-adf2-438a-ad25-a2182bc4abb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:52.835363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189917fb-adf2-438a-ad25-a2182bc4abb9 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:52.835648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189917fb-adf2-438a-ad25-a2182bc4abb9 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:52.835929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189917fb-adf2-438a-ad25-a2182bc4abb9 None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:52.836572 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189917fb-adf2-438a-ad25-a2182bc4abb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:52.836876 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189917fb-adf2-438a-ad25-a2182bc4abb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:52.838313 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189917fb-adf2-438a-ad25-a2182bc4abb9 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:52.852648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 459/883] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:52.854504 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-e5473637-c8a1-4088-b63e-75cc5778faff None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:52.855926 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e5473637-c8a1-4088-b63e-75cc5778faff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:52.858245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189917fb-adf2-438a-ad25-a2182bc4abb9 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:52.937833 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 425/884] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:02:52.971439 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189917fb-adf2-438a-ad25-a2182bc4abb9 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:53.008919 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fb726-a64a-4e3a-b7de-1ad54d8573f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:53.009660 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fb726-a64a-4e3a-b7de-1ad54d8573f3 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:53.009984 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fb726-a64a-4e3a-b7de-1ad54d8573f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:53.010263 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fb726-a64a-4e3a-b7de-1ad54d8573f3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:53.018112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fb726-a64a-4e3a-b7de-1ad54d8573f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:53.019665 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fb726-a64a-4e3a-b7de-1ad54d8573f3 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:53.021758 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:53.034130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-fe3fb726-a64a-4e3a-b7de-1ad54d8573f3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:02:53.034130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:53.034130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:53.034130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:53.034130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:53.034130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:53.034130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:53.034130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:53.034130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:53.034130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:53.034130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:53.034130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:53.034130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:53.034130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:53.034130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:53.034130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:53.037913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:53.037913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:53.037913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:53.037913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:53.037913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:53.037913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:53.037913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:53.037913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:53.037913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:53.037913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:53.037913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:53.037913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:53.037913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:53.037913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:53.037913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:53.037913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:53.037913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:53.037913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:53.038905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:53.038905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:53.038905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:53.038905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:53.038905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:53.038905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:53.038905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:53.038905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:53.038905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:02:53.038905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:53.038905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 460/885] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Sep 2 21:02:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:53.041284 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5473637-c8a1-4088-b63e-75cc5778faff None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:53.166970 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5473637-c8a1-4088-b63e-75cc5778faff None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:53.196792 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:53.207693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea94bb-054f-47b8-a5c3-844f59f3838b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:53.208383 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea94bb-054f-47b8-a5c3-844f59f3838b None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:53.208684 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea94bb-054f-47b8-a5c3-844f59f3838b None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:53.210214 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea94bb-054f-47b8-a5c3-844f59f3838b None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:53.210214 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea94bb-054f-47b8-a5c3-844f59f3838b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:53.210755 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea94bb-054f-47b8-a5c3-844f59f3838b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:53.212530 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea94bb-054f-47b8-a5c3-844f59f3838b None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:53.225543 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fb726-a64a-4e3a-b7de-1ad54d8573f3 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:53.239892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 426/886] 10.222.0.79 () {56 vars in 1149 bytes} [Fri Sep 2 21:02:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:53.245535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea94bb-054f-47b8-a5c3-844f59f3838b None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:53.338620 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fb726-a64a-4e3a-b7de-1ad54d8573f3 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:53.355604 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea94bb-054f-47b8-a5c3-844f59f3838b None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:53.378470 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ffe55-9475-4930-9bc7-61cbdbf4b618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:53.379471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ffe55-9475-4930-9bc7-61cbdbf4b618 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:53.379978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ffe55-9475-4930-9bc7-61cbdbf4b618 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:53.380458 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ffe55-9475-4930-9bc7-61cbdbf4b618 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:53.381252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ffe55-9475-4930-9bc7-61cbdbf4b618 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:53.382889 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ffe55-9475-4930-9bc7-61cbdbf4b618 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:53.393240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-172ffe55-9475-4930-9bc7-61cbdbf4b618 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:02:53.393240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:53.393240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:53.393240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:53.393240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:53.393240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:53.393240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:53.393240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:53.393240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:02:53.393240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:53.393240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:53.393240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:53.393240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:53.393240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:53.393240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:53.393240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:53.393240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:53.394340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:53.394340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:53.394340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:53.394340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:53.394340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:53.394340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:53.394340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:53.394340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:53.394340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:53.394340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:53.394340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:53.394340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:53.394340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:53.394340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:53.394340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:53.394340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:53.395187 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:53.395187 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:53.395187 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:53.395187 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:53.395187 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:53.395187 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:53.395187 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:53.395187 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:53.395187 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:53.395187 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:53.395187 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:53.395187 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:53.395187 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:02:53.395187 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:53.395920 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c2593-efff-4fb3-9792-67a99e660948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:53.395920 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c2593-efff-4fb3-9792-67a99e660948 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:53.395920 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c2593-efff-4fb3-9792-67a99e660948 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:53.395920 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c2593-efff-4fb3-9792-67a99e660948 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:53.402956 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 461/887] 10.222.0.79 () {56 vars in 1126 bytes} [Fri Sep 2 21:02:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:53.407250 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ffe55-9475-4930-9bc7-61cbdbf4b618 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:53.458781 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:53.479708 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c2593-efff-4fb3-9792-67a99e660948 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:53.481029 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c2593-efff-4fb3-9792-67a99e660948 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:53.500391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:53.552667 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ffe55-9475-4930-9bc7-61cbdbf4b618 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:53.591171 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9f5a9-6024-4962-ae94-85fd6bcac0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:53.591817 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9f5a9-6024-4962-ae94-85fd6bcac0d1 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:53.592105 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9f5a9-6024-4962-ae94-85fd6bcac0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:53.592380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9f5a9-6024-4962-ae94-85fd6bcac0d1 None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:53.593023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9f5a9-6024-4962-ae94-85fd6bcac0d1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:53.593330 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9f5a9-6024-4962-ae94-85fd6bcac0d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:53.595981 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9f5a9-6024-4962-ae94-85fd6bcac0d1 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:53.606057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 462/888] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Sep 2 21:02:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:53.608687 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9f5a9-6024-4962-ae94-85fd6bcac0d1 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:53.616394 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 427/889] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:02:53 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 02 21:02:53.617314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c2593-efff-4fb3-9792-67a99e660948 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:53.717395 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:53.724008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9f5a9-6024-4962-ae94-85fd6bcac0d1 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:53.736433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c2593-efff-4fb3-9792-67a99e660948 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:53.752198 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:53.761132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee445e9-1bf1-45cb-8397-c8f178dd8215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:53.761746 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee445e9-1bf1-45cb-8397-c8f178dd8215 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:53.762121 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee445e9-1bf1-45cb-8397-c8f178dd8215 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:53.762625 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee445e9-1bf1-45cb-8397-c8f178dd8215 None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:53.762967 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee445e9-1bf1-45cb-8397-c8f178dd8215 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:53.763280 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee445e9-1bf1-45cb-8397-c8f178dd8215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:53.764659 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee445e9-1bf1-45cb-8397-c8f178dd8215 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:53.769648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 463/890] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Sep 2 21:02:53 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:53.770903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf7f2b-b61c-4442-a74b-59cc1a6edf60 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:53.771192 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf7f2b-b61c-4442-a74b-59cc1a6edf60 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:53.771470 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf7f2b-b61c-4442-a74b-59cc1a6edf60 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:53.772716 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 464/891] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:53.778928 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe7c2e-a431-458e-83a8-5d25438b3bd1 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:53.779498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe7c2e-a431-458e-83a8-5d25438b3bd1 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:53.779780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe7c2e-a431-458e-83a8-5d25438b3bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:53.784606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7fb8c-b637-4c9d-82cc-68f77c1d6c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:53.785549 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7fb8c-b637-4c9d-82cc-68f77c1d6c33 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:53.786132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7fb8c-b637-4c9d-82cc-68f77c1d6c33 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:53.786780 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7fb8c-b637-4c9d-82cc-68f77c1d6c33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:53.799229 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7fb8c-b637-4c9d-82cc-68f77c1d6c33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:53.800388 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-8bbe7c2e-a431-458e-83a8-5d25438b3bd1 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:53.801234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7fb8c-b637-4c9d-82cc-68f77c1d6c33 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:53.801788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-8bbe7c2e-a431-458e-83a8-5d25438b3bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:53.819448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-f7b7fb8c-b637-4c9d-82cc-68f77c1d6c33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:53.819448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:53.819448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:53.819448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:53.819448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:53.819448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:53.819448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:53.819448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:53.819448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:53.819448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:53.819448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:53.819448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:53.819448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:53.819448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:53.819448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:53.819448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:53.822990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:53.822990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:53.822990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:53.822990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:53.822990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:53.822990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:53.822990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:53.822990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:53.822990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:53.822990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:53.822990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:53.822990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:53.822990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:53.822990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:53.822990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:53.822990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:53.822990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:53.824015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:53.824015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:53.824015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:53.824015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 428/892] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:53.835060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7fb8c-b637-4c9d-82cc-68f77c1d6c33 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:53.890177 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 465/893] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:02:53.962586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7fb8c-b637-4c9d-82cc-68f77c1d6c33 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:53.998920 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446c593-f28b-479e-86da-e5eb36623427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:53.999454 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446c593-f28b-479e-86da-e5eb36623427 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:53.999823 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446c593-f28b-479e-86da-e5eb36623427 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:54.000603 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446c593-f28b-479e-86da-e5eb36623427 None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:54.001315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446c593-f28b-479e-86da-e5eb36623427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:54.001681 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446c593-f28b-479e-86da-e5eb36623427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:54.003090 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446c593-f28b-479e-86da-e5eb36623427 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:54.012621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:54.016792 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977ba3c-960e-46f3-82cb-b22f0cf1855c None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:54.017204 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 429/894] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:54.017312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977ba3c-960e-46f3-82cb-b22f0cf1855c None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:54.017479 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977ba3c-960e-46f3-82cb-b22f0cf1855c None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:54.019091 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 466/895] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:54.022696 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446c593-f28b-479e-86da-e5eb36623427 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:54.024474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf0eda-874f-4e9f-b3aa-71da4d35caf4 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:54.024764 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf0eda-874f-4e9f-b3aa-71da4d35caf4 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:54.025044 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf0eda-874f-4e9f-b3aa-71da4d35caf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:54.046322 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-51cf0eda-874f-4e9f-b3aa-71da4d35caf4 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:54.048003 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-51cf0eda-874f-4e9f-b3aa-71da4d35caf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:54.130214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 467/896] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:54.149530 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446c593-f28b-479e-86da-e5eb36623427 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:54.167842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf0eda-874f-4e9f-b3aa-71da4d35caf4 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:54.190676 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f85d51-603b-4082-b8b1-13a20cd018c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:54.191881 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f85d51-603b-4082-b8b1-13a20cd018c4 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:54.192232 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f85d51-603b-4082-b8b1-13a20cd018c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:54.192523 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f85d51-603b-4082-b8b1-13a20cd018c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:54.202156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f85d51-603b-4082-b8b1-13a20cd018c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:54.205184 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f85d51-603b-4082-b8b1-13a20cd018c4 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:54.220277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-e2f85d51-603b-4082-b8b1-13a20cd018c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:54.220277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:54.220277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:54.220277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:54.220277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:54.220277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:54.220277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:54.220277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:54.220277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:54.220277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:54.220277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:54.220277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:54.220277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:54.220277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:54.220277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:54.221256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:54.221256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:54.221256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:54.221256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:54.221256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:54.221256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:54.221256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:54.221256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:54.221256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:54.221256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:54.221256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:54.221256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:54.221256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:54.221256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:54.221256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:54.221256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:54.221256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:54.222280 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:54.222280 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:54.222280 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:54.222280 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:54.222280 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:54.222280 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:54.222280 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:54.222280 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:54.222280 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 430/897] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:54.227415 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f85d51-603b-4082-b8b1-13a20cd018c4 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:54.230208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:54.293298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf0eda-874f-4e9f-b3aa-71da4d35caf4 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:54.294560 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:54.342525 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f85d51-603b-4082-b8b1-13a20cd018c4 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:54.344103 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed57443-6529-462c-9782-e7a01ca30792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:54.344862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed57443-6529-462c-9782-e7a01ca30792 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:54.345221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed57443-6529-462c-9782-e7a01ca30792 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:54.345581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed57443-6529-462c-9782-e7a01ca30792 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:54.346560 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed57443-6529-462c-9782-e7a01ca30792 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:54.348947 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed57443-6529-462c-9782-e7a01ca30792 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:54.360851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-3ed57443-6529-462c-9782-e7a01ca30792 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 21:02:54.360851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:54.360851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:54.360851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:54.360851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:54.360851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:54.360851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:54.360851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:54.360851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 21:02:54.360851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:54.360851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:54.360851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:54.360851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:54.360851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:54.360851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:54.360851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:54.360851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:54.361911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:54.361911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:54.361911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:54.361911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:54.361911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:54.361911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:54.361911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:54.361911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:54.361911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:54.361911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:54.361911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:54.361911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:54.361911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:54.361911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:54.361911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:54.361911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:54.367725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:54.367725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:54.367725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:54.367725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:54.367725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:54.367725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:54.367725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:54.367725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:54.367725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:54.367725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:54.367725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:54.367725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:54.367725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 21:02:54.367725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:54.367725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 468/898] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Sep 2 21:02:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:54.370093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed57443-6529-462c-9782-e7a01ca30792 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:54.391606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e5fbc-be8b-47ee-8fcc-3d162eae4ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:54.392279 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e5fbc-be8b-47ee-8fcc-3d162eae4ec1 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:54.392572 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e5fbc-be8b-47ee-8fcc-3d162eae4ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:54.392850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e5fbc-be8b-47ee-8fcc-3d162eae4ec1 None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:54.393845 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e5fbc-be8b-47ee-8fcc-3d162eae4ec1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:54.394167 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e5fbc-be8b-47ee-8fcc-3d162eae4ec1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:54.396037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e5fbc-be8b-47ee-8fcc-3d162eae4ec1 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:54.411828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 431/899] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:54.412689 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e5fbc-be8b-47ee-8fcc-3d162eae4ec1 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:54.497546 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed57443-6529-462c-9782-e7a01ca30792 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:54.513230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:54.521304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e5fbc-be8b-47ee-8fcc-3d162eae4ec1 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:54.533686 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d6a42-6589-4e0a-8f25-b0c1b28d21bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:54.534370 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d6a42-6589-4e0a-8f25-b0c1b28d21bf None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:54.539000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d6a42-6589-4e0a-8f25-b0c1b28d21bf None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:54.539000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d6a42-6589-4e0a-8f25-b0c1b28d21bf None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:54.539000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d6a42-6589-4e0a-8f25-b0c1b28d21bf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:54.539000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d6a42-6589-4e0a-8f25-b0c1b28d21bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:54.539000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d6a42-6589-4e0a-8f25-b0c1b28d21bf None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:54.542339 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 469/900] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Sep 2 21:02:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:54.543272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d6a42-6589-4e0a-8f25-b0c1b28d21bf None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:54.548298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:54.576368 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8117907-2fb4-47e4-8297-e6327b5f32a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:54.577237 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8117907-2fb4-47e4-8297-e6327b5f32a5 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:54.577666 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8117907-2fb4-47e4-8297-e6327b5f32a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:54.578345 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8117907-2fb4-47e4-8297-e6327b5f32a5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:54.579439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8117907-2fb4-47e4-8297-e6327b5f32a5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:54.581019 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8117907-2fb4-47e4-8297-e6327b5f32a5 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:54.590166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-b8117907-2fb4-47e4-8297-e6327b5f32a5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 21:02:54.590166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:54.590166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:54.590166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:54.590166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:54.590166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:54.590166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:54.590166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:54.590166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 21:02:54.590166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:54.590166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:54.590166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:54.590166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:54.590166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:54.590166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:54.590166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:54.591220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:54.591220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:54.591220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:54.591220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:54.591220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:54.591220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:54.591220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:54.591220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:54.591220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:54.591220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:54.591220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:54.591220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:54.591220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:54.591220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:54.591220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:54.591220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:54.591220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:54.592286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:54.592286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:54.592286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:54.592286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:54.592286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:54.592286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:54.592286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:54.592286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:54.592286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:54.592286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:54.592286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:54.592286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:54.592286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 21:02:54.592286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:54.594814 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 432/901] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Sep 2 21:02:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:54.595758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8117907-2fb4-47e4-8297-e6327b5f32a5 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:54.657999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d6a42-6589-4e0a-8f25-b0c1b28d21bf None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:54.699471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91252b26-7ca3-4bce-9bd2-4477670e08b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:54.700151 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91252b26-7ca3-4bce-9bd2-4477670e08b2 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:54.700441 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91252b26-7ca3-4bce-9bd2-4477670e08b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:54.700718 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91252b26-7ca3-4bce-9bd2-4477670e08b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:54.701448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91252b26-7ca3-4bce-9bd2-4477670e08b2 None admin] RBAC: Adding query filter params (role.id=5916d78324aa4a8584dbcc3a45e32746, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=f45f65dd3a844cb583e42d837d2a58d5) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:54.701761 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91252b26-7ca3-4bce-9bd2-4477670e08b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:54.706028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91252b26-7ca3-4bce-9bd2-4477670e08b2 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:54.710321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 470/902] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:02:54 2022] GET /identity/v3/role_assignments?user.id=f45f65dd3a844cb583e42d837d2a58d5&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=5916d78324aa4a8584dbcc3a45e32746 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:54.711140 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91252b26-7ca3-4bce-9bd2-4477670e08b2 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:54.741529 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8117907-2fb4-47e4-8297-e6327b5f32a5 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:54.770988 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:54.785060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2995f5b-2a81-4067-b222-556a0898e227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:54.786153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2995f5b-2a81-4067-b222-556a0898e227 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:54.786668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2995f5b-2a81-4067-b222-556a0898e227 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:54.787176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2995f5b-2a81-4067-b222-556a0898e227 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:54.788099 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2995f5b-2a81-4067-b222-556a0898e227 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:54.788618 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2995f5b-2a81-4067-b222-556a0898e227 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:54.790277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2995f5b-2a81-4067-b222-556a0898e227 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:54.796667 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 433/903] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Sep 2 21:02:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:54.807113 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2995f5b-2a81-4067-b222-556a0898e227 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:54.866993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91252b26-7ca3-4bce-9bd2-4477670e08b2 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:54.871700 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:54.915285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b7222-6d45-429e-963b-da13e6ccf771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:54.915929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b7222-6d45-429e-963b-da13e6ccf771 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:54.916215 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b7222-6d45-429e-963b-da13e6ccf771 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:54.916493 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b7222-6d45-429e-963b-da13e6ccf771 None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:54.917206 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b7222-6d45-429e-963b-da13e6ccf771 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:54.917520 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b7222-6d45-429e-963b-da13e6ccf771 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:54.918997 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b7222-6d45-429e-963b-da13e6ccf771 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:54.925381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 471/904] 10.222.0.79 () {56 vars in 1126 bytes} [Fri Sep 2 21:02:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:54.931236 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b7222-6d45-429e-963b-da13e6ccf771 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:54.959237 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2995f5b-2a81-4067-b222-556a0898e227 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:55.001925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169847a-26f3-4123-bc83-fe8dbaa48d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:55.002643 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169847a-26f3-4123-bc83-fe8dbaa48d06 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:55.003041 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169847a-26f3-4123-bc83-fe8dbaa48d06 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:55.003417 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169847a-26f3-4123-bc83-fe8dbaa48d06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:55.004225 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169847a-26f3-4123-bc83-fe8dbaa48d06 None admin] RBAC: Adding query filter params (interface=public, service_id=ce2820fabd00454e868f961c70b49228, region_id=RegionOne) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:55.004638 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169847a-26f3-4123-bc83-fe8dbaa48d06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:55.006139 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169847a-26f3-4123-bc83-fe8dbaa48d06 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:55.016934 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 434/905] 10.222.0.79 () {56 vars in 1251 bytes} [Fri Sep 2 21:02:54 2022] GET /identity/v3/endpoints?service_id=ce2820fabd00454e868f961c70b49228&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:55.018164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169847a-26f3-4123-bc83-fe8dbaa48d06 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:55.060453 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b7222-6d45-429e-963b-da13e6ccf771 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:55.068474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:55.096974 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d44fe7-0da3-4bfa-b8b9-075fd24504cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:55.097647 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d44fe7-0da3-4bfa-b8b9-075fd24504cb None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:55.098009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d44fe7-0da3-4bfa-b8b9-075fd24504cb None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:55.098288 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d44fe7-0da3-4bfa-b8b9-075fd24504cb None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:55.098925 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d44fe7-0da3-4bfa-b8b9-075fd24504cb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:55.099235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d44fe7-0da3-4bfa-b8b9-075fd24504cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:55.100617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d44fe7-0da3-4bfa-b8b9-075fd24504cb None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:55.111087 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 472/906] 10.222.0.79 () {56 vars in 1126 bytes} [Fri Sep 2 21:02:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:02:55.112034 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d44fe7-0da3-4bfa-b8b9-075fd24504cb None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:55.152910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169847a-26f3-4123-bc83-fe8dbaa48d06 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:55.165826 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:55.202492 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67703c24-d49c-4065-b822-50835993700b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:55.204130 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67703c24-d49c-4065-b822-50835993700b None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:55.205043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67703c24-d49c-4065-b822-50835993700b None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:55.206107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67703c24-d49c-4065-b822-50835993700b None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:55.207199 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67703c24-d49c-4065-b822-50835993700b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:55.209259 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67703c24-d49c-4065-b822-50835993700b None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:55.221840 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 435/907] 10.222.0.79 () {56 vars in 1087 bytes} [Fri Sep 2 21:02:55 2022] GET /identity/v3/services => generated 1268 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:02:55.244122 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d44fe7-0da3-4bfa-b8b9-075fd24504cb None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:55.286133 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f234d-79a2-44f6-975c-7e1fbec3242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:55.287025 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f234d-79a2-44f6-975c-7e1fbec3242f None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:55.287464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f234d-79a2-44f6-975c-7e1fbec3242f None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:55.287995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f234d-79a2-44f6-975c-7e1fbec3242f None admin] PATH_INFO: `/v3/endpoints` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:55.288873 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f234d-79a2-44f6-975c-7e1fbec3242f None admin] RBAC: Adding query filter params (interface=public, service_id=0292768b649449018a6f0ad8337b9ef4, region_id=RegionOne) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:55.289345 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f234d-79a2-44f6-975c-7e1fbec3242f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:55.290939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f234d-79a2-44f6-975c-7e1fbec3242f None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:55.299118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 473/908] 10.222.0.79 () {56 vars in 1251 bytes} [Fri Sep 2 21:02:55 2022] GET /identity/v3/endpoints?service_id=0292768b649449018a6f0ad8337b9ef4&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:55.307581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67703c24-d49c-4065-b822-50835993700b None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:55.422055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67703c24-d49c-4065-b822-50835993700b None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:55.458874 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ae4c8-a61a-4d65-8d74-863b46be64d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:55.459486 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ae4c8-a61a-4d65-8d74-863b46be64d4 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:55.459770 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ae4c8-a61a-4d65-8d74-863b46be64d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:55.460049 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ae4c8-a61a-4d65-8d74-863b46be64d4 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:55.460671 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ae4c8-a61a-4d65-8d74-863b46be64d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:55.462064 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ae4c8-a61a-4d65-8d74-863b46be64d4 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:55.468264 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 436/909] 10.222.0.79 () {56 vars in 1087 bytes} [Fri Sep 2 21:02:55 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:02:55.811731 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b759012-c37e-464c-9590-a5f4097723ad None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:55.812360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b759012-c37e-464c-9590-a5f4097723ad None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:55.812360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b759012-c37e-464c-9590-a5f4097723ad None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:55.814181 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 474/910] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:55.820150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535ecfa-1de9-434f-b2b9-ff0db2f7417c None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:55.820471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535ecfa-1de9-434f-b2b9-ff0db2f7417c None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:55.820726 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535ecfa-1de9-434f-b2b9-ff0db2f7417c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:55.840117 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-4535ecfa-1de9-434f-b2b9-ff0db2f7417c None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:55.841320 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-4535ecfa-1de9-434f-b2b9-ff0db2f7417c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:55.871679 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:55.920779 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 437/911] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:56.194259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b759012-c37e-464c-9590-a5f4097723ad None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:56.234079 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:56.308795 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b759012-c37e-464c-9590-a5f4097723ad None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:56.352997 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c0d9a-29d2-49b0-bcbc-ea6545a55124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:56.354013 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c0d9a-29d2-49b0-bcbc-ea6545a55124 None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:56.354506 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c0d9a-29d2-49b0-bcbc-ea6545a55124 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:56.355012 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c0d9a-29d2-49b0-bcbc-ea6545a55124 None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:56.355875 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c0d9a-29d2-49b0-bcbc-ea6545a55124 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:56.357456 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c0d9a-29d2-49b0-bcbc-ea6545a55124 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:56.452458 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 475/912] 10.222.0.79 () {60 vars in 1141 bytes} [Fri Sep 2 21:02:56 2022] POST /identity/v3/services => generated 241 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:56.681121 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec0860-9f47-4a2e-8aac-d17a795e0a14 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:56.681524 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec0860-9f47-4a2e-8aac-d17a795e0a14 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:56.681705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec0860-9f47-4a2e-8aac-d17a795e0a14 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:56.683364 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 438/913] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:56.694991 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a796e-b3a3-472d-9929-576dee3b8628 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:56.695289 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a796e-b3a3-472d-9929-576dee3b8628 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:56.695571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a796e-b3a3-472d-9929-576dee3b8628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:56.718233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-f73a796e-b3a3-472d-9929-576dee3b8628 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:56.719445 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f73a796e-b3a3-472d-9929-576dee3b8628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:56.801355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 476/914] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:57.076334 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec0860-9f47-4a2e-8aac-d17a795e0a14 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:57.186341 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec0860-9f47-4a2e-8aac-d17a795e0a14 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:57.227340 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2c5a2-cdad-4643-8473-432948c39273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:57.227988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2c5a2-cdad-4643-8473-432948c39273 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:57.228264 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2c5a2-cdad-4643-8473-432948c39273 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:57.228538 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2c5a2-cdad-4643-8473-432948c39273 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:57.239610 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2c5a2-cdad-4643-8473-432948c39273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:02:57.244437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-7ce2c5a2-cdad-4643-8473-432948c39273 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:02:57.244437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:57.244437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:57.244437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:57.244437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:57.244437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:57.244437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:57.244437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:57.244437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:57.244437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:57.244437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:57.244437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:57.244437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:02:57.244437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:02:57.244437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:02:57.244437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:02:57.246311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:02:57.246311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:02:57.246311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:02:57.246311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:02:57.246311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:57.246311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:57.246311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:57.246311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:57.246311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:57.246311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:57.246311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:57.246311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:57.246311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:57.246311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:57.246311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:57.246311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:57.248012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:57.248012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:57.248012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:57.248012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:57.248012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:02:57.248012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:02:57.248012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:02:57.248012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:02:57.248012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:02:57.248012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:02:57.248012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:02:57.248012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:57.248012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 439/915] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Sep 2 21:02:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:57.253273 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a796e-b3a3-472d-9929-576dee3b8628 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:57.282162 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:57.336616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03618d-d20f-4c31-8cec-b5793a09a0c2 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:57.336794 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03618d-d20f-4c31-8cec-b5793a09a0c2 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:57.337063 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03618d-d20f-4c31-8cec-b5793a09a0c2 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:57.339299 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 440/916] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:57.345331 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13671fc-fd67-4ffe-9ed4-fd55197ed37f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:57.345622 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13671fc-fd67-4ffe-9ed4-fd55197ed37f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:57.346168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13671fc-fd67-4ffe-9ed4-fd55197ed37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:57.368119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-f13671fc-fd67-4ffe-9ed4-fd55197ed37f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:57.369308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f13671fc-fd67-4ffe-9ed4-fd55197ed37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:57.371383 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a796e-b3a3-472d-9929-576dee3b8628 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:57.392651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:57.410710 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f5fcc-8c96-44da-a9b3-beab6e186f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:57.411856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f5fcc-8c96-44da-a9b3-beab6e186f83 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:57.413196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f5fcc-8c96-44da-a9b3-beab6e186f83 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:57.413735 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f5fcc-8c96-44da-a9b3-beab6e186f83 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:57.414692 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f5fcc-8c96-44da-a9b3-beab6e186f83 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:57.415182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f5fcc-8c96-44da-a9b3-beab6e186f83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:57.416753 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f5fcc-8c96-44da-a9b3-beab6e186f83 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:57.433999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 477/917] 10.222.0.79 () {56 vars in 1115 bytes} [Fri Sep 2 21:02:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:57.437726 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f5fcc-8c96-44da-a9b3-beab6e186f83 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:57.465237 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 441/918] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:02:57.501936 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f131b8e-2ede-41e0-8338-5e1144b9287a None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:57.502585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f131b8e-2ede-41e0-8338-5e1144b9287a None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:57.502969 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f131b8e-2ede-41e0-8338-5e1144b9287a None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:57.504678 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 442/919] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:02:57.510317 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8942b-2721-4005-a14d-61f6e9da77b4 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:57.510606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8942b-2721-4005-a14d-61f6e9da77b4 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:57.510884 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8942b-2721-4005-a14d-61f6e9da77b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:57.527267 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:57.539999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-bdc8942b-2721-4005-a14d-61f6e9da77b4 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:57.541540 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-bdc8942b-2721-4005-a14d-61f6e9da77b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:57.548499 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f5fcc-8c96-44da-a9b3-beab6e186f83 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:57.587698 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd63ae0-9559-4f57-9716-5e737f191cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:57.588594 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd63ae0-9559-4f57-9716-5e737f191cd9 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:57.589125 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd63ae0-9559-4f57-9716-5e737f191cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:57.589662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd63ae0-9559-4f57-9716-5e737f191cd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:57.603654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd63ae0-9559-4f57-9716-5e737f191cd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:57.605317 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd63ae0-9559-4f57-9716-5e737f191cd9 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:57.621009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-6dd63ae0-9559-4f57-9716-5e737f191cd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:57.621009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:57.621009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:57.621009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:57.621009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:57.621009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:57.621009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:57.621009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:57.621009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:57.621009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:57.621009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:57.621009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:57.621009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:57.621009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:57.621009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:57.621009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:57.622248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:57.622248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:57.622248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:57.622248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:57.622248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:57.622248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:57.622248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:57.622248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:57.622248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:57.622248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:57.622248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:57.622248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:57.622248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:57.622248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:57.622248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:57.622248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:57.622248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:57.623133 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:57.623133 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:57.623133 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:57.627903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 478/920] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:57.628771 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd63ae0-9559-4f57-9716-5e737f191cd9 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:57.633157 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 443/921] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:02:57.734814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd63ae0-9559-4f57-9716-5e737f191cd9 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:57.748113 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8942b-2721-4005-a14d-61f6e9da77b4 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:57.776052 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fbe18-89f5-4a53-9f35-c7b8c2f1355f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:57.776674 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fbe18-89f5-4a53-9f35-c7b8c2f1355f None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:57.776958 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fbe18-89f5-4a53-9f35-c7b8c2f1355f None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:57.777238 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fbe18-89f5-4a53-9f35-c7b8c2f1355f None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:57.777923 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fbe18-89f5-4a53-9f35-c7b8c2f1355f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:57.778237 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fbe18-89f5-4a53-9f35-c7b8c2f1355f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:57.779702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fbe18-89f5-4a53-9f35-c7b8c2f1355f None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:57.782332 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:57.794003 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 479/922] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:57.799839 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fbe18-89f5-4a53-9f35-c7b8c2f1355f None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:57.864535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:57.885497 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8942b-2721-4005-a14d-61f6e9da77b4 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:57.918333 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fbe18-89f5-4a53-9f35-c7b8c2f1355f None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:57.939158 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33534d89-511e-477d-a84c-9f4aa6c9748a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:57.939810 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33534d89-511e-477d-a84c-9f4aa6c9748a None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:57.940089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33534d89-511e-477d-a84c-9f4aa6c9748a None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:57.940363 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33534d89-511e-477d-a84c-9f4aa6c9748a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:57.940959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33534d89-511e-477d-a84c-9f4aa6c9748a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:57.942365 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33534d89-511e-477d-a84c-9f4aa6c9748a None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:57.951758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-33534d89-511e-477d-a84c-9f4aa6c9748a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 21:02:57.951758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:57.951758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:57.951758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:57.951758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:57.951758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:57.951758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:57.951758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:57.951758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 21:02:57.951758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:57.951758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:57.951758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:57.951758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:57.951758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:57.951758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:57.951758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:57.951758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:57.953978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:57.953978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:57.953978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:57.953978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:57.953978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:57.953978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:57.953978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:57.953978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:57.953978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:57.953978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:57.953978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:57.953978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:57.953978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:57.953978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:57.953978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:57.953978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:57.954989 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:57.954989 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:57.954989 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:57.954989 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:57.954989 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:57.954989 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:57.954989 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:57.954989 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:57.954989 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:57.954989 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:57.954989 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:57.954989 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:57.954989 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 02 21:02:57.954989 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:57.954989 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 444/923] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Sep 2 21:02:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:57.955782 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33534d89-511e-477d-a84c-9f4aa6c9748a None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:57.964012 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc4475-d017-4015-accb-2e64aceb87e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:57.965073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc4475-d017-4015-accb-2e64aceb87e3 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:57.965073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc4475-d017-4015-accb-2e64aceb87e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:57.965412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc4475-d017-4015-accb-2e64aceb87e3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:57.974481 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc4475-d017-4015-accb-2e64aceb87e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:57.976344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc4475-d017-4015-accb-2e64aceb87e3 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:57.989648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-45bc4475-d017-4015-accb-2e64aceb87e3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:02:57.989648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:57.989648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:57.989648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:57.989648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:57.989648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:57.989648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:57.989648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:57.989648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:57.989648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:57.989648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:57.989648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:57.989648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:02:57.989648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:02:57.989648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:02:57.989648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:02:57.990871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:57.990871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:57.990871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:02:57.990871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:57.990871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:02:57.990871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:02:57.990871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:57.990871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:57.990871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:57.990871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:57.990871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:57.990871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:57.990871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:57.990871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:57.990871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:57.990871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:57.990871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:57.990871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:57.991932 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:57.991932 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:57.991932 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:02:57.991932 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:02:57.991932 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:02:57.991932 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:02:57.991932 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:02:57.991932 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:02:57.991932 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:02:57.991932 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:57.991932 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 480/924] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Sep 2 21:02:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:02:57.992992 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc4475-d017-4015-accb-2e64aceb87e3 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:58.057410 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:58.076814 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33534d89-511e-477d-a84c-9f4aa6c9748a None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:58.104496 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc4475-d017-4015-accb-2e64aceb87e3 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:58.115902 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4bd50-6381-493a-a214-e99bc102b177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:58.116917 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4bd50-6381-493a-a214-e99bc102b177 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:58.117092 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4bd50-6381-493a-a214-e99bc102b177 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:58.117374 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4bd50-6381-493a-a214-e99bc102b177 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:58.118017 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4bd50-6381-493a-a214-e99bc102b177 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:58.119420 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4bd50-6381-493a-a214-e99bc102b177 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:58.129567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-1cc4bd50-6381-493a-a214-e99bc102b177 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 21:02:58.129567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:58.129567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:58.129567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:58.129567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:58.129567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:58.129567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:58.129567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:58.129567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 21:02:58.129567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:58.129567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:58.129567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:58.129567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:58.129567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:58.129567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:58.129567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:58.135761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:58.135761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:58.135761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:58.135761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:58.135761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:58.135761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:58.135761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:58.135761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:58.135761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:58.135761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:58.135761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:58.135761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:58.135761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:58.135761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:58.135761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:58.135761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:58.135761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:58.136852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:58.136852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:58.136852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:58.136852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:58.136852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:58.136852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:58.136852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:58.136852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:58.136852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:58.136852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:58.136852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:58.136852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:58.136852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 02 21:02:58.136852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:58.136852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 445/925] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Sep 2 21:02:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:58.137672 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4bd50-6381-493a-a214-e99bc102b177 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:58.149547 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:58.150029 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8af993-ffa3-4a77-9283-78109c03b8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:58.150644 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8af993-ffa3-4a77-9283-78109c03b8d7 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:58.151077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8af993-ffa3-4a77-9283-78109c03b8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:58.151353 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8af993-ffa3-4a77-9283-78109c03b8d7 None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:58.151989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8af993-ffa3-4a77-9283-78109c03b8d7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:58.152296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8af993-ffa3-4a77-9283-78109c03b8d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:58.153666 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8af993-ffa3-4a77-9283-78109c03b8d7 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:58.160347 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 481/926] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Sep 2 21:02:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:58.161172 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8af993-ffa3-4a77-9283-78109c03b8d7 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:58.247932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4bd50-6381-493a-a214-e99bc102b177 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:58.273730 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8af993-ffa3-4a77-9283-78109c03b8d7 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:58.289086 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0560380-b733-4cd7-bf1f-05ee97f1570b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:58.289698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0560380-b733-4cd7-bf1f-05ee97f1570b None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:58.290019 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0560380-b733-4cd7-bf1f-05ee97f1570b None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:58.290293 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0560380-b733-4cd7-bf1f-05ee97f1570b None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:58.291027 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0560380-b733-4cd7-bf1f-05ee97f1570b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:58.291332 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0560380-b733-4cd7-bf1f-05ee97f1570b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:58.292538 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:58.292740 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0560380-b733-4cd7-bf1f-05ee97f1570b None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:58.311584 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c207e2-2c91-4491-9440-2ca9ab1784b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:58.312757 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c207e2-2c91-4491-9440-2ca9ab1784b1 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:58.313121 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c207e2-2c91-4491-9440-2ca9ab1784b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:58.313434 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c207e2-2c91-4491-9440-2ca9ab1784b1 None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:58.314109 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c207e2-2c91-4491-9440-2ca9ab1784b1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:58.314418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c207e2-2c91-4491-9440-2ca9ab1784b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:58.315802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c207e2-2c91-4491-9440-2ca9ab1784b1 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:58.317343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 446/927] 10.222.0.79 () {56 vars in 1149 bytes} [Fri Sep 2 21:02:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:58.318120 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0560380-b733-4cd7-bf1f-05ee97f1570b None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:58.321851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 482/928] 10.222.0.79 () {56 vars in 1126 bytes} [Fri Sep 2 21:02:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:58.321851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c207e2-2c91-4491-9440-2ca9ab1784b1 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:58.398405 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:58.429080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0560380-b733-4cd7-bf1f-05ee97f1570b None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:58.435496 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c207e2-2c91-4491-9440-2ca9ab1784b1 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:58.467042 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf60cf-57cf-44db-9aea-85e4a3ae3318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:58.467652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf60cf-57cf-44db-9aea-85e4a3ae3318 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:58.467940 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf60cf-57cf-44db-9aea-85e4a3ae3318 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:58.468208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf60cf-57cf-44db-9aea-85e4a3ae3318 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:58.469792 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf60cf-57cf-44db-9aea-85e4a3ae3318 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:58.470120 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf60cf-57cf-44db-9aea-85e4a3ae3318 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:58.471490 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf60cf-57cf-44db-9aea-85e4a3ae3318 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:58.481082 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 447/929] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Sep 2 21:02:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:58.481082 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf60cf-57cf-44db-9aea-85e4a3ae3318 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:58.483490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855c4ce-3d90-4c52-8289-bcf93196ca58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:58.484138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855c4ce-3d90-4c52-8289-bcf93196ca58 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:58.484523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855c4ce-3d90-4c52-8289-bcf93196ca58 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:58.484800 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855c4ce-3d90-4c52-8289-bcf93196ca58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:58.496460 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855c4ce-3d90-4c52-8289-bcf93196ca58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:58.497949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855c4ce-3d90-4c52-8289-bcf93196ca58 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:58.511926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-c855c4ce-3d90-4c52-8289-bcf93196ca58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:58.511926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:58.511926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:58.511926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:58.511926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:58.511926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:58.511926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:58.511926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:58.511926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:58.511926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:58.511926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:58.511926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:58.511926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:02:58.511926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:02:58.511926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:02:58.511926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:02:58.512954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:58.512954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:58.512954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:58.512954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:58.512954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:58.512954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:58.512954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:58.512954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:58.512954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:58.512954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:58.512954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:58.512954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:58.512954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:58.512954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:58.512954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:58.512954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:58.512954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:02:58.513854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:02:58.513854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:02:58.513854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:02:58.513854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 483/930] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:58.513854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855c4ce-3d90-4c52-8289-bcf93196ca58 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:58.548147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:58.584177 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf60cf-57cf-44db-9aea-85e4a3ae3318 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:58.618774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855c4ce-3d90-4c52-8289-bcf93196ca58 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:58.621984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6b66d-c965-4ade-aba9-6c2b6de91b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:58.622599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6b66d-c965-4ade-aba9-6c2b6de91b1d None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:58.622883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6b66d-c965-4ade-aba9-6c2b6de91b1d None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:58.623162 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6b66d-c965-4ade-aba9-6c2b6de91b1d None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:58.623802 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6b66d-c965-4ade-aba9-6c2b6de91b1d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:58.624112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6b66d-c965-4ade-aba9-6c2b6de91b1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:58.626265 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6b66d-c965-4ade-aba9-6c2b6de91b1d None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:58.628396 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:58.631516 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 448/931] 10.222.0.79 () {56 vars in 1126 bytes} [Fri Sep 2 21:02:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:58.632692 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2303594-3d24-419e-bebc-13957e09037f None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:58.632981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2303594-3d24-419e-bebc-13957e09037f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:58.633327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2303594-3d24-419e-bebc-13957e09037f None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:58.634634 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 449/932] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:02:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:02:58.635173 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2303594-3d24-419e-bebc-13957e09037f None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:58.659338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d8cb5-4289-4745-84f6-aa33b9b83b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:58.659886 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d8cb5-4289-4745-84f6-aa33b9b83b4d None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:58.660306 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d8cb5-4289-4745-84f6-aa33b9b83b4d None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:58.660603 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d8cb5-4289-4745-84f6-aa33b9b83b4d None admin] PATH_INFO: `/v3/endpoints` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:58.661261 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d8cb5-4289-4745-84f6-aa33b9b83b4d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:58.662730 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d8cb5-4289-4745-84f6-aa33b9b83b4d None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:58.739400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2303594-3d24-419e-bebc-13957e09037f None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:58.772511 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d1768-5671-45e0-b76b-d31ba1abe62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:58.773118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d1768-5671-45e0-b76b-d31ba1abe62e None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:58.773396 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d1768-5671-45e0-b76b-d31ba1abe62e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:58.773668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d1768-5671-45e0-b76b-d31ba1abe62e None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:58.774344 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d1768-5671-45e0-b76b-d31ba1abe62e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:58.774649 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d1768-5671-45e0-b76b-d31ba1abe62e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:58.776078 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d1768-5671-45e0-b76b-d31ba1abe62e None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:58.776349 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 484/933] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:02:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:58.777160 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d8cb5-4289-4745-84f6-aa33b9b83b4d None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:58.790211 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 450/934] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:58.791561 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692f9f0-d98d-4be9-b61e-992f9acd2a66 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:58.791847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692f9f0-d98d-4be9-b61e-992f9acd2a66 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:58.792122 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692f9f0-d98d-4be9-b61e-992f9acd2a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:58.812956 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-6692f9f0-d98d-4be9-b61e-992f9acd2a66 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:02:58.814405 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-6692f9f0-d98d-4be9-b61e-992f9acd2a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:02:58.883125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:58.902582 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 451/935] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:02:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:02:58.904097 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692f9f0-d98d-4be9-b61e-992f9acd2a66 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:58.910902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:58.920523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d8cb5-4289-4745-84f6-aa33b9b83b4d None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:58.974242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3762e-4131-45a3-97a2-0a2f677d4178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:58.974977 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3762e-4131-45a3-97a2-0a2f677d4178 None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:58.976525 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3762e-4131-45a3-97a2-0a2f677d4178 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:58.976806 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3762e-4131-45a3-97a2-0a2f677d4178 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:58.977487 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3762e-4131-45a3-97a2-0a2f677d4178 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:58.978994 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3762e-4131-45a3-97a2-0a2f677d4178 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:59.037081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692f9f0-d98d-4be9-b61e-992f9acd2a66 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:59.079165 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 485/936] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:02:58 2022] POST /identity/v3/endpoints => generated 347 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:02:59.090792 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e947b-a83b-42d2-966e-c115c409c231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:59.092257 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e947b-a83b-42d2-966e-c115c409c231 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:59.092866 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e947b-a83b-42d2-966e-c115c409c231 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:59.093703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e947b-a83b-42d2-966e-c115c409c231 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:59.102902 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e947b-a83b-42d2-966e-c115c409c231 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:59.104766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e947b-a83b-42d2-966e-c115c409c231 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:59.119668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-746e947b-a83b-42d2-966e-c115c409c231 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:59.119668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:59.119668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:59.119668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:59.119668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:59.119668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:59.119668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:59.119668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:59.119668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:59.119668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:59.119668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:59.119668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:59.119668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:02:59.119668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:02:59.119668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:02:59.120665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:02:59.120665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:59.120665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:59.120665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:59.120665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:59.120665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:59.120665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:59.120665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:59.120665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:59.120665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:59.120665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:59.120665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:59.120665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:59.120665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:59.120665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:59.120665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:59.120665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:59.121565 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:02:59.121565 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:02:59.121565 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:02:59.121565 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:02:59.121565 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:02:59.121565 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:02:59.121565 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:02:59.121565 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:59.128813 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 452/937] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:02:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:59.131510 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3762e-4131-45a3-97a2-0a2f677d4178 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:59.185271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e947b-a83b-42d2-966e-c115c409c231 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:59.247218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:59.260400 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3762e-4131-45a3-97a2-0a2f677d4178 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:59.308248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1117579-baf4-41a6-a0a6-e3dbcf214a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:59.308902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1117579-baf4-41a6-a0a6-e3dbcf214a60 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:59.309123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1117579-baf4-41a6-a0a6-e3dbcf214a60 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:59.309438 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1117579-baf4-41a6-a0a6-e3dbcf214a60 None admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:59.310180 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1117579-baf4-41a6-a0a6-e3dbcf214a60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:59.310565 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1117579-baf4-41a6-a0a6-e3dbcf214a60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:59.312867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1117579-baf4-41a6-a0a6-e3dbcf214a60 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:59.329978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 486/938] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:02:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:59.335891 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1117579-baf4-41a6-a0a6-e3dbcf214a60 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:59.337721 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e947b-a83b-42d2-966e-c115c409c231 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:59.345604 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:59.376687 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7007af-6771-4b9f-9b48-af61c0c68875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:59.377468 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7007af-6771-4b9f-9b48-af61c0c68875 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:59.377841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7007af-6771-4b9f-9b48-af61c0c68875 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:59.378204 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7007af-6771-4b9f-9b48-af61c0c68875 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:59.378884 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7007af-6771-4b9f-9b48-af61c0c68875 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:59.380334 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7007af-6771-4b9f-9b48-af61c0c68875 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:59.391100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-6a7007af-6771-4b9f-9b48-af61c0c68875 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:02:59.391100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:59.391100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:02:59.391100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:02:59.391100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:02:59.391100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:02:59.391100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:02:59.391100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:59.391100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:02:59.391100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:59.391100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:02:59.391100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:59.391100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:02:59.391100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:02:59.391100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:02:59.391100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:02:59.391100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:02:59.397165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:02:59.397165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:02:59.397165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:02:59.397165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:02:59.397165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:02:59.397165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:02:59.397165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:02:59.397165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:02:59.397165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:02:59.397165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:02:59.397165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:02:59.397165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:02:59.397165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:02:59.397165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:02:59.397165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:02:59.397165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:02:59.398057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:02:59.398057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:02:59.398057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:02:59.398057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:02:59.398057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:02:59.398057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:02:59.398057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:02:59.398057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:02:59.398057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:02:59.398057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:02:59.398057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:02:59.398057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:02:59.398057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:02:59.398057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:02:59.398057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 453/939] 10.222.0.79 () {56 vars in 1126 bytes} [Fri Sep 2 21:02:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:02:59.400467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7007af-6771-4b9f-9b48-af61c0c68875 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:59.457594 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1117579-baf4-41a6-a0a6-e3dbcf214a60 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:59.499336 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d52d27-f0d5-49da-9771-bce377c58c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:59.500035 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d52d27-f0d5-49da-9771-bce377c58c08 None admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:59.500462 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d52d27-f0d5-49da-9771-bce377c58c08 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:59.500739 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d52d27-f0d5-49da-9771-bce377c58c08 None admin] PATH_INFO: `/v3/projects/61c5f56764934c4a90ad38357b46f397/users/f45f65dd3a844cb583e42d837d2a58d5/roles/5916d78324aa4a8584dbcc3a45e32746` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:59.503069 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d52d27-f0d5-49da-9771-bce377c58c08 None admin] RBAC: Authorizing `identity:create_grant(project_id=61c5f56764934c4a90ad38357b46f397, user_id=f45f65dd3a844cb583e42d837d2a58d5, role_id=5916d78324aa4a8584dbcc3a45e32746)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:59.504732 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d52d27-f0d5-49da-9771-bce377c58c08 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:59.530398 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7007af-6771-4b9f-9b48-af61c0c68875 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:59.539260 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:59.568263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21856664-ab4d-47de-af5f-87904d578db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:59.568874 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21856664-ab4d-47de-af5f-87904d578db4 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:59.569155 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21856664-ab4d-47de-af5f-87904d578db4 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:59.569510 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21856664-ab4d-47de-af5f-87904d578db4 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:59.570141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21856664-ab4d-47de-af5f-87904d578db4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:59.570454 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21856664-ab4d-47de-af5f-87904d578db4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:59.571817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21856664-ab4d-47de-af5f-87904d578db4 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:59.583009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 487/940] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:02:59 2022] PUT /identity/v3/projects/61c5f56764934c4a90ad38357b46f397/users/f45f65dd3a844cb583e42d837d2a58d5/roles/5916d78324aa4a8584dbcc3a45e32746 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:02:59.584177 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 454/941] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Sep 2 21:02:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:59.590333 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d52d27-f0d5-49da-9771-bce377c58c08 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:59.687861 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:02:59.728386 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d52d27-f0d5-49da-9771-bce377c58c08 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:59.766236 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f90930-d140-4d54-ab7f-ffe511ea0300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:59.767111 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f90930-d140-4d54-ab7f-ffe511ea0300 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:59.767398 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f90930-d140-4d54-ab7f-ffe511ea0300 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:59.767678 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f90930-d140-4d54-ab7f-ffe511ea0300 None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:59.768324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f90930-d140-4d54-ab7f-ffe511ea0300 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:59.768805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f90930-d140-4d54-ab7f-ffe511ea0300 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:59.770029 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f90930-d140-4d54-ab7f-ffe511ea0300 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:59.776765 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 488/942] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Sep 2 21:02:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:59.783420 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21856664-ab4d-47de-af5f-87904d578db4 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:02:59.894836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21856664-ab4d-47de-af5f-87904d578db4 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:02:59.934370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34d62d-df07-483b-a670-f1ce308eed2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:02:59.934995 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34d62d-df07-483b-a670-f1ce308eed2e None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:02:59.935278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34d62d-df07-483b-a670-f1ce308eed2e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:02:59.935556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34d62d-df07-483b-a670-f1ce308eed2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:02:59.936279 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34d62d-df07-483b-a670-f1ce308eed2e None admin] RBAC: Adding query filter params (interface=public, service_id=22c7c254c6e14438ada2119af2888e29, region_id=RegionOne) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:02:59.936592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34d62d-df07-483b-a670-f1ce308eed2e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:02:59.938607 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34d62d-df07-483b-a670-f1ce308eed2e None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:02:59.944494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 455/943] 10.222.0.79 () {56 vars in 1251 bytes} [Fri Sep 2 21:02:59 2022] GET /identity/v3/endpoints?service_id=22c7c254c6e14438ada2119af2888e29&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:02:59.950057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f90930-d140-4d54-ab7f-ffe511ea0300 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:00.060336 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f90930-d140-4d54-ab7f-ffe511ea0300 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:00.091631 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:00.098667 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f5e4f-916c-4682-afcd-ea9251294328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:00.099472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f5e4f-916c-4682-afcd-ea9251294328 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:00.099922 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f5e4f-916c-4682-afcd-ea9251294328 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:00.100333 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f5e4f-916c-4682-afcd-ea9251294328 None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:00.106364 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f5e4f-916c-4682-afcd-ea9251294328 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:00.106364 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f5e4f-916c-4682-afcd-ea9251294328 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:00.110143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 489/944] 10.222.0.79 () {56 vars in 1087 bytes} [Fri Sep 2 21:02:59 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:03:01.136393 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715f151-d716-475b-bf18-0626a2076a4b None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:01.137176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715f151-d716-475b-bf18-0626a2076a4b None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:01.137176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715f151-d716-475b-bf18-0626a2076a4b None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:01.138571 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 456/945] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:03:01.144557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393da3de-77dc-408c-8740-5ab41398ff7f None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:01.145214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393da3de-77dc-408c-8740-5ab41398ff7f None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:01.145214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393da3de-77dc-408c-8740-5ab41398ff7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:01.172428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-393da3de-77dc-408c-8740-5ab41398ff7f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:01.174796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-393da3de-77dc-408c-8740-5ab41398ff7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:01.295163 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 490/946] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:03:01.297520 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e735500-2c7d-4139-80d4-424d8da35257 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:01.297839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e735500-2c7d-4139-80d4-424d8da35257 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:01.298226 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e735500-2c7d-4139-80d4-424d8da35257 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:01.299819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 457/947] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:01.305460 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7894b6-97e3-44f7-a93a-033fc7cba5ee None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:01.305758 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7894b6-97e3-44f7-a93a-033fc7cba5ee None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:01.306071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7894b6-97e3-44f7-a93a-033fc7cba5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:01.330020 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-8a7894b6-97e3-44f7-a93a-033fc7cba5ee None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:01.331292 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-8a7894b6-97e3-44f7-a93a-033fc7cba5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:01.406458 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 491/948] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:01.580009 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e735500-2c7d-4139-80d4-424d8da35257 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:01.618364 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:01.636191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16628ab-79e0-4f1b-92a7-9e611aa578c7 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:01.636854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16628ab-79e0-4f1b-92a7-9e611aa578c7 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:01.637366 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16628ab-79e0-4f1b-92a7-9e611aa578c7 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:01.639154 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 492/949] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:03:01.645705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b8eee-7a31-4f16-957d-088e27ff2dda None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:01.646117 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b8eee-7a31-4f16-957d-088e27ff2dda None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:01.646487 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b8eee-7a31-4f16-957d-088e27ff2dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:01.670423 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-863b8eee-7a31-4f16-957d-088e27ff2dda None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:01.672370 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-863b8eee-7a31-4f16-957d-088e27ff2dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:01.712479 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e735500-2c7d-4139-80d4-424d8da35257 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:01.735529 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:01.754030 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 493/950] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:03:01.754328 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3af471-db30-476e-900e-437c05f854c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:01.754966 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3af471-db30-476e-900e-437c05f854c8 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:01.755249 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3af471-db30-476e-900e-437c05f854c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:01.755527 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3af471-db30-476e-900e-437c05f854c8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:01.756011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b8eee-7a31-4f16-957d-088e27ff2dda None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:01.756181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3af471-db30-476e-900e-437c05f854c8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:01.757549 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3af471-db30-476e-900e-437c05f854c8 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:01.777315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-5b3af471-db30-476e-900e-437c05f854c8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 21:03:01.777315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:01.777315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:03:01.777315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:03:01.777315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:03:01.777315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:03:01.777315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:03:01.777315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:03:01.777315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 21:03:01.777315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:01.777315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:03:01.777315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:01.777315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:01.777315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:01.777315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:01.777315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:01.777315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:01.778532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:01.778532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:01.778532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:01.778532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:01.778532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:01.778532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:01.778532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:03:01.778532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:03:01.778532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:03:01.778532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:03:01.778532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:01.778532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:01.778532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:01.778532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:01.778532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:01.778532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:01.779429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:01.779429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:01.779429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:01.779429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:01.779429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:01.779429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:01.779429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:01.779429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:01.779429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:01.779429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:01.779429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:03:01.779429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:03:01.779429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 21:03:01.779429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:01.779429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 458/951] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:03:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:01.787914 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3af471-db30-476e-900e-437c05f854c8 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:01.895472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b8eee-7a31-4f16-957d-088e27ff2dda None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:01.911359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:01.915544 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3af471-db30-476e-900e-437c05f854c8 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:01.942962 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68237e08-cfc7-447c-a664-ee88d4af8423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:01.943570 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68237e08-cfc7-447c-a664-ee88d4af8423 None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:01.943857 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68237e08-cfc7-447c-a664-ee88d4af8423 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:01.944134 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68237e08-cfc7-447c-a664-ee88d4af8423 None admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:01.945110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68237e08-cfc7-447c-a664-ee88d4af8423 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:01.947082 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68237e08-cfc7-447c-a664-ee88d4af8423 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:01.950505 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: WARNING keystone.server.flask.common [None req-68237e08-cfc7-447c-a664-ee88d4af8423 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 02 21:03:01.953169 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e000de-1cfa-4a84-888f-7c49ed394cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:01.954384 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e000de-1cfa-4a84-888f-7c49ed394cd2 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:01.954860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e000de-1cfa-4a84-888f-7c49ed394cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:01.955325 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e000de-1cfa-4a84-888f-7c49ed394cd2 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:01.956171 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e000de-1cfa-4a84-888f-7c49ed394cd2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:01.956766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e000de-1cfa-4a84-888f-7c49ed394cd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:01.958728 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e000de-1cfa-4a84-888f-7c49ed394cd2 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:01.969653 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 459/952] 10.222.0.79 () {56 vars in 1112 bytes} [Fri Sep 2 21:03:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:01.971031 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e000de-1cfa-4a84-888f-7c49ed394cd2 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:02.004427 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.sql.core [None req-68237e08-cfc7-447c-a664-ee88d4af8423 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 02 21:03:02.004427 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 02 21:03:02.004427 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [parameters: {'id': 'ea7bb808e7b948f6a74a7008d76fd1ec', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 02 21:03:02.004427 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82125) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 02 21:03:02.028754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-68237e08-cfc7-447c-a664-ee88d4af8423 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ea7bb808e7b948f6a74a7008d76fd1ec.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ea7bb808e7b948f6a74a7008d76fd1ec. Sep 02 21:03:02.028754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:02.028754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 21:03:02.028754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 21:03:02.028754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 21:03:02.028754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 21:03:02.028754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 21:03:02.028754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 21:03:02.028754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 21:03:02.028754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application conn.query(q) Sep 02 21:03:02.028754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 21:03:02.028754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 21:03:02.028754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 21:03:02.029679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application result.read() Sep 02 21:03:02.029679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 21:03:02.029679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 21:03:02.029679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 21:03:02.029679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 21:03:02.029679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 21:03:02.029679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 21:03:02.029679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 21:03:02.029679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 21:03:02.029679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 02 21:03:02.029679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:02.029679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 02 21:03:02.029679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:02.029679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:02.029679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 02 21:03:02.029679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 02 21:03:02.029679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 02 21:03:02.029679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 02 21:03:02.030788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 21:03:02.030788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application next(self.gen) Sep 02 21:03:02.030788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 02 21:03:02.030788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application yield resource Sep 02 21:03:02.030788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 21:03:02.030788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application next(self.gen) Sep 02 21:03:02.030788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 02 21:03:02.030788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self.session.rollback() Sep 02 21:03:02.030788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 02 21:03:02.030788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self.force_reraise() Sep 02 21:03:02.030788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 02 21:03:02.030788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise self.value Sep 02 21:03:02.030788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 02 21:03:02.030788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 02 21:03:02.030788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 02 21:03:02.030788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application session.commit() Sep 02 21:03:02.030788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 02 21:03:02.031845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 02 21:03:02.031845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 02 21:03:02.031845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._prepare_impl() Sep 02 21:03:02.031845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 02 21:03:02.031845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self.session.flush() Sep 02 21:03:02.031845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 02 21:03:02.031845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._flush(objects) Sep 02 21:03:02.031845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 02 21:03:02.031845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 02 21:03:02.031845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 02 21:03:02.031845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application compat.raise_( Sep 02 21:03:02.031845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 21:03:02.031845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception Sep 02 21:03:02.031845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 02 21:03:02.031845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application flush_context.execute() Sep 02 21:03:02.031845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 02 21:03:02.031845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rec.execute(self) Sep 02 21:03:02.034223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 02 21:03:02.034223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 02 21:03:02.034223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 02 21:03:02.034223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 02 21:03:02.034223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 02 21:03:02.034223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 02 21:03:02.034223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 02 21:03:02.034223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 02 21:03:02.034223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 02 21:03:02.034223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 02 21:03:02.034223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 02 21:03:02.034223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 02 21:03:02.034223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 02 21:03:02.034223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 02 21:03:02.034223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 02 21:03:02.036136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 02 21:03:02.036136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 21:03:02.036136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception Sep 02 21:03:02.036136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 21:03:02.036136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 21:03:02.036136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 21:03:02.036136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 21:03:02.036136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 21:03:02.036136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 21:03:02.036136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 21:03:02.036136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application conn.query(q) Sep 02 21:03:02.036136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 21:03:02.036136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 21:03:02.036136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 21:03:02.036136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application result.read() Sep 02 21:03:02.036136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 21:03:02.036136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 21:03:02.038200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 21:03:02.038200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 21:03:02.038200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 21:03:02.038200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 21:03:02.038200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 21:03:02.038200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 21:03:02.038200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 02 21:03:02.038200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 02 21:03:02.038200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [parameters: {'id': 'ea7bb808e7b948f6a74a7008d76fd1ec', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 02 21:03:02.038200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 02 21:03:02.038200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:02.038200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:03:02.038200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:02.038200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:02.038200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 02 21:03:02.040380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 02 21:03:02.040380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 02 21:03:02.040380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 02 21:03:02.040380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 02 21:03:02.040380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:02.040380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:03:02.040380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:02.040380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:02.040380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:02.040380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:02.040380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:02.040380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:02.040380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:02.040380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:02.040380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:02.040380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:02.040380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:02.042982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:02.042982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 02 21:03:02.042982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 02 21:03:02.042982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:02.042982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:02.042982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 02 21:03:02.042982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 02 21:03:02.042982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ea7bb808e7b948f6a74a7008d76fd1ec. Sep 02 21:03:02.042982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:02.042982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 494/953] 10.222.0.79 () {60 vars in 1140 bytes} [Fri Sep 2 21:03:01 2022] POST /identity/v3/projects => generated 262 bytes in 283 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:02.042982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68237e08-cfc7-447c-a664-ee88d4af8423 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:02.091391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:02.098861 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e000de-1cfa-4a84-888f-7c49ed394cd2 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:02.135647 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb28504-d3db-4471-9948-a44fe6a5c69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:02.136256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb28504-d3db-4471-9948-a44fe6a5c69a None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:02.136618 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb28504-d3db-4471-9948-a44fe6a5c69a None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:02.137238 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb28504-d3db-4471-9948-a44fe6a5c69a None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:02.138014 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb28504-d3db-4471-9948-a44fe6a5c69a None admin] RBAC: Adding query filter params (type=compute) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:02.138014 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb28504-d3db-4471-9948-a44fe6a5c69a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:02.139134 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb28504-d3db-4471-9948-a44fe6a5c69a None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:02.145370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 460/954] 10.222.0.79 () {56 vars in 1112 bytes} [Fri Sep 2 21:03:01 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:02.146328 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb28504-d3db-4471-9948-a44fe6a5c69a None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:02.174809 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68237e08-cfc7-447c-a664-ee88d4af8423 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:02.183747 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:02.222430 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a993bc5-f2ae-4d86-a9c8-a68820991255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:02.222998 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a993bc5-f2ae-4d86-a9c8-a68820991255 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:02.223295 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a993bc5-f2ae-4d86-a9c8-a68820991255 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:02.223583 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a993bc5-f2ae-4d86-a9c8-a68820991255 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:02.233867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a993bc5-f2ae-4d86-a9c8-a68820991255 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:02.237208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a993bc5-f2ae-4d86-a9c8-a68820991255 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:02.252890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-4a993bc5-f2ae-4d86-a9c8-a68820991255 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:03:02.252890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:02.252890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:02.252890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:02.252890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:02.252890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:02.252890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:02.252890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:02.252890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:02.252890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:02.252890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:02.252890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:02.252890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:03:02.252890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:03:02.252890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:03:02.254196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:03:02.254196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:02.254196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:02.254196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:02.254196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:02.254196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:02.254196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:02.254196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:02.254196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:02.254196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:02.254196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:02.254196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:02.254196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:02.254196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:02.254196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:02.254196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:02.254196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:02.255147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:03:02.255147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:03:02.255147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:03:02.255147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:03:02.255147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:03:02.255147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:03:02.255147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:03:02.255147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:02.263343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 495/955] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:03:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:02.264652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a993bc5-f2ae-4d86-a9c8-a68820991255 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:02.292820 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb28504-d3db-4471-9948-a44fe6a5c69a None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:02.340062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a412f-8b2e-4731-bd5d-876708c8a2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:02.340710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a412f-8b2e-4731-bd5d-876708c8a2d4 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:02.340996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a412f-8b2e-4731-bd5d-876708c8a2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:02.341275 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a412f-8b2e-4731-bd5d-876708c8a2d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:02.356249 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a412f-8b2e-4731-bd5d-876708c8a2d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:03:02.363734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-399a412f-8b2e-4731-bd5d-876708c8a2d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:03:02.363734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:02.363734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:02.363734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:02.363734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:02.363734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:02.363734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:02.363734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:02.363734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:02.363734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:02.363734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:02.363734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:02.363734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:03:02.363734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:03:02.363734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:03:02.363734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:03:02.364693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:03:02.364693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:03:02.364693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:03:02.364693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:03:02.364693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:02.364693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:02.364693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:02.364693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:02.364693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:02.364693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:02.364693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:02.364693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:02.364693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:02.364693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:02.364693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:02.364693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:02.365624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:02.365624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:02.365624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:02.365624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:02.365624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:03:02.365624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:03:02.365624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:03:02.365624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:03:02.365624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:03:02.365624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:03:02.365624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:03:02.365624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:02.369877 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 461/956] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Sep 2 21:03:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:02.373020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a412f-8b2e-4731-bd5d-876708c8a2d4 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:02.394522 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a993bc5-f2ae-4d86-a9c8-a68820991255 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:02.406668 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:02.432986 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea695246-883a-4bd3-833a-9b42545630e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:02.433983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea695246-883a-4bd3-833a-9b42545630e2 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:02.434449 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea695246-883a-4bd3-833a-9b42545630e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:02.436965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea695246-883a-4bd3-833a-9b42545630e2 None admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:02.436965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea695246-883a-4bd3-833a-9b42545630e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:02.436965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea695246-883a-4bd3-833a-9b42545630e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:02.438159 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea695246-883a-4bd3-833a-9b42545630e2 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:02.466409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 496/957] 10.222.0.79 () {56 vars in 1112 bytes} [Fri Sep 2 21:03:02 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:02.475669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:02.491054 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c585a30-d9fa-4bd0-808c-fdb5f9e8c732 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:02.494501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c585a30-d9fa-4bd0-808c-fdb5f9e8c732 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:02.494501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c585a30-d9fa-4bd0-808c-fdb5f9e8c732 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:02.494501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 497/958] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:02.496505 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a412f-8b2e-4731-bd5d-876708c8a2d4 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:02.499103 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204e799-a174-474f-b9b5-e5be2fda76c2 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:02.499424 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204e799-a174-474f-b9b5-e5be2fda76c2 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:02.499710 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204e799-a174-474f-b9b5-e5be2fda76c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:02.522445 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-9204e799-a174-474f-b9b5-e5be2fda76c2 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:02.523842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-9204e799-a174-474f-b9b5-e5be2fda76c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:02.549716 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ad0bf-76c6-4c09-8de4-52e187498cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:02.551290 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ad0bf-76c6-4c09-8de4-52e187498cbb None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:02.552223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ad0bf-76c6-4c09-8de4-52e187498cbb None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:02.552662 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ad0bf-76c6-4c09-8de4-52e187498cbb None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:02.554166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ad0bf-76c6-4c09-8de4-52e187498cbb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:02.554853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ad0bf-76c6-4c09-8de4-52e187498cbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:02.556845 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ad0bf-76c6-4c09-8de4-52e187498cbb None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:02.570440 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 462/959] 10.222.0.79 () {56 vars in 1115 bytes} [Fri Sep 2 21:03:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:02.577883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ad0bf-76c6-4c09-8de4-52e187498cbb None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:02.614287 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 498/960] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:03:02.693667 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ad0bf-76c6-4c09-8de4-52e187498cbb None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:02.739374 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d8d67-68c2-4840-bae2-87fda59a3368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:02.739941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d8d67-68c2-4840-bae2-87fda59a3368 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:02.740226 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d8d67-68c2-4840-bae2-87fda59a3368 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:02.740506 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d8d67-68c2-4840-bae2-87fda59a3368 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:02.752717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d8d67-68c2-4840-bae2-87fda59a3368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:02.754334 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d8d67-68c2-4840-bae2-87fda59a3368 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:02.763451 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:02.770758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-969d8d67-68c2-4840-bae2-87fda59a3368 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:03:02.770758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:02.770758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:02.770758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:02.770758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:02.770758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:02.770758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:02.770758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:02.770758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:02.770758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:02.770758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:02.770758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:02.770758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:03:02.770758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:03:02.770758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:03:02.770758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:03:02.771730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:02.771730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:02.771730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:02.771730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:02.771730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:02.771730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:02.771730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:02.771730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:02.771730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:02.771730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:02.771730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:02.771730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:02.771730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:02.771730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:02.771730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:02.771730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:02.771730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:03:02.772639 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:03:02.772639 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:03:02.772639 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:02.772639 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 463/961] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:03:02.779088 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204e799-a174-474f-b9b5-e5be2fda76c2 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:02.877617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:02.887825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204e799-a174-474f-b9b5-e5be2fda76c2 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:02.912092 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d8d67-68c2-4840-bae2-87fda59a3368 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:02.930665 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64987d6-2714-4914-b880-49339e980d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:02.931837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64987d6-2714-4914-b880-49339e980d90 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:02.932295 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64987d6-2714-4914-b880-49339e980d90 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:02.933163 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64987d6-2714-4914-b880-49339e980d90 None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:02.934303 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64987d6-2714-4914-b880-49339e980d90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:02.934815 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64987d6-2714-4914-b880-49339e980d90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:02.937639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64987d6-2714-4914-b880-49339e980d90 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:02.954076 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 499/962] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:02.962549 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64987d6-2714-4914-b880-49339e980d90 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:03.054287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d8d67-68c2-4840-bae2-87fda59a3368 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:03.076272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64987d6-2714-4914-b880-49339e980d90 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:03.102097 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a07094-b152-4bc7-aeed-3f1636cbb2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:03.102741 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a07094-b152-4bc7-aeed-3f1636cbb2d8 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:03.103023 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a07094-b152-4bc7-aeed-3f1636cbb2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:03.103299 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a07094-b152-4bc7-aeed-3f1636cbb2d8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:03.103897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a07094-b152-4bc7-aeed-3f1636cbb2d8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:03.105260 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a07094-b152-4bc7-aeed-3f1636cbb2d8 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:03.119652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba620137-c0a8-4fe4-becb-f918e5081d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:03.120286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba620137-c0a8-4fe4-becb-f918e5081d20 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:03.120571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba620137-c0a8-4fe4-becb-f918e5081d20 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:03.120860 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba620137-c0a8-4fe4-becb-f918e5081d20 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:03.121047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-25a07094-b152-4bc7-aeed-3f1636cbb2d8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:03:03.121047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:03.121047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:03:03.121047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:03:03.121047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:03:03.121047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:03:03.121047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:03:03.121047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:03:03.121047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:03:03.121047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:03.121047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:03:03.121047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:03.121047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:03.121047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:03.121047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:03.121047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:03.121047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:03.122089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:03.122089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:03.122089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:03.122089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:03.122089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:03.122089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:03.122089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:03:03.122089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:03:03.122089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:03:03.122089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:03:03.122089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:03.122089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:03.122089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:03.122089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:03.122089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:03.122089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:03.122967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:03.122967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:03.122967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:03.122967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:03.122967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:03.122967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:03.122967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:03.122967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:03.122967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:03.122967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:03.122967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:03:03.122967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:03:03.122967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:03:03.122967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:03.125958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 464/963] 10.222.0.79 () {56 vars in 1126 bytes} [Fri Sep 2 21:03:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:03:03.129670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a07094-b152-4bc7-aeed-3f1636cbb2d8 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:03.136891 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba620137-c0a8-4fe4-becb-f918e5081d20 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:03.138399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba620137-c0a8-4fe4-becb-f918e5081d20 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:03.151038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-ba620137-c0a8-4fe4-becb-f918e5081d20 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:03:03.151038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:03.151038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:03.151038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:03.151038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:03.151038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:03.151038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:03.151038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:03.151038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:03.151038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:03.151038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:03.151038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:03.151038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:03:03.151038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:03:03.151038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:03:03.151038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:03:03.152072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:03.152072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:03.152072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:03:03.152072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:03:03.152072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:03:03.152072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:03:03.152072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:03.152072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:03.152072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:03.152072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:03.152072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:03.152072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:03.152072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:03.152072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:03.152072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:03.152072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:03.152072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:03.152072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:03.153014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:03.153014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:03.153014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:03:03.153014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:03:03.153014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:03:03.153014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:03:03.153014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:03:03.153014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:03:03.153014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 02 21:03:03.153014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:03.157385 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 500/964] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Sep 2 21:03:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:03.158364 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba620137-c0a8-4fe4-becb-f918e5081d20 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:03.172753 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:03.211057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:03.255224 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a07094-b152-4bc7-aeed-3f1636cbb2d8 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:03.296021 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcba357-05d3-4502-92d2-0d1ea997a874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:03.297375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba620137-c0a8-4fe4-becb-f918e5081d20 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:03.297835 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcba357-05d3-4502-92d2-0d1ea997a874 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:03.298177 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcba357-05d3-4502-92d2-0d1ea997a874 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:03.298830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcba357-05d3-4502-92d2-0d1ea997a874 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:03.300130 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcba357-05d3-4502-92d2-0d1ea997a874 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:03.300520 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcba357-05d3-4502-92d2-0d1ea997a874 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:03.302574 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcba357-05d3-4502-92d2-0d1ea997a874 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:03.314005 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 465/965] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Sep 2 21:03:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:03.315050 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcba357-05d3-4502-92d2-0d1ea997a874 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:03.340861 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb923337-dbae-4b7c-a61c-bb8780f38e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:03.341593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb923337-dbae-4b7c-a61c-bb8780f38e4a None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:03.341990 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb923337-dbae-4b7c-a61c-bb8780f38e4a None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:03.342342 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb923337-dbae-4b7c-a61c-bb8780f38e4a None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:03.343240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb923337-dbae-4b7c-a61c-bb8780f38e4a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:03.344341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb923337-dbae-4b7c-a61c-bb8780f38e4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:03.346243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb923337-dbae-4b7c-a61c-bb8780f38e4a None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:03.381800 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 501/966] 10.222.0.79 () {56 vars in 1149 bytes} [Fri Sep 2 21:03:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:03.382942 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb923337-dbae-4b7c-a61c-bb8780f38e4a None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:03.447511 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcba357-05d3-4502-92d2-0d1ea997a874 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:03.462290 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:03.488386 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:03.498849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c44799-43f4-46af-8cad-dc14e67e92a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:03.499635 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb923337-dbae-4b7c-a61c-bb8780f38e4a None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:03.500037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c44799-43f4-46af-8cad-dc14e67e92a5 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:03.500477 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c44799-43f4-46af-8cad-dc14e67e92a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:03.501013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c44799-43f4-46af-8cad-dc14e67e92a5 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:03.501907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c44799-43f4-46af-8cad-dc14e67e92a5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:03.502442 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c44799-43f4-46af-8cad-dc14e67e92a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:03.504072 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c44799-43f4-46af-8cad-dc14e67e92a5 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:03.509771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 466/967] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Sep 2 21:03:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:03.515293 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c44799-43f4-46af-8cad-dc14e67e92a5 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:03.548952 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e7df0-3041-484c-b4f8-325007fa7a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:03.549737 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e7df0-3041-484c-b4f8-325007fa7a11 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:03.550140 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e7df0-3041-484c-b4f8-325007fa7a11 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:03.550790 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e7df0-3041-484c-b4f8-325007fa7a11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:03.635749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e7df0-3041-484c-b4f8-325007fa7a11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:03.637495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e7df0-3041-484c-b4f8-325007fa7a11 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:03.648546 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c44799-43f4-46af-8cad-dc14e67e92a5 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:03.689381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe43fcf-e78c-4225-9e2f-aa3b846ddcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:03.691126 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe43fcf-e78c-4225-9e2f-aa3b846ddcd6 None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:03.691526 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe43fcf-e78c-4225-9e2f-aa3b846ddcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:03.691905 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe43fcf-e78c-4225-9e2f-aa3b846ddcd6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:03.692744 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe43fcf-e78c-4225-9e2f-aa3b846ddcd6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:03.694525 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe43fcf-e78c-4225-9e2f-aa3b846ddcd6 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:03.715154 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:03.755585 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 502/968] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:03:03 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:03:03.756836 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e7df0-3041-484c-b4f8-325007fa7a11 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:03.792533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 467/969] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:03:03 2022] POST /identity/v3/endpoints => generated 349 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:03:03.890358 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e7df0-3041-484c-b4f8-325007fa7a11 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:03.938867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea752c4c-ac9e-4914-96af-1f66ebb9581e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:03.939510 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea752c4c-ac9e-4914-96af-1f66ebb9581e None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:03.939793 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea752c4c-ac9e-4914-96af-1f66ebb9581e None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:03.940068 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea752c4c-ac9e-4914-96af-1f66ebb9581e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:03.952034 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea752c4c-ac9e-4914-96af-1f66ebb9581e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:03.954489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea752c4c-ac9e-4914-96af-1f66ebb9581e None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:03.971472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-ea752c4c-ac9e-4914-96af-1f66ebb9581e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:03:03.971472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:03.971472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:03.971472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:03.971472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:03.971472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:03.971472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:03.971472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:03.971472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:03.971472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:03.971472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:03.971472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:03.971472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:03:03.971472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:03:03.971472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:03:03.971472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:03:03.972482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:03.972482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:03.972482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:03.972482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:03.972482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:03.972482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:03.972482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:03.972482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:03.972482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:03.972482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:03.972482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:03.972482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:03.972482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:03.972482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:03.972482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:03.972482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:03.972482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:03:03.973394 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:03:03.973394 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:03:03.973394 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:03.973394 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 503/970] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:03.979585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe43fcf-e78c-4225-9e2f-aa3b846ddcd6 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:04.034944 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:04.089486 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe43fcf-e78c-4225-9e2f-aa3b846ddcd6 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:04.126863 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1152bfc-2bee-4d6f-8805-1b120b748d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:04.127484 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1152bfc-2bee-4d6f-8805-1b120b748d0d None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:04.127763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1152bfc-2bee-4d6f-8805-1b120b748d0d None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:04.128140 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1152bfc-2bee-4d6f-8805-1b120b748d0d None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:04.128800 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1152bfc-2bee-4d6f-8805-1b120b748d0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:04.129217 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1152bfc-2bee-4d6f-8805-1b120b748d0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:04.130621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1152bfc-2bee-4d6f-8805-1b120b748d0d None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:04.144178 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 468/971] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:04.149500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1152bfc-2bee-4d6f-8805-1b120b748d0d None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:04.149779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59968cdc-f4ee-4515-9fb3-43aba0590f2e None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:04.150104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59968cdc-f4ee-4515-9fb3-43aba0590f2e None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:04.150377 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59968cdc-f4ee-4515-9fb3-43aba0590f2e None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:04.151942 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 504/972] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:04.158120 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bce118-f52a-4336-bae7-8bcda10e8519 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:04.158405 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bce118-f52a-4336-bae7-8bcda10e8519 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:04.158674 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bce118-f52a-4336-bae7-8bcda10e8519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:04.178035 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-b1bce118-f52a-4336-bae7-8bcda10e8519 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:04.179222 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b1bce118-f52a-4336-bae7-8bcda10e8519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:04.192292 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:04.258131 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 505/973] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:03:04.272217 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1152bfc-2bee-4d6f-8805-1b120b748d0d None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:04.290296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:04.308522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c9ee1-76bc-4120-b908-6ab16a46a98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:04.309162 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c9ee1-76bc-4120-b908-6ab16a46a98e None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:04.309439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c9ee1-76bc-4120-b908-6ab16a46a98e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:04.309711 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c9ee1-76bc-4120-b908-6ab16a46a98e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:04.317588 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c9ee1-76bc-4120-b908-6ab16a46a98e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:04.319047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c9ee1-76bc-4120-b908-6ab16a46a98e None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:04.331831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-7d0c9ee1-76bc-4120-b908-6ab16a46a98e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:03:04.331831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:04.331831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:04.331831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:04.331831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:04.331831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:04.331831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:04.331831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:04.331831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:04.331831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:04.331831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:04.331831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:04.331831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:03:04.331831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:03:04.331831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:03:04.332789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:03:04.332789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:04.332789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:04.332789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:04.332789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:04.332789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:04.332789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:04.332789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:04.332789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:04.332789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:04.332789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:04.332789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:04.332789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:04.332789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:04.332789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:04.332789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:04.332789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:04.333698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:03:04.333698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:03:04.333698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:03:04.333698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:03:04.333698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:03:04.333698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:03:04.333698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:03:04.333698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:04.333698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 469/974] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:03:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:04.339080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bce118-f52a-4336-bae7-8bcda10e8519 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:04.453773 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bce118-f52a-4336-bae7-8bcda10e8519 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:04.492086 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa38c30-31b7-4cfd-a77c-85b130228e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:04.493003 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa38c30-31b7-4cfd-a77c-85b130228e51 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:04.493461 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa38c30-31b7-4cfd-a77c-85b130228e51 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:04.493967 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa38c30-31b7-4cfd-a77c-85b130228e51 None admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:04.494833 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa38c30-31b7-4cfd-a77c-85b130228e51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:04.495315 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa38c30-31b7-4cfd-a77c-85b130228e51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:04.496911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa38c30-31b7-4cfd-a77c-85b130228e51 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:04.513900 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 506/975] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:03:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:04.516574 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c9ee1-76bc-4120-b908-6ab16a46a98e None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:04.534216 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa38c30-31b7-4cfd-a77c-85b130228e51 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:04.548201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:04.631331 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c9ee1-76bc-4120-b908-6ab16a46a98e None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:04.652735 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa38c30-31b7-4cfd-a77c-85b130228e51 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:04.668392 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335b694-6ebf-43e2-8fb6-76b3d928d46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:04.669061 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335b694-6ebf-43e2-8fb6-76b3d928d46c None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:04.669274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335b694-6ebf-43e2-8fb6-76b3d928d46c None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:04.669555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335b694-6ebf-43e2-8fb6-76b3d928d46c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:04.670332 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335b694-6ebf-43e2-8fb6-76b3d928d46c None admin] RBAC: Adding query filter params (role.id=5916d78324aa4a8584dbcc3a45e32746, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=f45f65dd3a844cb583e42d837d2a58d5) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:04.670647 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335b694-6ebf-43e2-8fb6-76b3d928d46c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:04.672180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335b694-6ebf-43e2-8fb6-76b3d928d46c None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:04.685835 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 470/976] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:03:04 2022] GET /identity/v3/role_assignments?user.id=f45f65dd3a844cb583e42d837d2a58d5&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=5916d78324aa4a8584dbcc3a45e32746 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:04.685835 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb18f9-c9b9-49aa-bf08-9f33bf5efa2b None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:04.685835 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb18f9-c9b9-49aa-bf08-9f33bf5efa2b None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:04.685835 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb18f9-c9b9-49aa-bf08-9f33bf5efa2b None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:04.685835 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 471/977] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:04.687496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd314635-a937-43b7-a3d5-5e4618f33e1d None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:04.687496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd314635-a937-43b7-a3d5-5e4618f33e1d None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:04.687496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd314635-a937-43b7-a3d5-5e4618f33e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:04.708404 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-fd314635-a937-43b7-a3d5-5e4618f33e1d None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:04.709888 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-fd314635-a937-43b7-a3d5-5e4618f33e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:04.713131 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ac6fb-36f7-4060-b74f-6229afef37d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:04.714058 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ac6fb-36f7-4060-b74f-6229afef37d2 None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:04.714350 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ac6fb-36f7-4060-b74f-6229afef37d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:04.714803 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ac6fb-36f7-4060-b74f-6229afef37d2 None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:04.715488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ac6fb-36f7-4060-b74f-6229afef37d2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:04.716980 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ac6fb-36f7-4060-b74f-6229afef37d2 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:04.748185 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:04.801529 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 507/978] 10.222.0.79 () {60 vars in 1141 bytes} [Fri Sep 2 21:03:04 2022] POST /identity/v3/services => generated 242 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:03:04.806241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 472/979] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:03:05.086977 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ac6fb-36f7-4060-b74f-6229afef37d2 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:05.159306 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:05.208195 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ac6fb-36f7-4060-b74f-6229afef37d2 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:05.243913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415c34f-d61e-4a90-9b85-ce65d9f738d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:05.245472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415c34f-d61e-4a90-9b85-ce65d9f738d3 None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:05.245758 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415c34f-d61e-4a90-9b85-ce65d9f738d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:05.246070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415c34f-d61e-4a90-9b85-ce65d9f738d3 None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:05.246725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415c34f-d61e-4a90-9b85-ce65d9f738d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:05.248165 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415c34f-d61e-4a90-9b85-ce65d9f738d3 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:05.290227 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.sql.core [None req-9415c34f-d61e-4a90-9b85-ce65d9f738d3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 02 21:03:05.290227 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 02 21:03:05.290227 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [parameters: {'user_id': 'ecff379e06514fe1ad1bb310fe7dcb71', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 02 21:03:05.290227 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82125) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 02 21:03:05.300579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-9415c34f-d61e-4a90-9b85-ce65d9f738d3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 02 21:03:05.300579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:05.300579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 21:03:05.300579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 21:03:05.300579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 21:03:05.300579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 21:03:05.300579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 21:03:05.300579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 21:03:05.300579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 21:03:05.300579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application conn.query(q) Sep 02 21:03:05.300579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 21:03:05.300579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 21:03:05.300579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 21:03:05.300579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application result.read() Sep 02 21:03:05.300579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 21:03:05.301593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 21:03:05.301593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 21:03:05.301593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 21:03:05.301593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 21:03:05.301593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 21:03:05.301593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 21:03:05.301593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 21:03:05.301593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 02 21:03:05.301593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:05.301593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 02 21:03:05.301593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:05.301593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:05.301593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 02 21:03:05.301593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 02 21:03:05.301593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 02 21:03:05.301593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 02 21:03:05.301593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 21:03:05.301593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application next(self.gen) Sep 02 21:03:05.303080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 02 21:03:05.303080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application yield resource Sep 02 21:03:05.303080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 02 21:03:05.303080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application next(self.gen) Sep 02 21:03:05.303080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 02 21:03:05.303080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self.session.rollback() Sep 02 21:03:05.303080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 02 21:03:05.303080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self.force_reraise() Sep 02 21:03:05.303080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 02 21:03:05.303080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise self.value Sep 02 21:03:05.303080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 02 21:03:05.303080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 02 21:03:05.303080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 02 21:03:05.303080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application session.commit() Sep 02 21:03:05.303080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 02 21:03:05.303080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 02 21:03:05.303080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 02 21:03:05.304294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._prepare_impl() Sep 02 21:03:05.304294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 02 21:03:05.304294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self.session.flush() Sep 02 21:03:05.304294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 02 21:03:05.304294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._flush(objects) Sep 02 21:03:05.304294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 02 21:03:05.304294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 02 21:03:05.304294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 02 21:03:05.304294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application compat.raise_( Sep 02 21:03:05.304294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 21:03:05.304294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception Sep 02 21:03:05.304294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 02 21:03:05.304294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application flush_context.execute() Sep 02 21:03:05.304294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 02 21:03:05.304294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rec.execute(self) Sep 02 21:03:05.304294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 02 21:03:05.304294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 02 21:03:05.305197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 02 21:03:05.305197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 02 21:03:05.305197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 02 21:03:05.305197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 02 21:03:05.305197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 02 21:03:05.305197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 02 21:03:05.305197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 02 21:03:05.305197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 02 21:03:05.305197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 02 21:03:05.305197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 02 21:03:05.305197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 02 21:03:05.305197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 02 21:03:05.305197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 02 21:03:05.305197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 02 21:03:05.305197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 02 21:03:05.305197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception Sep 02 21:03:05.309653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 02 21:03:05.309653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 02 21:03:05.309653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 02 21:03:05.309653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 02 21:03:05.309653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 02 21:03:05.309653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application result = self._query(query) Sep 02 21:03:05.309653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 02 21:03:05.309653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application conn.query(q) Sep 02 21:03:05.309653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 02 21:03:05.309653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 02 21:03:05.309653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 02 21:03:05.309653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application result.read() Sep 02 21:03:05.309653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 02 21:03:05.309653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 02 21:03:05.309653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 02 21:03:05.309653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 02 21:03:05.312756 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 02 21:03:05.312756 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 02 21:03:05.312756 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 02 21:03:05.312756 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 02 21:03:05.312756 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 02 21:03:05.312756 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 02 21:03:05.312756 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ecff379e06514fe1ad1bb310fe7dcb71', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 02 21:03:05.312756 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 02 21:03:05.312756 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:05.312756 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:03:05.312756 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:05.312756 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:05.312756 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:05.312756 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:05.312756 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:05.315842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:05.315842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:05.315842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:05.315842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:05.315842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:05.315842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:05.315842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:05.315842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 02 21:03:05.315842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 02 21:03:05.315842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:05.315842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:05.315842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:03:05.315842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:03:05.315842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:03:05.315842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:03:05.315842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 02 21:03:05.315842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 02 21:03:05.318360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 02 21:03:05.318360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 02 21:03:05.318360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 02 21:03:05.318360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 02 21:03:05.318360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 02 21:03:05.318360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:05.318360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 508/980] 10.222.0.79 () {60 vars in 1131 bytes} [Fri Sep 2 21:03:05 2022] POST /identity/v3/users => generated 160 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:05.319360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd314635-a937-43b7-a3d5-5e4618f33e1d None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:05.428057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd314635-a937-43b7-a3d5-5e4618f33e1d None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:05.463655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57192400-c541-4db3-a659-111d35f0f50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:05.464299 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57192400-c541-4db3-a659-111d35f0f50e None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:05.464580 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57192400-c541-4db3-a659-111d35f0f50e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:05.464851 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57192400-c541-4db3-a659-111d35f0f50e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:05.473841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57192400-c541-4db3-a659-111d35f0f50e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:05.475312 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57192400-c541-4db3-a659-111d35f0f50e None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:05.487843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-57192400-c541-4db3-a659-111d35f0f50e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 21:03:05.487843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:05.487843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:05.487843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:05.487843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:05.487843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:05.487843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:05.487843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:05.487843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:05.487843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:05.487843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:05.487843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:05.487843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:03:05.487843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:03:05.487843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:03:05.487843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:03:05.490075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:05.490075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:05.490075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:03:05.490075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:03:05.490075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:03:05.490075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:03:05.490075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:05.490075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:05.490075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:05.490075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:05.490075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:05.490075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:05.490075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:05.490075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:05.490075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:05.490075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:05.490075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:05.490075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:05.491496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:05.491496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:05.491496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:03:05.491496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:03:05.491496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:03:05.491496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:03:05.491496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:03:05.491496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:03:05.491496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 02 21:03:05.491496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:05.491496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 473/981] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:03:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:05.499157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415c34f-d61e-4a90-9b85-ce65d9f738d3 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:05.611344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415c34f-d61e-4a90-9b85-ce65d9f738d3 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:05.635834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:05.647365 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37257495-d12c-4c89-8437-982895e0e777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:05.647984 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37257495-d12c-4c89-8437-982895e0e777 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:05.657871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37257495-d12c-4c89-8437-982895e0e777 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:05.657871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37257495-d12c-4c89-8437-982895e0e777 None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:05.657871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37257495-d12c-4c89-8437-982895e0e777 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:05.657871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37257495-d12c-4c89-8437-982895e0e777 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:05.657871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37257495-d12c-4c89-8437-982895e0e777 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:05.698492 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 509/982] 10.222.0.79 () {56 vars in 1101 bytes} [Fri Sep 2 21:03:05 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:05.939303 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae7fe7-306b-429a-8675-7c78740effcc None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:05.939957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae7fe7-306b-429a-8675-7c78740effcc None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:05.940428 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae7fe7-306b-429a-8675-7c78740effcc None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:05.942253 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 474/983] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:05.948276 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550500c0-c897-40be-9526-da47b78750a6 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:05.948852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550500c0-c897-40be-9526-da47b78750a6 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:05.949344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550500c0-c897-40be-9526-da47b78750a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:05.970235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-550500c0-c897-40be-9526-da47b78750a6 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:05.972460 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-550500c0-c897-40be-9526-da47b78750a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:06.048770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 510/984] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:06.327172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae7fe7-306b-429a-8675-7c78740effcc None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:06.360149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:06.446732 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae7fe7-306b-429a-8675-7c78740effcc None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:06.488758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e291663-3c53-4fd9-9b8c-f5706e6426f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:06.489408 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e291663-3c53-4fd9-9b8c-f5706e6426f5 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:06.489694 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e291663-3c53-4fd9-9b8c-f5706e6426f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:06.489991 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e291663-3c53-4fd9-9b8c-f5706e6426f5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:06.490711 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e291663-3c53-4fd9-9b8c-f5706e6426f5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:06.492079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e291663-3c53-4fd9-9b8c-f5706e6426f5 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:06.502959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-0e291663-3c53-4fd9-9b8c-f5706e6426f5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:03:06.502959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:06.502959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:03:06.502959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:03:06.502959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:03:06.502959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:03:06.502959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:03:06.502959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:03:06.502959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:03:06.502959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:06.502959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:03:06.502959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:06.502959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:06.502959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:06.502959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:06.502959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:06.502959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:06.504153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:06.504153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:06.504153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:06.504153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:06.504153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:06.504153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:06.504153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:03:06.504153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:03:06.504153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:03:06.504153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:03:06.504153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:06.504153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:06.504153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:06.504153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:06.504153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:06.504153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:06.505020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:06.505020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:06.505020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:06.505020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:06.505020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:06.505020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:06.505020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:06.505020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:06.505020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:06.505020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:06.505020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:03:06.505020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:03:06.505020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:03:06.505020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:06.505020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 475/985] 10.222.0.79 () {56 vars in 1126 bytes} [Fri Sep 2 21:03:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:06.511800 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550500c0-c897-40be-9526-da47b78750a6 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:06.635439 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550500c0-c897-40be-9526-da47b78750a6 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:06.649681 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:06.673061 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703a838-8fd7-426d-b788-529ee8594c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:06.673679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703a838-8fd7-426d-b788-529ee8594c6a None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:06.674002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703a838-8fd7-426d-b788-529ee8594c6a None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:06.674286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703a838-8fd7-426d-b788-529ee8594c6a None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:06.674922 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703a838-8fd7-426d-b788-529ee8594c6a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:06.675234 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703a838-8fd7-426d-b788-529ee8594c6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:06.676757 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703a838-8fd7-426d-b788-529ee8594c6a None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:06.690300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 511/986] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Sep 2 21:03:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:06.691970 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e291663-3c53-4fd9-9b8c-f5706e6426f5 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:06.734563 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f5fb0-ef65-4459-9925-9cb8a504ed2d None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:06.734842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f5fb0-ef65-4459-9925-9cb8a504ed2d None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:06.735125 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f5fb0-ef65-4459-9925-9cb8a504ed2d None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:06.736599 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 512/987] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:03:06.741579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916f944-f46d-4c75-a5ab-9f90745b68cc None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:06.741902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916f944-f46d-4c75-a5ab-9f90745b68cc None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:06.742161 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916f944-f46d-4c75-a5ab-9f90745b68cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:06.761041 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-b916f944-f46d-4c75-a5ab-9f90745b68cc None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:06.762255 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b916f944-f46d-4c75-a5ab-9f90745b68cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:06.799643 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:06.816567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e291663-3c53-4fd9-9b8c-f5706e6426f5 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:06.844523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 513/988] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:03:06.857010 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f6ed4-a5ad-463a-8dba-988b730aec85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:06.857704 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f6ed4-a5ad-463a-8dba-988b730aec85 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:06.858047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f6ed4-a5ad-463a-8dba-988b730aec85 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:06.858386 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f6ed4-a5ad-463a-8dba-988b730aec85 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:06.859400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f6ed4-a5ad-463a-8dba-988b730aec85 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:06.859770 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f6ed4-a5ad-463a-8dba-988b730aec85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:06.861199 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f6ed4-a5ad-463a-8dba-988b730aec85 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:06.863632 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed751b0f-4a56-4790-97bc-71dd547fa4f2 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:06.863914 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed751b0f-4a56-4790-97bc-71dd547fa4f2 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:06.864202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed751b0f-4a56-4790-97bc-71dd547fa4f2 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:06.865543 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 514/989] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:03:06.867302 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 476/990] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Sep 2 21:03:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:06.870816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e04048-7139-49cc-b713-547dab133d56 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:06.871249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e04048-7139-49cc-b713-547dab133d56 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:06.871687 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e04048-7139-49cc-b713-547dab133d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:06.872927 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f6ed4-a5ad-463a-8dba-988b730aec85 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:06.894883 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-c4e04048-7139-49cc-b713-547dab133d56 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:06.895960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-c4e04048-7139-49cc-b713-547dab133d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:06.963649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 515/991] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:03:06.983271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f6ed4-a5ad-463a-8dba-988b730aec85 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:07.017926 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee85a9-bfce-4fd1-9196-9bd6becb5565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:07.018533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee85a9-bfce-4fd1-9196-9bd6becb5565 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:07.018814 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee85a9-bfce-4fd1-9196-9bd6becb5565 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:07.019086 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee85a9-bfce-4fd1-9196-9bd6becb5565 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:07.019794 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee85a9-bfce-4fd1-9196-9bd6becb5565 None admin] RBAC: Adding query filter params (interface=admin, service_id=22c7c254c6e14438ada2119af2888e29, region_id=RegionOne) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:07.020104 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee85a9-bfce-4fd1-9196-9bd6becb5565 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:07.021464 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee85a9-bfce-4fd1-9196-9bd6becb5565 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:07.030149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 477/992] 10.222.0.79 () {56 vars in 1249 bytes} [Fri Sep 2 21:03:06 2022] GET /identity/v3/endpoints?service_id=22c7c254c6e14438ada2119af2888e29&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:07.033022 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e04048-7139-49cc-b713-547dab133d56 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:07.068987 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:07.126659 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee85a9-bfce-4fd1-9196-9bd6becb5565 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:07.135801 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e04048-7139-49cc-b713-547dab133d56 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:07.146567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:07.173422 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efc310-0593-4902-b1b0-403ba6a7c4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:07.174066 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efc310-0593-4902-b1b0-403ba6a7c4a7 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:07.174353 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efc310-0593-4902-b1b0-403ba6a7c4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:07.174630 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efc310-0593-4902-b1b0-403ba6a7c4a7 None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:07.175242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efc310-0593-4902-b1b0-403ba6a7c4a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:07.176618 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efc310-0593-4902-b1b0-403ba6a7c4a7 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:07.183294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 516/993] 10.222.0.79 () {56 vars in 1087 bytes} [Fri Sep 2 21:03:07 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:03:07.238972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efc310-0593-4902-b1b0-403ba6a7c4a7 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:07.249877 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee85a9-bfce-4fd1-9196-9bd6becb5565 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:07.291583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f743ce-c9ef-4bde-8090-929cd0219dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:07.292426 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f743ce-c9ef-4bde-8090-929cd0219dfd None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:07.292786 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f743ce-c9ef-4bde-8090-929cd0219dfd None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:07.293131 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f743ce-c9ef-4bde-8090-929cd0219dfd None admin] PATH_INFO: `/v3/services/image` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:07.293836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f743ce-c9ef-4bde-8090-929cd0219dfd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:07.295246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f743ce-c9ef-4bde-8090-929cd0219dfd None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:07.304903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-c7f743ce-c9ef-4bde-8090-929cd0219dfd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 21:03:07.304903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:07.304903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:03:07.304903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:03:07.304903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:03:07.304903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:03:07.304903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:03:07.304903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:03:07.304903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 21:03:07.304903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:07.304903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:03:07.304903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:07.304903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:07.304903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:07.304903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:07.304903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:07.304903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:07.306207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:07.306207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:07.306207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:07.306207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:07.306207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:07.306207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:07.306207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:03:07.306207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:03:07.306207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:03:07.306207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:03:07.306207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:07.306207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:07.306207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:07.306207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:07.306207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:07.306207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:07.307263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:07.307263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:07.307263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:07.307263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:07.307263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:07.307263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:07.307263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:07.307263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:07.307263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:07.307263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:07.307263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:03:07.307263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:03:07.307263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 21:03:07.307263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:07.311501 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 478/994] 10.222.0.79 () {56 vars in 1105 bytes} [Fri Sep 2 21:03:07 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:03:07.313437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f743ce-c9ef-4bde-8090-929cd0219dfd None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:07.361456 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:07.365164 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efc310-0593-4902-b1b0-403ba6a7c4a7 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:07.408497 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:07.411415 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca217b5-85d5-4fce-acc5-bd881104a1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:07.412502 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca217b5-85d5-4fce-acc5-bd881104a1e9 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:07.413118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca217b5-85d5-4fce-acc5-bd881104a1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:07.413460 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca217b5-85d5-4fce-acc5-bd881104a1e9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:07.414393 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca217b5-85d5-4fce-acc5-bd881104a1e9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:07.416053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca217b5-85d5-4fce-acc5-bd881104a1e9 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:07.428976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-6ca217b5-85d5-4fce-acc5-bd881104a1e9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 21:03:07.428976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:07.428976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:03:07.428976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:03:07.428976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:03:07.428976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:03:07.428976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:03:07.428976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:03:07.428976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 21:03:07.428976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:07.428976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:03:07.428976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:07.428976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:07.428976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:07.428976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:07.428976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:07.428976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:07.430363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:07.430363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:07.430363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:07.430363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:07.430363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:07.430363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:07.430363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:03:07.430363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:03:07.430363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:03:07.430363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:03:07.430363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:07.430363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:07.430363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:07.430363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:07.430363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:07.430363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:07.431623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:07.431623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:07.431623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:07.431623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:07.431623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:07.431623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:07.431623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:07.431623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:07.431623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:07.431623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:07.431623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:03:07.431623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:03:07.431623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 21:03:07.431623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:07.432480 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f743ce-c9ef-4bde-8090-929cd0219dfd None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:07.432557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 517/995] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:03:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:03:07.437189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca217b5-85d5-4fce-acc5-bd881104a1e9 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:07.468725 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6d43c-f84e-41fc-a722-190f28043c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:07.469731 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6d43c-f84e-41fc-a722-190f28043c33 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:07.470151 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6d43c-f84e-41fc-a722-190f28043c33 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:07.470724 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6d43c-f84e-41fc-a722-190f28043c33 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:07.471467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6d43c-f84e-41fc-a722-190f28043c33 None admin] RBAC: Adding query filter params (name=image) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:07.471891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6d43c-f84e-41fc-a722-190f28043c33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:07.473787 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6d43c-f84e-41fc-a722-190f28043c33 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:07.479970 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 479/996] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:03:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:07.487603 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6d43c-f84e-41fc-a722-190f28043c33 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:07.559083 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca217b5-85d5-4fce-acc5-bd881104a1e9 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:07.596189 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6d43c-f84e-41fc-a722-190f28043c33 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:07.596912 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c95636-723b-478f-baed-7f6326e6f7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:07.597526 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c95636-723b-478f-baed-7f6326e6f7e2 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:07.597836 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c95636-723b-478f-baed-7f6326e6f7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:07.598114 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c95636-723b-478f-baed-7f6326e6f7e2 None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:07.599244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c95636-723b-478f-baed-7f6326e6f7e2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:07.599244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c95636-723b-478f-baed-7f6326e6f7e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:07.600429 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c95636-723b-478f-baed-7f6326e6f7e2 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:07.611030 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 518/997] 10.222.0.79 () {56 vars in 1112 bytes} [Fri Sep 2 21:03:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:07.612805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c95636-723b-478f-baed-7f6326e6f7e2 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:07.634114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00ad52-dd78-4921-86ef-4ec5fb600863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:07.634731 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00ad52-dd78-4921-86ef-4ec5fb600863 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:07.635014 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00ad52-dd78-4921-86ef-4ec5fb600863 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:07.635293 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00ad52-dd78-4921-86ef-4ec5fb600863 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:07.635936 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00ad52-dd78-4921-86ef-4ec5fb600863 None admin] RBAC: Adding query filter params (type=image) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:07.636246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00ad52-dd78-4921-86ef-4ec5fb600863 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:07.637608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00ad52-dd78-4921-86ef-4ec5fb600863 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:07.644333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 480/998] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:03:07 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:07.645295 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:07.741796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c95636-723b-478f-baed-7f6326e6f7e2 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:07.781252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a470a32-a973-4be8-99a6-2e8ee6f919bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:07.782138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a470a32-a973-4be8-99a6-2e8ee6f919bd None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:07.782515 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a470a32-a973-4be8-99a6-2e8ee6f919bd None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:07.782889 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a470a32-a973-4be8-99a6-2e8ee6f919bd None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:07.783638 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a470a32-a973-4be8-99a6-2e8ee6f919bd None admin] RBAC: Adding query filter params (type=compute) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:07.784042 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a470a32-a973-4be8-99a6-2e8ee6f919bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:07.785594 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a470a32-a973-4be8-99a6-2e8ee6f919bd None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:07.792031 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 519/999] 10.222.0.79 () {56 vars in 1112 bytes} [Fri Sep 2 21:03:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:07.798751 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00ad52-dd78-4921-86ef-4ec5fb600863 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:07.809494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:07.908499 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00ad52-dd78-4921-86ef-4ec5fb600863 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:07.945462 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d57bd-5081-4a16-b9b0-9a0afe40b375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:07.946012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d57bd-5081-4a16-b9b0-9a0afe40b375 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:07.946292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d57bd-5081-4a16-b9b0-9a0afe40b375 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:07.946563 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d57bd-5081-4a16-b9b0-9a0afe40b375 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:07.947271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d57bd-5081-4a16-b9b0-9a0afe40b375 None admin] RBAC: Adding query filter params (interface=public, service_id=22631802fb5d4a0c89136a102069f445, region_id=RegionOne) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:07.947595 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d57bd-5081-4a16-b9b0-9a0afe40b375 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:07.948949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d57bd-5081-4a16-b9b0-9a0afe40b375 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:07.955049 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 481/1000] 10.222.0.79 () {56 vars in 1251 bytes} [Fri Sep 2 21:03:07 2022] GET /identity/v3/endpoints?service_id=22631802fb5d4a0c89136a102069f445&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:07.960541 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a470a32-a973-4be8-99a6-2e8ee6f919bd None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:08.056560 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:08.065633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a470a32-a973-4be8-99a6-2e8ee6f919bd None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:08.101028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e8077-f00b-4148-8063-de57fd098105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:08.101631 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e8077-f00b-4148-8063-de57fd098105 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:08.101939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e8077-f00b-4148-8063-de57fd098105 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:08.102214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e8077-f00b-4148-8063-de57fd098105 None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:08.102820 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e8077-f00b-4148-8063-de57fd098105 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:08.104196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e8077-f00b-4148-8063-de57fd098105 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:08.111659 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 520/1001] 10.222.0.79 () {56 vars in 1087 bytes} [Fri Sep 2 21:03:07 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:03:09.169730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb88576-0329-4448-96b7-249015c93f64 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:09.170300 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb88576-0329-4448-96b7-249015c93f64 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:09.170380 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb88576-0329-4448-96b7-249015c93f64 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:09.172364 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 482/1002] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:09.177571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a4103-4ed5-4aeb-8d1e-1c8b938d6bbe None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:09.178055 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a4103-4ed5-4aeb-8d1e-1c8b938d6bbe None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:09.178223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a4103-4ed5-4aeb-8d1e-1c8b938d6bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:09.198147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-a61a4103-4ed5-4aeb-8d1e-1c8b938d6bbe None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:09.199379 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-a61a4103-4ed5-4aeb-8d1e-1c8b938d6bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:09.273336 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 521/1003] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:09 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:09.543789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb88576-0329-4448-96b7-249015c93f64 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:09.620886 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:09.627193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526c2cb-85bc-452a-b4cb-dad314496201 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:09.627490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526c2cb-85bc-452a-b4cb-dad314496201 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:09.627770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526c2cb-85bc-452a-b4cb-dad314496201 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:09.629255 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 522/1004] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:03:09.634173 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641de0b1-c81b-47fe-a37a-3d375aff17a4 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:09.640316 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641de0b1-c81b-47fe-a37a-3d375aff17a4 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:09.640316 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641de0b1-c81b-47fe-a37a-3d375aff17a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:09.653370 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-641de0b1-c81b-47fe-a37a-3d375aff17a4 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:09.654605 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-641de0b1-c81b-47fe-a37a-3d375aff17a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:09.655059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb88576-0329-4448-96b7-249015c93f64 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:09.696542 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30586f-2add-44af-8ba5-64981bff1cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:09.697184 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30586f-2add-44af-8ba5-64981bff1cab None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:09.697463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30586f-2add-44af-8ba5-64981bff1cab None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:09.697737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30586f-2add-44af-8ba5-64981bff1cab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:09.698351 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30586f-2add-44af-8ba5-64981bff1cab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:09.699843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30586f-2add-44af-8ba5-64981bff1cab None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:09.713429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-5a30586f-2add-44af-8ba5-64981bff1cab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:03:09.713429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:09.713429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:03:09.713429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:03:09.713429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:03:09.713429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:03:09.713429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:03:09.713429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:03:09.713429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:03:09.713429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:09.713429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:03:09.713429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:09.713429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:09.713429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:09.713429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:09.713429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:09.713429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:09.715054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:09.715054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:09.715054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:09.715054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:09.715054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:09.715054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:09.715054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:03:09.715054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:03:09.715054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:03:09.715054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:03:09.715054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:09.715054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:09.715054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:09.715054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:09.715054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:09.715054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:09.715883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:09.715883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:09.715883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:09.715883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:09.715883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:09.715883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:09.715883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:09.715883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:09.715883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:09.715883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:09.715883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:03:09.715883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:03:09.715883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 02 21:03:09.715883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:09.715883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 483/1005] 10.222.0.79 () {56 vars in 1126 bytes} [Fri Sep 2 21:03:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:09.721506 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30586f-2add-44af-8ba5-64981bff1cab None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:09.743485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 523/1006] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:09 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:03:09.829977 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30586f-2add-44af-8ba5-64981bff1cab None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:09.865698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b998c-7733-410c-a2fc-12209520a1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:09.866358 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b998c-7733-410c-a2fc-12209520a1d8 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:09.866643 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b998c-7733-410c-a2fc-12209520a1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:09.866922 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b998c-7733-410c-a2fc-12209520a1d8 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:09.867551 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b998c-7733-410c-a2fc-12209520a1d8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:09.867860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b998c-7733-410c-a2fc-12209520a1d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:09.869227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b998c-7733-410c-a2fc-12209520a1d8 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:09.870369 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:09.875358 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 484/1007] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Sep 2 21:03:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:09.881313 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641de0b1-c81b-47fe-a37a-3d375aff17a4 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:09.900995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:09.993528 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641de0b1-c81b-47fe-a37a-3d375aff17a4 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:10.024340 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b998c-7733-410c-a2fc-12209520a1d8 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:10.029656 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65190164-c12c-4ea3-bf82-9ab50e727ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:10.030336 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65190164-c12c-4ea3-bf82-9ab50e727ca3 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:10.030618 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65190164-c12c-4ea3-bf82-9ab50e727ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:10.030891 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65190164-c12c-4ea3-bf82-9ab50e727ca3 None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:10.031528 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65190164-c12c-4ea3-bf82-9ab50e727ca3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:10.031832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65190164-c12c-4ea3-bf82-9ab50e727ca3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:10.033211 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65190164-c12c-4ea3-bf82-9ab50e727ca3 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:10.038461 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 524/1008] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Sep 2 21:03:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:10.043822 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65190164-c12c-4ea3-bf82-9ab50e727ca3 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:10.127585 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:10.133599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b998c-7733-410c-a2fc-12209520a1d8 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:10.146102 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65190164-c12c-4ea3-bf82-9ab50e727ca3 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:10.168272 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b374d7-4fb0-4aec-9ab8-854a3811f1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:10.168891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b374d7-4fb0-4aec-9ab8-854a3811f1ec None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:10.169171 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b374d7-4fb0-4aec-9ab8-854a3811f1ec None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:10.169451 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b374d7-4fb0-4aec-9ab8-854a3811f1ec None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:10.170155 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b374d7-4fb0-4aec-9ab8-854a3811f1ec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:10.172225 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b374d7-4fb0-4aec-9ab8-854a3811f1ec None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:10.180772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de9698-edb0-49aa-8ce9-a280023661c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:10.181532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de9698-edb0-49aa-8ce9-a280023661c7 None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:10.182254 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de9698-edb0-49aa-8ce9-a280023661c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:10.182536 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de9698-edb0-49aa-8ce9-a280023661c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:10.185439 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de9698-edb0-49aa-8ce9-a280023661c7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:10.185439 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de9698-edb0-49aa-8ce9-a280023661c7 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:10.261737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 485/1009] 10.222.0.79 () {60 vars in 1141 bytes} [Fri Sep 2 21:03:10 2022] POST /identity/v3/services => generated 242 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:03:10.263068 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b52fb6-95cb-4bdd-bcfb-2f0e77b1dd24 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:10.263359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b52fb6-95cb-4bdd-bcfb-2f0e77b1dd24 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:10.263638 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b52fb6-95cb-4bdd-bcfb-2f0e77b1dd24 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:10.264908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 486/1010] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:10.271174 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59bb3a-869e-4e99-bcaa-786ec5b3b215 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:10.271448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59bb3a-869e-4e99-bcaa-786ec5b3b215 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:10.271722 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59bb3a-869e-4e99-bcaa-786ec5b3b215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:10.292475 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-9f59bb3a-869e-4e99-bcaa-786ec5b3b215 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:10.293132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 525/1011] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:03:10 2022] POST /identity/v3/endpoints => generated 325 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:03:10.294591 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-9f59bb3a-869e-4e99-bcaa-786ec5b3b215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:10.366813 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:10.393632 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 487/1012] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:10 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:03:10.664194 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de9698-edb0-49aa-8ce9-a280023661c7 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:10.777508 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de9698-edb0-49aa-8ce9-a280023661c7 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:10.814419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94dfac-c196-40b5-8542-b4306a157018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:10.815060 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94dfac-c196-40b5-8542-b4306a157018 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:10.815340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94dfac-c196-40b5-8542-b4306a157018 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:10.815615 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94dfac-c196-40b5-8542-b4306a157018 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:10.816456 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94dfac-c196-40b5-8542-b4306a157018 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:10.817628 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94dfac-c196-40b5-8542-b4306a157018 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:10.826707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-8e94dfac-c196-40b5-8542-b4306a157018 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 21:03:10.826707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:10.826707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:03:10.826707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:03:10.826707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:03:10.826707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:03:10.826707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:03:10.826707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:03:10.826707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 21:03:10.826707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:10.826707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:03:10.826707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:10.826707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:10.826707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:10.826707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:10.826707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:10.826707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:10.827814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:10.827814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:10.827814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:10.827814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:10.827814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:10.827814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:10.827814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:03:10.827814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:03:10.827814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:03:10.827814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:03:10.827814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:10.827814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:10.827814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:10.827814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:10.827814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:10.827814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:10.829009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:10.829009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:10.829009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:10.829009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:10.829009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:10.829009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:10.829009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:10.829009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:10.829009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:10.829009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:10.829009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:03:10.829009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:03:10.829009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 02 21:03:10.829009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:10.836240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 526/1013] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:03:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:10.836385 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59bb3a-869e-4e99-bcaa-786ec5b3b215 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:10.942280 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59bb3a-869e-4e99-bcaa-786ec5b3b215 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:10.979004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a5f1a-2bd6-4d21-9663-1e3a36328970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:10.979773 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a5f1a-2bd6-4d21-9663-1e3a36328970 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:10.980156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a5f1a-2bd6-4d21-9663-1e3a36328970 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:10.980538 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a5f1a-2bd6-4d21-9663-1e3a36328970 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:10.981304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a5f1a-2bd6-4d21-9663-1e3a36328970 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:10.981701 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a5f1a-2bd6-4d21-9663-1e3a36328970 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:10.983180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a5f1a-2bd6-4d21-9663-1e3a36328970 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:10.993771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 488/1014] 10.222.0.79 () {56 vars in 1112 bytes} [Fri Sep 2 21:03:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:10.994993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94dfac-c196-40b5-8542-b4306a157018 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:10.999633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:11.114738 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94dfac-c196-40b5-8542-b4306a157018 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:11.152325 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef71fa1-ce29-4ca7-9a83-6f8e7a3a4527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:11.153087 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71fa1-ce29-4ca7-9a83-6f8e7a3a4527 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:11.153494 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71fa1-ce29-4ca7-9a83-6f8e7a3a4527 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:11.153901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71fa1-ce29-4ca7-9a83-6f8e7a3a4527 None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:11.154638 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef71fa1-ce29-4ca7-9a83-6f8e7a3a4527 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:11.155050 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef71fa1-ce29-4ca7-9a83-6f8e7a3a4527 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:11.156577 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef71fa1-ce29-4ca7-9a83-6f8e7a3a4527 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:11.163846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 527/1015] 10.222.0.79 () {56 vars in 1112 bytes} [Fri Sep 2 21:03:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:11.169434 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a5f1a-2bd6-4d21-9663-1e3a36328970 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:11.229520 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:11.286287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a5f1a-2bd6-4d21-9663-1e3a36328970 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:11.321872 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725158c5-d3b0-4fc3-96ab-95a6cd1e26cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:11.322376 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725158c5-d3b0-4fc3-96ab-95a6cd1e26cb None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:11.322655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725158c5-d3b0-4fc3-96ab-95a6cd1e26cb None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:11.322930 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725158c5-d3b0-4fc3-96ab-95a6cd1e26cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:11.323612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725158c5-d3b0-4fc3-96ab-95a6cd1e26cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:11.324990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725158c5-d3b0-4fc3-96ab-95a6cd1e26cb None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:11.481923 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 489/1016] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:03:11 2022] POST /identity/v3/endpoints => generated 334 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:03:12.243981 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5a299-6fe5-4aa3-a340-6748cf9ea060 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:12.244598 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5a299-6fe5-4aa3-a340-6748cf9ea060 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:12.244598 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5a299-6fe5-4aa3-a340-6748cf9ea060 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:12.246050 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 528/1017] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:12.251362 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208870d-5d4d-4bd7-bbb3-03b6769de64f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:12.251756 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208870d-5d4d-4bd7-bbb3-03b6769de64f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:12.251932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208870d-5d4d-4bd7-bbb3-03b6769de64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:12.271138 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-8208870d-5d4d-4bd7-bbb3-03b6769de64f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:12.272725 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8208870d-5d4d-4bd7-bbb3-03b6769de64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:12.312335 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91897e6b-c8b4-45d4-9c73-2e80ff2afc7d None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:12.312639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91897e6b-c8b4-45d4-9c73-2e80ff2afc7d None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:12.313041 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91897e6b-c8b4-45d4-9c73-2e80ff2afc7d None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:12.314522 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 529/1018] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:12.320962 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a5031-c060-4013-9b23-936807c34b7b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:12.321248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a5031-c060-4013-9b23-936807c34b7b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:12.321523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a5031-c060-4013-9b23-936807c34b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:12.341224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-870a5031-c060-4013-9b23-936807c34b7b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:12.342443 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-870a5031-c060-4013-9b23-936807c34b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:12.353095 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 490/1019] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:12.414855 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:12.421005 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 530/1020] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:03:12.627022 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208870d-5d4d-4bd7-bbb3-03b6769de64f None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:12.658173 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:12.699686 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a5031-c060-4013-9b23-936807c34b7b None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:12.742071 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208870d-5d4d-4bd7-bbb3-03b6769de64f None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:12.778085 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75968e31-439b-4323-8d8c-5d82bb4e015e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:12.778774 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75968e31-439b-4323-8d8c-5d82bb4e015e None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:12.779054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75968e31-439b-4323-8d8c-5d82bb4e015e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:12.779332 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75968e31-439b-4323-8d8c-5d82bb4e015e None admin] PATH_INFO: `/v3/services/image` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:12.779920 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75968e31-439b-4323-8d8c-5d82bb4e015e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:12.782366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75968e31-439b-4323-8d8c-5d82bb4e015e None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:12.791585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-75968e31-439b-4323-8d8c-5d82bb4e015e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 21:03:12.791585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:12.791585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:03:12.791585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:03:12.791585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:03:12.791585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:03:12.791585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:03:12.791585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:03:12.791585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 21:03:12.791585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:12.791585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:03:12.791585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:12.791585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:12.791585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:12.791585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:12.791585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:12.791585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:12.792620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:12.792620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:12.792620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:12.792620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:12.792620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:12.792620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:12.792620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:03:12.792620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:03:12.792620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:03:12.792620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:03:12.792620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:12.792620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:12.792620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:12.792620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:12.792620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:12.792620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:12.793502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:12.793502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:12.793502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:12.793502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:12.793502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:12.793502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:12.793502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:12.793502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:12.793502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:12.793502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:12.793502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:03:12.793502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:03:12.793502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 21:03:12.793502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:12.793502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 491/1021] 10.222.0.79 () {56 vars in 1105 bytes} [Fri Sep 2 21:03:12 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:12.798781 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75968e31-439b-4323-8d8c-5d82bb4e015e None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:12.819237 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a5031-c060-4013-9b23-936807c34b7b None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:12.855661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbedf6-6e2c-4d33-bb1e-4e289333066a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:12.856296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbedf6-6e2c-4d33-bb1e-4e289333066a None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:12.856577 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbedf6-6e2c-4d33-bb1e-4e289333066a None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:12.856853 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbedf6-6e2c-4d33-bb1e-4e289333066a None admin] PATH_INFO: `/v3/domains/default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:12.857975 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbedf6-6e2c-4d33-bb1e-4e289333066a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:12.859447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbedf6-6e2c-4d33-bb1e-4e289333066a None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:12.861013 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 531/1022] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:03:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:12.866888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbedf6-6e2c-4d33-bb1e-4e289333066a None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:12.901051 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:12.909013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75968e31-439b-4323-8d8c-5d82bb4e015e None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:12.934433 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:12.946425 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e908afc-63bf-438a-b8e8-d850caca5808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:12.947049 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e908afc-63bf-438a-b8e8-d850caca5808 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:12.947334 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e908afc-63bf-438a-b8e8-d850caca5808 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:12.947614 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e908afc-63bf-438a-b8e8-d850caca5808 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:12.948257 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e908afc-63bf-438a-b8e8-d850caca5808 None admin] RBAC: Adding query filter params (name=image) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:12.948563 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e908afc-63bf-438a-b8e8-d850caca5808 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:12.950000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e908afc-63bf-438a-b8e8-d850caca5808 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:12.956216 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 492/1023] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:03:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:12.962049 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e908afc-63bf-438a-b8e8-d850caca5808 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:12.977386 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbedf6-6e2c-4d33-bb1e-4e289333066a None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:13.015772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307a675-4822-47ae-b515-0b7012f77b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:13.016589 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307a675-4822-47ae-b515-0b7012f77b36 None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:13.016872 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307a675-4822-47ae-b515-0b7012f77b36 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:13.017147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307a675-4822-47ae-b515-0b7012f77b36 None admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:13.017832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307a675-4822-47ae-b515-0b7012f77b36 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:13.019381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307a675-4822-47ae-b515-0b7012f77b36 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:13.072737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e908afc-63bf-438a-b8e8-d850caca5808 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:13.109231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 532/1024] 10.222.0.79 () {60 vars in 1141 bytes} [Fri Sep 2 21:03:12 2022] POST /identity/v3/projects => generated 311 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:03:13.109748 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ec9c2-0df0-42c8-9984-052557ea9f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:13.110432 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ec9c2-0df0-42c8-9984-052557ea9f79 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:13.110726 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ec9c2-0df0-42c8-9984-052557ea9f79 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:13.111006 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ec9c2-0df0-42c8-9984-052557ea9f79 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:13.111650 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ec9c2-0df0-42c8-9984-052557ea9f79 None admin] RBAC: Adding query filter params (type=image) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:13.111962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ec9c2-0df0-42c8-9984-052557ea9f79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:13.113346 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ec9c2-0df0-42c8-9984-052557ea9f79 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:13.119587 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 493/1025] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:03:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:13.128089 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307a675-4822-47ae-b515-0b7012f77b36 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:13.245947 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307a675-4822-47ae-b515-0b7012f77b36 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:13.264993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:13.283746 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19a881-1947-4d46-b469-d51ae0269676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:13.284369 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19a881-1947-4d46-b469-d51ae0269676 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:13.284658 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19a881-1947-4d46-b469-d51ae0269676 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:13.284935 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19a881-1947-4d46-b469-d51ae0269676 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:13.285723 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19a881-1947-4d46-b469-d51ae0269676 None admin] RBAC: Adding query filter params (interface=public, service_id=c67a9cceeeb748d1b77713abf87a65d8, region_id=RegionOne) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:13.286028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19a881-1947-4d46-b469-d51ae0269676 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:13.287669 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19a881-1947-4d46-b469-d51ae0269676 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:13.297886 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 533/1026] 10.222.0.79 () {56 vars in 1251 bytes} [Fri Sep 2 21:03:13 2022] GET /identity/v3/endpoints?service_id=c67a9cceeeb748d1b77713abf87a65d8&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:13.300261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ec9c2-0df0-42c8-9984-052557ea9f79 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:13.328417 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:13.411727 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ec9c2-0df0-42c8-9984-052557ea9f79 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:13.448487 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53776d78-566f-4171-aae7-5d6e7d2581de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:13.449092 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53776d78-566f-4171-aae7-5d6e7d2581de None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:13.449369 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53776d78-566f-4171-aae7-5d6e7d2581de None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:13.449639 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53776d78-566f-4171-aae7-5d6e7d2581de None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:13.450277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53776d78-566f-4171-aae7-5d6e7d2581de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:13.451634 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53776d78-566f-4171-aae7-5d6e7d2581de None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:13.459377 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 494/1027] 10.222.0.79 () {56 vars in 1087 bytes} [Fri Sep 2 21:03:13 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:03:13.529847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e654d7-ae86-4880-b2be-52bc49966942 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:13.530707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e654d7-ae86-4880-b2be-52bc49966942 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:13.530975 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e654d7-ae86-4880-b2be-52bc49966942 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:13.532751 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 534/1028] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:13.538494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a445b-94ac-45f6-aee8-c9ec1a0899b0 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:13.538829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a445b-94ac-45f6-aee8-c9ec1a0899b0 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:13.539058 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a445b-94ac-45f6-aee8-c9ec1a0899b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:13.559204 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-de6a445b-94ac-45f6-aee8-c9ec1a0899b0 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:13.560435 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-de6a445b-94ac-45f6-aee8-c9ec1a0899b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:13.641489 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 495/1029] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:13.916779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e654d7-ae86-4880-b2be-52bc49966942 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:14.024555 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e654d7-ae86-4880-b2be-52bc49966942 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:14.059748 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26045994-2fc1-460b-a2f6-56ba2be13504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:14.060384 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26045994-2fc1-460b-a2f6-56ba2be13504 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:14.060670 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26045994-2fc1-460b-a2f6-56ba2be13504 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:14.060947 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26045994-2fc1-460b-a2f6-56ba2be13504 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:14.071952 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26045994-2fc1-460b-a2f6-56ba2be13504 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:03:14.076816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-26045994-2fc1-460b-a2f6-56ba2be13504 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:03:14.076816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:14.076816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:14.076816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:14.076816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:14.076816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:14.076816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:14.076816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:14.076816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:14.076816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:14.076816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:14.076816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:14.076816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:03:14.076816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:03:14.076816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:03:14.076816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:03:14.077768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:03:14.077768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:03:14.077768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:03:14.077768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:03:14.077768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:14.077768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:14.077768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:14.077768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:14.077768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:14.077768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:14.077768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:14.077768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:14.077768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:14.077768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:14.077768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:14.077768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:14.078929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:14.078929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:14.078929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:14.078929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:14.078929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:03:14.078929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:03:14.078929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:03:14.078929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:03:14.078929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:03:14.078929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:03:14.078929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:03:14.078929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:14.079598 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 535/1030] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Sep 2 21:03:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:14.084860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a445b-94ac-45f6-aee8-c9ec1a0899b0 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:14.103229 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:14.186371 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a445b-94ac-45f6-aee8-c9ec1a0899b0 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:14.223194 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd57ec-5b2e-41af-bcff-88c796f3d155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:14.223812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd57ec-5b2e-41af-bcff-88c796f3d155 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:14.224097 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd57ec-5b2e-41af-bcff-88c796f3d155 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:14.224375 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd57ec-5b2e-41af-bcff-88c796f3d155 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:14.225053 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd57ec-5b2e-41af-bcff-88c796f3d155 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:14.225429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd57ec-5b2e-41af-bcff-88c796f3d155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:14.226760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd57ec-5b2e-41af-bcff-88c796f3d155 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:14.235749 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 496/1031] 10.222.0.79 () {56 vars in 1115 bytes} [Fri Sep 2 21:03:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:14.241368 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26045994-2fc1-460b-a2f6-56ba2be13504 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:14.291890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:14.354245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26045994-2fc1-460b-a2f6-56ba2be13504 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:14.390057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3969ac0-3fc2-44db-a10b-da321612997a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:14.390767 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3969ac0-3fc2-44db-a10b-da321612997a None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:14.391053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3969ac0-3fc2-44db-a10b-da321612997a None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:14.391333 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3969ac0-3fc2-44db-a10b-da321612997a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:14.402655 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3969ac0-3fc2-44db-a10b-da321612997a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:14.404127 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3969ac0-3fc2-44db-a10b-da321612997a None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:14.418796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-c3969ac0-3fc2-44db-a10b-da321612997a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:03:14.418796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:14.418796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:14.418796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:14.418796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:14.418796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:14.418796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:14.418796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:14.418796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:14.418796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:14.418796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:14.418796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:14.418796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:03:14.418796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:03:14.418796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:03:14.418796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:03:14.419774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:14.419774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:14.419774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:14.419774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:14.419774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:14.419774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:14.419774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:14.419774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:14.419774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:14.419774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:14.419774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:14.419774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:14.419774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:14.419774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:14.419774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:14.419774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:14.419774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:03:14.421202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:03:14.421202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:03:14.421202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:14.421202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 536/1032] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:14.426681 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd57ec-5b2e-41af-bcff-88c796f3d155 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:14.509560 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:14.531599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd57ec-5b2e-41af-bcff-88c796f3d155 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:14.575718 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6171e-d3ba-4a28-8956-8ce86d884867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:14.576411 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6171e-d3ba-4a28-8956-8ce86d884867 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:14.576714 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6171e-d3ba-4a28-8956-8ce86d884867 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:14.577620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6171e-d3ba-4a28-8956-8ce86d884867 None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:14.578737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6171e-d3ba-4a28-8956-8ce86d884867 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:14.578925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6171e-d3ba-4a28-8956-8ce86d884867 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:14.580419 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6171e-d3ba-4a28-8956-8ce86d884867 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:14.599588 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 497/1033] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:14.601103 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3969ac0-3fc2-44db-a10b-da321612997a None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:14.708857 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:14.714200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3969ac0-3fc2-44db-a10b-da321612997a None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:14.749641 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb8372-d021-4279-84d0-affdd087d7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:14.750460 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb8372-d021-4279-84d0-affdd087d7ce None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:14.750764 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb8372-d021-4279-84d0-affdd087d7ce None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:14.751225 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb8372-d021-4279-84d0-affdd087d7ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:14.759189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb8372-d021-4279-84d0-affdd087d7ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:14.760716 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb8372-d021-4279-84d0-affdd087d7ce None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:14.774099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-ecdb8372-d021-4279-84d0-affdd087d7ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:03:14.774099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:14.774099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:14.774099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:14.774099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:14.774099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:14.774099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:14.774099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:14.774099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:14.774099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:14.774099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:14.774099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:14.774099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:03:14.774099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:03:14.774099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:03:14.774099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:03:14.775404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:14.775404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:14.775404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:03:14.775404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:03:14.775404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:03:14.775404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:03:14.775404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:14.775404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:14.775404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:14.775404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:14.775404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:14.775404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:14.775404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:14.775404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:14.775404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:14.775404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:14.775404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:14.775404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:14.776621 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:14.776621 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:14.776621 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:03:14.776621 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:03:14.776621 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:03:14.776621 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:03:14.776621 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:03:14.776621 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:03:14.776621 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:03:14.776621 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:14.776621 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 537/1034] 10.222.0.79 () {56 vars in 1093 bytes} [Fri Sep 2 21:03:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:14.784228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6171e-d3ba-4a28-8956-8ce86d884867 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:14.899871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6171e-d3ba-4a28-8956-8ce86d884867 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:14.935891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f485aa9-8481-4e13-bd9c-3bbdebba92ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:14.936593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f485aa9-8481-4e13-bd9c-3bbdebba92ed None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:14.937079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f485aa9-8481-4e13-bd9c-3bbdebba92ed None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:14.937221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f485aa9-8481-4e13-bd9c-3bbdebba92ed None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:14.941828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f485aa9-8481-4e13-bd9c-3bbdebba92ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:14.941828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f485aa9-8481-4e13-bd9c-3bbdebba92ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:14.941828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f485aa9-8481-4e13-bd9c-3bbdebba92ed None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:14.957358 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:14.974361 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 498/1035] 10.222.0.79 () {56 vars in 1133 bytes} [Fri Sep 2 21:03:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:14.978570 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb8372-d021-4279-84d0-affdd087d7ce None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:15.087084 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb8372-d021-4279-84d0-affdd087d7ce None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:15.122113 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca610344-08ba-4084-8233-c0fcc9121e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:15.122619 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca610344-08ba-4084-8233-c0fcc9121e3b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:15.122907 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca610344-08ba-4084-8233-c0fcc9121e3b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:15.123186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca610344-08ba-4084-8233-c0fcc9121e3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:15.144581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385459a1-9bc4-484b-b8f4-4374fcdad04a None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:15.144921 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385459a1-9bc4-484b-b8f4-4374fcdad04a None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:15.145137 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385459a1-9bc4-484b-b8f4-4374fcdad04a None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:15.146650 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 499/1036] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:03:15.148846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:15.151414 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda18489-e227-4e0b-bff6-7c723c50e733 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:15.151715 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda18489-e227-4e0b-bff6-7c723c50e733 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:15.151981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda18489-e227-4e0b-bff6-7c723c50e733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:15.171960 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-fda18489-e227-4e0b-bff6-7c723c50e733 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:15.173220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-fda18489-e227-4e0b-bff6-7c723c50e733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:15.197866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca610344-08ba-4084-8233-c0fcc9121e3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:15.199336 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca610344-08ba-4084-8233-c0fcc9121e3b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:15.244637 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 500/1037] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:15 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:03:15.308004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 538/1038] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:03:14 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:03:15.310337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda18489-e227-4e0b-bff6-7c723c50e733 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:15.417527 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda18489-e227-4e0b-bff6-7c723c50e733 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:15.427484 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18b2c5-3fef-4cee-9d63-8b380884b6db None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:15.427928 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18b2c5-3fef-4cee-9d63-8b380884b6db None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:15.428294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18b2c5-3fef-4cee-9d63-8b380884b6db None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:15.429713 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 539/1039] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:15.434747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c315d2-d013-4c4b-98d0-0fa3ad562657 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:15.435040 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c315d2-d013-4c4b-98d0-0fa3ad562657 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:15.435321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c315d2-d013-4c4b-98d0-0fa3ad562657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:15.450906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:15.456577 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-22c315d2-d013-4c4b-98d0-0fa3ad562657 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:15.457783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-22c315d2-d013-4c4b-98d0-0fa3ad562657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:15.462047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9880d7-de6d-403b-b185-51fdf5274e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:15.462686 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9880d7-de6d-403b-b185-51fdf5274e2d None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:15.462972 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9880d7-de6d-403b-b185-51fdf5274e2d None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:15.463249 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9880d7-de6d-403b-b185-51fdf5274e2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:15.473991 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9880d7-de6d-403b-b185-51fdf5274e2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:15.481608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9880d7-de6d-403b-b185-51fdf5274e2d None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:15.492308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-3c9880d7-de6d-403b-b185-51fdf5274e2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:03:15.492308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:15.492308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:15.492308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:15.492308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:15.492308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:15.492308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:15.492308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:15.492308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:15.492308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:15.492308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:15.492308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:15.492308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:03:15.492308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:03:15.492308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:03:15.492308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:03:15.493519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:15.493519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:15.493519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:15.493519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:15.493519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:15.493519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:15.493519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:15.493519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:15.493519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:15.493519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:15.493519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:15.493519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:15.493519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:15.493519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:15.493519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:15.493519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:15.493519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:03:15.494712 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:03:15.494712 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:03:15.494712 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:15.498168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 501/1040] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:03:15.500519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9880d7-de6d-403b-b185-51fdf5274e2d None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:15.518533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:15.536465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 540/1041] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:15 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:03:15.537308 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c315d2-d013-4c4b-98d0-0fa3ad562657 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:15.611110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9880d7-de6d-403b-b185-51fdf5274e2d None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:15.647248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c315d2-d013-4c4b-98d0-0fa3ad562657 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:15.648287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e94af9-8567-4f9e-8d84-7abeaaa95f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:15.649067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e94af9-8567-4f9e-8d84-7abeaaa95f60 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:15.649900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e94af9-8567-4f9e-8d84-7abeaaa95f60 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:15.650214 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e94af9-8567-4f9e-8d84-7abeaaa95f60 None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:15.650884 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e94af9-8567-4f9e-8d84-7abeaaa95f60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:15.654171 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e94af9-8567-4f9e-8d84-7abeaaa95f60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:15.656460 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e94af9-8567-4f9e-8d84-7abeaaa95f60 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:15.671876 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 502/1042] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:15.677569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e94af9-8567-4f9e-8d84-7abeaaa95f60 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:15.689900 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeec93e-6493-4c89-9c0e-d5853b1e7a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:15.693601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeec93e-6493-4c89-9c0e-d5853b1e7a13 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:15.693912 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeec93e-6493-4c89-9c0e-d5853b1e7a13 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:15.694186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeec93e-6493-4c89-9c0e-d5853b1e7a13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:15.695834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeec93e-6493-4c89-9c0e-d5853b1e7a13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:15.696830 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeec93e-6493-4c89-9c0e-d5853b1e7a13 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:15.701940 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 541/1043] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:03:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:15.704989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeec93e-6493-4c89-9c0e-d5853b1e7a13 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:15.732803 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:15.760604 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:15.799575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e94af9-8567-4f9e-8d84-7abeaaa95f60 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:15.816611 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeec93e-6493-4c89-9c0e-d5853b1e7a13 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:15.835876 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c779a5-2647-4830-85b9-0f3faf4d1f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:15.836516 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c779a5-2647-4830-85b9-0f3faf4d1f42 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:15.836799 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c779a5-2647-4830-85b9-0f3faf4d1f42 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:15.837074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c779a5-2647-4830-85b9-0f3faf4d1f42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:15.843893 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c779a5-2647-4830-85b9-0f3faf4d1f42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:15.845349 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c779a5-2647-4830-85b9-0f3faf4d1f42 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:15.854434 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74f6c9-c5d1-447a-a0c4-124e01f28264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:15.855033 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74f6c9-c5d1-447a-a0c4-124e01f28264 None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:15.855314 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74f6c9-c5d1-447a-a0c4-124e01f28264 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:15.855578 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74f6c9-c5d1-447a-a0c4-124e01f28264 None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:15.856220 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74f6c9-c5d1-447a-a0c4-124e01f28264 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:15.857439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-58c779a5-2647-4830-85b9-0f3faf4d1f42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:03:15.857439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:15.857439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:15.857439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:15.857439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:15.857439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:15.857439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:15.857439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:15.857439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:15.857439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:15.857439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:15.857439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:15.857439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:03:15.857439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:03:15.857439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:03:15.859400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:03:15.859400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:15.859400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:15.859400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:15.859400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:15.859400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:15.859400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:15.859400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:15.859400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:15.859400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:15.859400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:15.859400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:15.859400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:15.859400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:15.859400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:15.859400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:15.859400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:15.860515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:03:15.860515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:03:15.860515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:03:15.860515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:03:15.860515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:03:15.860515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:03:15.860515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:03:15.860515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:15.860995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74f6c9-c5d1-447a-a0c4-124e01f28264 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:15.861068 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 503/1044] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:03:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:03:15.861068 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c779a5-2647-4830-85b9-0f3faf4d1f42 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:15.963173 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:15.967214 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c779a5-2647-4830-85b9-0f3faf4d1f42 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:15.982269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 542/1045] 10.222.0.79 () {60 vars in 1132 bytes} [Fri Sep 2 21:03:15 2022] POST /identity/v3/users => generated 285 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:03:15.982269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74f6c9-c5d1-447a-a0c4-124e01f28264 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:16.013608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3381252-f0dc-4c8a-a924-8e5de62a786c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:16.014990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3381252-f0dc-4c8a-a924-8e5de62a786c None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:16.015371 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3381252-f0dc-4c8a-a924-8e5de62a786c None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:16.015701 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3381252-f0dc-4c8a-a924-8e5de62a786c None admin] PATH_INFO: `/v3/services/image` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:16.016515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3381252-f0dc-4c8a-a924-8e5de62a786c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:16.018368 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3381252-f0dc-4c8a-a924-8e5de62a786c None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:16.037081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-f3381252-f0dc-4c8a-a924-8e5de62a786c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 21:03:16.037081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:16.037081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:03:16.037081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:03:16.037081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:03:16.037081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:03:16.037081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:03:16.037081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:03:16.037081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 21:03:16.037081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:16.037081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:03:16.037081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:16.037081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:16.037081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:16.037081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:16.037081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:16.037081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:16.038450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:16.038450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:16.038450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:16.038450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:16.038450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:16.038450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:16.038450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:03:16.038450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:03:16.038450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:03:16.038450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:03:16.038450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:16.038450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:16.038450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:16.038450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:16.038450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:16.038450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:16.039515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:16.039515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:16.039515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:16.039515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:16.039515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:16.039515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:16.039515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:16.039515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:16.039515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:16.039515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:16.039515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:03:16.039515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:03:16.039515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 02 21:03:16.039515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:16.040430 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 504/1046] 10.222.0.79 () {56 vars in 1105 bytes} [Fri Sep 2 21:03:15 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:16.046196 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3381252-f0dc-4c8a-a924-8e5de62a786c None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:16.122161 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74f6c9-c5d1-447a-a0c4-124e01f28264 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:16.132162 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:16.166027 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc0341-f3ea-459e-ba03-bd38d5e32fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:16.166653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc0341-f3ea-459e-ba03-bd38d5e32fc2 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:16.166934 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc0341-f3ea-459e-ba03-bd38d5e32fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:16.167213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc0341-f3ea-459e-ba03-bd38d5e32fc2 None admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:16.167958 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc0341-f3ea-459e-ba03-bd38d5e32fc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:16.168334 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc0341-f3ea-459e-ba03-bd38d5e32fc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:16.169753 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc0341-f3ea-459e-ba03-bd38d5e32fc2 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:16.180950 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3381252-f0dc-4c8a-a924-8e5de62a786c None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:16.184378 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 543/1047] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:03:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:16.191370 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc0341-f3ea-459e-ba03-bd38d5e32fc2 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:16.223431 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7718d-646f-406c-a370-318e549c5cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:16.223958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7718d-646f-406c-a370-318e549c5cb8 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:16.224236 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7718d-646f-406c-a370-318e549c5cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:16.224513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7718d-646f-406c-a370-318e549c5cb8 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:16.225149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7718d-646f-406c-a370-318e549c5cb8 None admin] RBAC: Adding query filter params (name=image) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:16.225465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7718d-646f-406c-a370-318e549c5cb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:16.226859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7718d-646f-406c-a370-318e549c5cb8 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:16.232928 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 505/1048] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:03:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:16.239622 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7718d-646f-406c-a370-318e549c5cb8 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:16.271718 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:16.316117 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc0341-f3ea-459e-ba03-bd38d5e32fc2 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:16.354777 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c8bb7-5aa2-48db-8666-a84c60abff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:16.355388 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c8bb7-5aa2-48db-8666-a84c60abff00 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:16.355672 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c8bb7-5aa2-48db-8666-a84c60abff00 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:16.355949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c8bb7-5aa2-48db-8666-a84c60abff00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:16.356573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7718d-646f-406c-a370-318e549c5cb8 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:16.356742 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c8bb7-5aa2-48db-8666-a84c60abff00 None admin] RBAC: Adding query filter params (role.id=5916d78324aa4a8584dbcc3a45e32746, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=632071470f7d409ab7b0129d120320c7) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:16.357059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c8bb7-5aa2-48db-8666-a84c60abff00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:16.359182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c8bb7-5aa2-48db-8666-a84c60abff00 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:16.373845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 544/1049] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:03:16 2022] GET /identity/v3/role_assignments?user.id=632071470f7d409ab7b0129d120320c7&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=5916d78324aa4a8584dbcc3a45e32746 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:16.408133 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a9033-e0d0-4f8f-9a85-0b95128762f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:16.408760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a9033-e0d0-4f8f-9a85-0b95128762f9 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:16.409042 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a9033-e0d0-4f8f-9a85-0b95128762f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:16.409316 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a9033-e0d0-4f8f-9a85-0b95128762f9 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:16.410009 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a9033-e0d0-4f8f-9a85-0b95128762f9 None admin] RBAC: Adding query filter params (type=image) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:16.410316 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a9033-e0d0-4f8f-9a85-0b95128762f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:16.411709 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a9033-e0d0-4f8f-9a85-0b95128762f9 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:16.423522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 506/1050] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:03:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:16.424673 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c8bb7-5aa2-48db-8666-a84c60abff00 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:16.462087 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:16.541475 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c8bb7-5aa2-48db-8666-a84c60abff00 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:16.576801 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5677697-f726-4aea-9472-54985712bcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:16.578022 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5677697-f726-4aea-9472-54985712bcac None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:16.578380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5677697-f726-4aea-9472-54985712bcac None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:16.578656 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5677697-f726-4aea-9472-54985712bcac None admin] PATH_INFO: `/v3/endpoints` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:16.579327 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5677697-f726-4aea-9472-54985712bcac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:16.580688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5677697-f726-4aea-9472-54985712bcac None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:16.689795 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 545/1051] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:03:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:03:18.088104 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2cfec-962b-4dcb-ac8a-7773c130f1d3 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:18.088635 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2cfec-962b-4dcb-ac8a-7773c130f1d3 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:18.088635 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2cfec-962b-4dcb-ac8a-7773c130f1d3 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:18.090186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 507/1052] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:18.096411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6c714-d7c3-4ebf-8879-469b787aec05 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:18.096840 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6c714-d7c3-4ebf-8879-469b787aec05 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:18.097037 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6c714-d7c3-4ebf-8879-469b787aec05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:18.116580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-75d6c714-d7c3-4ebf-8879-469b787aec05 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:18.117781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-75d6c714-d7c3-4ebf-8879-469b787aec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:18.194917 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 546/1053] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:18.322569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c0ac7-aaee-4808-9b70-cc733633f25b None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:18.322928 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c0ac7-aaee-4808-9b70-cc733633f25b None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:18.323124 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c0ac7-aaee-4808-9b70-cc733633f25b None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:18.325848 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 508/1054] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:18.330293 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c923f-6e14-456c-9a62-f2e9ea42d5ab None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:18.330587 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c923f-6e14-456c-9a62-f2e9ea42d5ab None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:18.330869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c923f-6e14-456c-9a62-f2e9ea42d5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:18.349334 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-4f2c923f-6e14-456c-9a62-f2e9ea42d5ab None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:18.350490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-4f2c923f-6e14-456c-9a62-f2e9ea42d5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:18.361489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:18.432063 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 547/1055] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:18.466903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c0ac7-aaee-4808-9b70-cc733633f25b None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:18.563732 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:18.574565 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c0ac7-aaee-4808-9b70-cc733633f25b None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:18.616712 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bf3c6-4b8c-4509-9d22-db339fb62517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:18.617263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bf3c6-4b8c-4509-9d22-db339fb62517 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:18.617541 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bf3c6-4b8c-4509-9d22-db339fb62517 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:18.617940 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bf3c6-4b8c-4509-9d22-db339fb62517 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:18.628831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bf3c6-4b8c-4509-9d22-db339fb62517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:03:18.633575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-b81bf3c6-4b8c-4509-9d22-db339fb62517 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:18.633575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:18.633575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:18.633575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:18.633575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:18.633575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:18.633575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:18.633575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:18.633575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:18.633575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:18.633575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:18.633575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:18.633575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:03:18.633575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:03:18.633575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:03:18.633575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:03:18.634630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:03:18.634630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:03:18.634630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:03:18.634630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:03:18.634630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:18.634630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:18.634630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:18.634630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:18.634630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:18.634630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:18.634630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:18.634630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:18.634630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:18.634630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:18.634630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:18.634630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:18.635513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:18.635513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:18.635513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:18.635513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:18.635513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:03:18.635513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:03:18.635513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:03:18.635513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:03:18.635513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:03:18.635513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:03:18.635513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:18.635513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:18.635513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 509/1056] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:03:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:18.642620 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c923f-6e14-456c-9a62-f2e9ea42d5ab None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:18.696508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345d988-63b1-47a3-8d8a-03a053eb2fce None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:18.696797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345d988-63b1-47a3-8d8a-03a053eb2fce None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:18.697236 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345d988-63b1-47a3-8d8a-03a053eb2fce None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:18.698744 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 510/1057] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:03:18.704713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317781d8-5043-42b4-8c13-027aeafa8fa8 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:18.705002 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317781d8-5043-42b4-8c13-027aeafa8fa8 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:18.705281 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317781d8-5043-42b4-8c13-027aeafa8fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:18.725490 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-317781d8-5043-42b4-8c13-027aeafa8fa8 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:18.726826 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-317781d8-5043-42b4-8c13-027aeafa8fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:18.756090 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c923f-6e14-456c-9a62-f2e9ea42d5ab None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:18.791200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e007a3-fd52-46f7-bcf3-7d6dea356cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:18.791811 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e007a3-fd52-46f7-bcf3-7d6dea356cf6 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:18.792090 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e007a3-fd52-46f7-bcf3-7d6dea356cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:18.792361 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e007a3-fd52-46f7-bcf3-7d6dea356cf6 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:18.793017 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e007a3-fd52-46f7-bcf3-7d6dea356cf6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:18.793318 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e007a3-fd52-46f7-bcf3-7d6dea356cf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:18.794707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e007a3-fd52-46f7-bcf3-7d6dea356cf6 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:18.800624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 511/1058] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:03:18.801566 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317781d8-5043-42b4-8c13-027aeafa8fa8 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:18.805748 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 548/1059] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:03:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:18.811774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e007a3-fd52-46f7-bcf3-7d6dea356cf6 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:18.822645 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:18.887339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:18.910723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317781d8-5043-42b4-8c13-027aeafa8fa8 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:18.925285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e007a3-fd52-46f7-bcf3-7d6dea356cf6 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:18.948304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a07d42-a027-4ccd-b5e0-825812bd360a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:18.948938 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a07d42-a027-4ccd-b5e0-825812bd360a None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:18.949217 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a07d42-a027-4ccd-b5e0-825812bd360a None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:18.949489 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a07d42-a027-4ccd-b5e0-825812bd360a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:18.961403 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a07d42-a027-4ccd-b5e0-825812bd360a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:03:18.966478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-04a07d42-a027-4ccd-b5e0-825812bd360a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:03:18.966478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:18.966478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:18.966478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:18.966478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:18.966478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:18.966478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:18.966478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:18.966478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:18.966478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:18.966478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:18.966478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:18.966478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:03:18.966478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:03:18.966478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:03:18.966478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:03:18.968075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:03:18.968075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:03:18.968075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:03:18.968075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:03:18.968075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:18.968075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:18.968075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:18.968075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:18.968075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:18.968075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:18.968075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:18.968075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:18.968075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:18.968075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:18.968075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:18.968075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:18.969089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:18.969089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:18.969089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:18.969089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:18.969089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:03:18.969089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:03:18.969089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:03:18.969089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:03:18.969089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:03:18.969089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:03:18.969089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:03:18.969089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:18.969089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 512/1060] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Sep 2 21:03:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:18.975279 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a07d42-a027-4ccd-b5e0-825812bd360a None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:18.975536 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480d9ea-9603-4c5e-8f8a-d8a3ce569754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:18.976180 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480d9ea-9603-4c5e-8f8a-d8a3ce569754 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:18.976470 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480d9ea-9603-4c5e-8f8a-d8a3ce569754 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:18.976745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480d9ea-9603-4c5e-8f8a-d8a3ce569754 None admin] PATH_INFO: `/v3/users/c66091c62af84e8083f0353863662765` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:18.991504 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480d9ea-9603-4c5e-8f8a-d8a3ce569754 None admin] RBAC: Authorizing `identity:get_user(user_id=c66091c62af84e8083f0353863662765)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:18.992960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480d9ea-9603-4c5e-8f8a-d8a3ce569754 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:18.994852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 549/1061] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:03:18 2022] GET /identity/v3/users/c66091c62af84e8083f0353863662765 => generated 285 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:19.001086 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480d9ea-9603-4c5e-8f8a-d8a3ce569754 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:19.091527 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a07d42-a027-4ccd-b5e0-825812bd360a None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:19.095373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:19.127106 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da828163-52a6-40f3-b3db-86d2a0b1b102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:19.127713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da828163-52a6-40f3-b3db-86d2a0b1b102 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:19.127990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da828163-52a6-40f3-b3db-86d2a0b1b102 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:19.128263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da828163-52a6-40f3-b3db-86d2a0b1b102 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:19.128930 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da828163-52a6-40f3-b3db-86d2a0b1b102 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:19.129236 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da828163-52a6-40f3-b3db-86d2a0b1b102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:19.130626 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da828163-52a6-40f3-b3db-86d2a0b1b102 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:19.135007 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480d9ea-9603-4c5e-8f8a-d8a3ce569754 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:19.138678 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 513/1062] 10.222.0.79 () {56 vars in 1115 bytes} [Fri Sep 2 21:03:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:19.140067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da828163-52a6-40f3-b3db-86d2a0b1b102 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:19.142805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:19.173885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d058a3-36ec-4c6d-9979-46f9c4897968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:19.174559 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d058a3-36ec-4c6d-9979-46f9c4897968 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:19.174879 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d058a3-36ec-4c6d-9979-46f9c4897968 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:19.175158 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d058a3-36ec-4c6d-9979-46f9c4897968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:19.243307 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da828163-52a6-40f3-b3db-86d2a0b1b102 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:19.245983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d058a3-36ec-4c6d-9979-46f9c4897968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:19.247539 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d058a3-36ec-4c6d-9979-46f9c4897968 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:19.277990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d950a-5238-4813-a45c-70621eef1dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:19.278602 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d950a-5238-4813-a45c-70621eef1dea None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:19.278889 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d950a-5238-4813-a45c-70621eef1dea None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:19.279165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d950a-5238-4813-a45c-70621eef1dea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:19.311592 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:19.351216 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 550/1063] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:03:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 02 21:03:19.351566 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d950a-5238-4813-a45c-70621eef1dea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:19.352056 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d058a3-36ec-4c6d-9979-46f9c4897968 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:19.352946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d950a-5238-4813-a45c-70621eef1dea None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:19.354989 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:19.458204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d058a3-36ec-4c6d-9979-46f9c4897968 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:19.461364 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 514/1064] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:03:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:03:19.462259 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d950a-5238-4813-a45c-70621eef1dea None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:19.496180 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180874a-4c63-48bf-ae6c-ceb103594eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:19.496813 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180874a-4c63-48bf-ae6c-ceb103594eb4 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:19.497100 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180874a-4c63-48bf-ae6c-ceb103594eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:19.497375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180874a-4c63-48bf-ae6c-ceb103594eb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:19.508573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180874a-4c63-48bf-ae6c-ceb103594eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:19.510066 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180874a-4c63-48bf-ae6c-ceb103594eb4 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:19.525409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-e180874a-4c63-48bf-ae6c-ceb103594eb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:03:19.525409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:19.525409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:19.525409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:19.525409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:19.525409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:19.525409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:19.525409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:19.525409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:19.525409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:19.525409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:19.525409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:19.525409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:03:19.525409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:03:19.525409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:03:19.525409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:03:19.526490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:19.526490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:19.526490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:19.526490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:19.526490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:19.526490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:19.526490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:19.526490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:19.526490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:19.526490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:19.526490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:19.526490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:19.526490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:19.526490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:19.526490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:19.526490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:19.526490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:03:19.527424 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:03:19.527424 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:03:19.527424 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:19.529992 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 551/1065] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:19.531124 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180874a-4c63-48bf-ae6c-ceb103594eb4 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:19.550215 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:19.570190 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d950a-5238-4813-a45c-70621eef1dea None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:19.571754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:19.604852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a06d99-b5f6-49af-92e2-5c7e92300afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:19.605483 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a06d99-b5f6-49af-92e2-5c7e92300afc None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:19.605766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a06d99-b5f6-49af-92e2-5c7e92300afc None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:19.606064 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a06d99-b5f6-49af-92e2-5c7e92300afc None admin] PATH_INFO: `/v3/projects/c9d306c7517c481aa3a32658928a4c95` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:19.607202 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a06d99-b5f6-49af-92e2-5c7e92300afc None admin] RBAC: Authorizing `identity:get_project(project_id=c9d306c7517c481aa3a32658928a4c95)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:19.609329 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a06d99-b5f6-49af-92e2-5c7e92300afc None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:19.611738 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 515/1066] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:03:19 2022] GET /identity/v3/projects/c9d306c7517c481aa3a32658928a4c95 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:19.613032 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a06d99-b5f6-49af-92e2-5c7e92300afc None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:19.635192 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180874a-4c63-48bf-ae6c-ceb103594eb4 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:19.670078 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b12c26-a878-40c6-8785-1b6640a6af67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:19.671345 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b12c26-a878-40c6-8785-1b6640a6af67 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:19.671627 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b12c26-a878-40c6-8785-1b6640a6af67 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:19.671903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b12c26-a878-40c6-8785-1b6640a6af67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:19.682410 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b12c26-a878-40c6-8785-1b6640a6af67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:19.683858 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b12c26-a878-40c6-8785-1b6640a6af67 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:19.699338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-d8b12c26-a878-40c6-8785-1b6640a6af67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:03:19.699338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:19.699338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:19.699338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:19.699338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:19.699338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:19.699338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:19.699338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:19.699338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:19.699338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:19.699338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:19.699338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:19.699338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:03:19.699338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:03:19.699338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:03:19.699338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:03:19.700533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:19.700533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:19.700533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:19.700533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:19.700533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:19.700533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:19.700533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:19.700533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:19.700533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:19.700533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:19.700533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:19.700533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:19.700533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:19.700533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:19.700533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:19.700533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:19.700533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:03:19.701584 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:03:19.701584 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:03:19.701584 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:19.701584 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 552/1067] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:19.701584 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b12c26-a878-40c6-8785-1b6640a6af67 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:19.723996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a06d99-b5f6-49af-92e2-5c7e92300afc None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:19.762421 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e742cba-9bfa-4a42-9e9b-ae8d06cd7254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:19.763030 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e742cba-9bfa-4a42-9e9b-ae8d06cd7254 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:19.763320 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e742cba-9bfa-4a42-9e9b-ae8d06cd7254 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:19.763596 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e742cba-9bfa-4a42-9e9b-ae8d06cd7254 None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:19.764255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e742cba-9bfa-4a42-9e9b-ae8d06cd7254 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:19.764562 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e742cba-9bfa-4a42-9e9b-ae8d06cd7254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:19.765966 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e742cba-9bfa-4a42-9e9b-ae8d06cd7254 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:19.771385 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:19.777268 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 516/1068] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:19.778118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e742cba-9bfa-4a42-9e9b-ae8d06cd7254 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:19.805749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b12c26-a878-40c6-8785-1b6640a6af67 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:19.809828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:19.841282 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e9871-b08b-41ee-8595-5681d7582b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:19.841936 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e9871-b08b-41ee-8595-5681d7582b32 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:19.842205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e9871-b08b-41ee-8595-5681d7582b32 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:19.842576 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e9871-b08b-41ee-8595-5681d7582b32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:19.843312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e9871-b08b-41ee-8595-5681d7582b32 None admin] RBAC: Adding query filter params (role.id=32e6a7f83b444d1ca9e5891a2b175f9a, scope.project.id=c9d306c7517c481aa3a32658928a4c95, user.id=c66091c62af84e8083f0353863662765) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:19.843628 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e9871-b08b-41ee-8595-5681d7582b32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:19.845073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e9871-b08b-41ee-8595-5681d7582b32 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:19.851374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 553/1069] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:03:19 2022] GET /identity/v3/role_assignments?user.id=c66091c62af84e8083f0353863662765&scope.project.id=c9d306c7517c481aa3a32658928a4c95&role.id=32e6a7f83b444d1ca9e5891a2b175f9a => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:19.851613 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e9871-b08b-41ee-8595-5681d7582b32 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:19.895760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e742cba-9bfa-4a42-9e9b-ae8d06cd7254 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:19.934292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e06390-a088-4543-9515-e709e845fd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:19.935009 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e06390-a088-4543-9515-e709e845fd25 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:19.935296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e06390-a088-4543-9515-e709e845fd25 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:19.935574 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e06390-a088-4543-9515-e709e845fd25 None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:19.936926 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e06390-a088-4543-9515-e709e845fd25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:19.937371 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e06390-a088-4543-9515-e709e845fd25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:19.938644 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e06390-a088-4543-9515-e709e845fd25 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:19.952441 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 517/1070] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:19.976740 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e9871-b08b-41ee-8595-5681d7582b32 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:20.014828 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:20.020239 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa065ed6-0855-4bfa-ab3e-2eafe508df69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:20.020895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa065ed6-0855-4bfa-ab3e-2eafe508df69 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:20.021175 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa065ed6-0855-4bfa-ab3e-2eafe508df69 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:20.021455 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa065ed6-0855-4bfa-ab3e-2eafe508df69 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:20.032141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa065ed6-0855-4bfa-ab3e-2eafe508df69 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:20.035345 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa065ed6-0855-4bfa-ab3e-2eafe508df69 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:20.047642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-fa065ed6-0855-4bfa-ab3e-2eafe508df69 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:03:20.047642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:20.047642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:20.047642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:20.047642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:20.047642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:20.047642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:20.047642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:20.047642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:20.047642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:20.047642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:20.047642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:20.047642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:03:20.047642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:03:20.047642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:03:20.047642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:03:20.048708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:20.048708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:20.048708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:03:20.048708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:03:20.048708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:03:20.048708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:03:20.048708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:20.048708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:20.048708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:20.048708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:20.048708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:20.048708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:20.048708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:20.048708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:20.048708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:20.048708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:20.048708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:20.048708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:20.050346 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:20.050346 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:20.050346 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:03:20.050346 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:03:20.050346 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:03:20.050346 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:03:20.050346 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:03:20.050346 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:03:20.050346 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:03:20.050346 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:20.050346 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 554/1071] 10.222.0.79 () {56 vars in 1093 bytes} [Fri Sep 2 21:03:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:20.055255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e06390-a088-4543-9515-e709e845fd25 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:20.167193 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:20.177185 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e06390-a088-4543-9515-e709e845fd25 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:20.214962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7a817-d968-4098-9cfe-a0df3696e7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:20.215583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7a817-d968-4098-9cfe-a0df3696e7c6 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:20.215866 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7a817-d968-4098-9cfe-a0df3696e7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:20.216145 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7a817-d968-4098-9cfe-a0df3696e7c6 None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:20.216890 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7a817-d968-4098-9cfe-a0df3696e7c6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:20.217204 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7a817-d968-4098-9cfe-a0df3696e7c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:20.219439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7a817-d968-4098-9cfe-a0df3696e7c6 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:20.237637 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 518/1072] 10.222.0.79 () {56 vars in 1133 bytes} [Fri Sep 2 21:03:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:20.243069 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa065ed6-0855-4bfa-ab3e-2eafe508df69 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:20.349254 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa065ed6-0855-4bfa-ab3e-2eafe508df69 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:20.383696 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe30da-92a7-4069-8895-6686d4f42703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:20.384324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe30da-92a7-4069-8895-6686d4f42703 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:20.384606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe30da-92a7-4069-8895-6686d4f42703 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:20.384881 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe30da-92a7-4069-8895-6686d4f42703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:20.396182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe30da-92a7-4069-8895-6686d4f42703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:20.397638 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe30da-92a7-4069-8895-6686d4f42703 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:20.412138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-93fe30da-92a7-4069-8895-6686d4f42703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:03:20.412138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:20.412138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:20.412138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:20.412138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:20.412138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:20.412138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:20.412138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:20.412138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:20.412138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:20.412138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:20.412138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:20.412138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:03:20.412138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:03:20.412138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:03:20.412138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:03:20.413532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:20.413532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:20.413532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:20.413532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:20.413532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:20.413532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:20.413532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:20.413532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:20.413532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:20.413532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:20.413532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:20.413532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:20.413532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:20.413532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:20.413532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:20.413532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:20.413532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:03:20.414772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:03:20.414772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:03:20.414772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:20.414772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 555/1073] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:03:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:20.419090 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7a817-d968-4098-9cfe-a0df3696e7c6 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:20.518836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7a817-d968-4098-9cfe-a0df3696e7c6 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:20.552439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f7381-ac3a-4d89-b641-c7faad124dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:20.553039 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f7381-ac3a-4d89-b641-c7faad124dde None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:20.553317 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f7381-ac3a-4d89-b641-c7faad124dde None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:20.553590 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f7381-ac3a-4d89-b641-c7faad124dde None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:20.554254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f7381-ac3a-4d89-b641-c7faad124dde None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:20.554558 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f7381-ac3a-4d89-b641-c7faad124dde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:20.555908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f7381-ac3a-4d89-b641-c7faad124dde None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:20.567607 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 519/1074] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:20.573198 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe30da-92a7-4069-8895-6686d4f42703 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:20.619407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:20.674920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe30da-92a7-4069-8895-6686d4f42703 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:20.714711 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdfcb0-f136-4d3f-91bb-303ba51644a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:20.715350 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdfcb0-f136-4d3f-91bb-303ba51644a8 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:20.715639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdfcb0-f136-4d3f-91bb-303ba51644a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:20.717835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdfcb0-f136-4d3f-91bb-303ba51644a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:20.730828 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdfcb0-f136-4d3f-91bb-303ba51644a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:20.733544 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdfcb0-f136-4d3f-91bb-303ba51644a8 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:20.746683 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-29fdfcb0-f136-4d3f-91bb-303ba51644a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:03:20.746683 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:20.746683 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:20.746683 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:20.746683 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:20.746683 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:20.746683 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:20.746683 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:20.746683 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:20.746683 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:20.746683 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:20.746683 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:20.746683 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:03:20.746683 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:03:20.746683 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:03:20.753301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:03:20.753301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:20.753301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:20.753301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:20.753301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:20.753301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:20.753301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:20.753301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:20.753301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:20.753301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:20.753301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:20.753301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:20.753301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:20.753301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:20.753301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:20.753301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:20.753301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:20.754245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:03:20.754245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:03:20.754245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:03:20.754245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:03:20.754245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:03:20.754245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:03:20.754245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:03:20.754245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:20.754245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 556/1075] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:03:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:20.754743 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f7381-ac3a-4d89-b641-c7faad124dde None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:20.765834 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:20.857147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f7381-ac3a-4d89-b641-c7faad124dde None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:20.893476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ae456-4304-4fa9-adfd-6de610863a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:20.894112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ae456-4304-4fa9-adfd-6de610863a9b None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:20.894395 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ae456-4304-4fa9-adfd-6de610863a9b None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:20.894671 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ae456-4304-4fa9-adfd-6de610863a9b None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:20.895368 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ae456-4304-4fa9-adfd-6de610863a9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:20.895677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ae456-4304-4fa9-adfd-6de610863a9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:20.897101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ae456-4304-4fa9-adfd-6de610863a9b None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:20.909693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 520/1076] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:03:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:20.916032 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdfcb0-f136-4d3f-91bb-303ba51644a8 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:21.023592 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdfcb0-f136-4d3f-91bb-303ba51644a8 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:21.025958 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:21.060026 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea9022-7398-40fd-91d1-33d9d57eac39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:21.060859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea9022-7398-40fd-91d1-33d9d57eac39 None admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:21.060990 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea9022-7398-40fd-91d1-33d9d57eac39 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:21.061856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea9022-7398-40fd-91d1-33d9d57eac39 None admin] PATH_INFO: `/v3/projects/61c5f56764934c4a90ad38357b46f397/users/632071470f7d409ab7b0129d120320c7/roles/5916d78324aa4a8584dbcc3a45e32746` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:21.064049 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea9022-7398-40fd-91d1-33d9d57eac39 None admin] RBAC: Authorizing `identity:create_grant(project_id=61c5f56764934c4a90ad38357b46f397, user_id=632071470f7d409ab7b0129d120320c7, role_id=5916d78324aa4a8584dbcc3a45e32746)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:21.065483 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea9022-7398-40fd-91d1-33d9d57eac39 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:21.135270 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 557/1077] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:03:20 2022] PUT /identity/v3/projects/61c5f56764934c4a90ad38357b46f397/users/632071470f7d409ab7b0129d120320c7/roles/5916d78324aa4a8584dbcc3a45e32746 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:03:21.821377 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d1c47-8a12-470e-adaa-be48e92bbae5 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:21.821929 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d1c47-8a12-470e-adaa-be48e92bbae5 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:21.822055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d1c47-8a12-470e-adaa-be48e92bbae5 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:21.823306 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 521/1078] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:21.829055 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41d2a1-f4de-4a13-817f-96173d007fc3 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:21.829504 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41d2a1-f4de-4a13-817f-96173d007fc3 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:21.829695 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41d2a1-f4de-4a13-817f-96173d007fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:21.848100 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-ad41d2a1-f4de-4a13-817f-96173d007fc3 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:21.849303 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ad41d2a1-f4de-4a13-817f-96173d007fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:21.918306 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 558/1079] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:03:22.217023 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d1c47-8a12-470e-adaa-be48e92bbae5 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:22.290505 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:22.324784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d1c47-8a12-470e-adaa-be48e92bbae5 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:22.360241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688344-1de5-4d01-beb6-5669d82bf3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:22.360869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688344-1de5-4d01-beb6-5669d82bf3be None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:22.361151 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688344-1de5-4d01-beb6-5669d82bf3be None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:22.361428 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688344-1de5-4d01-beb6-5669d82bf3be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:22.371560 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8688344-1de5-4d01-beb6-5669d82bf3be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:03:22.376463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-c8688344-1de5-4d01-beb6-5669d82bf3be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:22.376463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:22.376463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:22.376463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:22.376463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:22.376463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:22.376463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:22.376463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:22.376463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:22.376463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:22.376463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:22.376463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:22.376463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:03:22.376463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:03:22.376463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:03:22.376463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:03:22.377569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:03:22.377569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:03:22.377569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:03:22.377569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:03:22.377569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:22.377569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:22.377569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:22.377569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:22.377569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:22.377569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:22.377569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:22.377569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:22.377569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:22.377569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:22.377569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:22.377569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:22.378467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:22.378467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:22.378467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:22.378467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:22.378467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:03:22.378467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:03:22.378467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:03:22.378467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:03:22.378467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:03:22.378467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:03:22.378467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:22.378467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:22.378467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 522/1080] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:03:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:22.383703 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41d2a1-f4de-4a13-817f-96173d007fc3 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:22.479237 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:22.486684 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41d2a1-f4de-4a13-817f-96173d007fc3 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:22.521025 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3a26e-8fe1-4708-aefc-b9fb27762630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:22.521638 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3a26e-8fe1-4708-aefc-b9fb27762630 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:22.522222 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3a26e-8fe1-4708-aefc-b9fb27762630 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:22.522485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3a26e-8fe1-4708-aefc-b9fb27762630 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:22.523207 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3a26e-8fe1-4708-aefc-b9fb27762630 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:22.523670 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3a26e-8fe1-4708-aefc-b9fb27762630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:22.525540 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3a26e-8fe1-4708-aefc-b9fb27762630 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:22.534624 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 559/1081] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:03:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:22.540440 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688344-1de5-4d01-beb6-5669d82bf3be None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:22.642952 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688344-1de5-4d01-beb6-5669d82bf3be None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:22.671032 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:22.679649 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ad24f-d123-4b79-be3c-42637857dae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:22.680392 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ad24f-d123-4b79-be3c-42637857dae1 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:22.680676 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ad24f-d123-4b79-be3c-42637857dae1 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:22.680951 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ad24f-d123-4b79-be3c-42637857dae1 None admin] PATH_INFO: `/v3/users/c66091c62af84e8083f0353863662765` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:22.682127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ad24f-d123-4b79-be3c-42637857dae1 None admin] RBAC: Authorizing `identity:get_user(user_id=c66091c62af84e8083f0353863662765)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:22.683554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ad24f-d123-4b79-be3c-42637857dae1 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:22.686956 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 523/1082] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:03:22 2022] GET /identity/v3/users/c66091c62af84e8083f0353863662765 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:22.691137 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3a26e-8fe1-4708-aefc-b9fb27762630 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:22.797745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3a26e-8fe1-4708-aefc-b9fb27762630 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:22.831711 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae342ee1-3285-4ff4-9b79-7809b54f49ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:22.832351 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae342ee1-3285-4ff4-9b79-7809b54f49ff None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:22.832617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae342ee1-3285-4ff4-9b79-7809b54f49ff None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:22.832898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae342ee1-3285-4ff4-9b79-7809b54f49ff None admin] PATH_INFO: `/v3/projects/c9d306c7517c481aa3a32658928a4c95` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:22.834070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae342ee1-3285-4ff4-9b79-7809b54f49ff None admin] RBAC: Authorizing `identity:get_project(project_id=c9d306c7517c481aa3a32658928a4c95)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:22.835509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae342ee1-3285-4ff4-9b79-7809b54f49ff None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:22.837147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 560/1083] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:03:22 2022] GET /identity/v3/projects/c9d306c7517c481aa3a32658928a4c95 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:22.843725 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ad24f-d123-4b79-be3c-42637857dae1 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:22.942790 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ad24f-d123-4b79-be3c-42637857dae1 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:22.977152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f57af-3523-407a-9123-4f53b33716c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:22.977830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f57af-3523-407a-9123-4f53b33716c2 None admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:22.978107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f57af-3523-407a-9123-4f53b33716c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:22.978380 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f57af-3523-407a-9123-4f53b33716c2 None admin] PATH_INFO: `/v3/projects/c9d306c7517c481aa3a32658928a4c95/users/c66091c62af84e8083f0353863662765/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:22.980257 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f57af-3523-407a-9123-4f53b33716c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9d306c7517c481aa3a32658928a4c95, user_id=c66091c62af84e8083f0353863662765, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:22.981673 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f57af-3523-407a-9123-4f53b33716c2 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:23.049759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 524/1084] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:03:22 2022] PUT /identity/v3/projects/c9d306c7517c481aa3a32658928a4c95/users/c66091c62af84e8083f0353863662765/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:03:23.075500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c892a-e2b8-48f6-b94b-944786c4c30e None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:23.075812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c892a-e2b8-48f6-b94b-944786c4c30e None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:23.076082 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c892a-e2b8-48f6-b94b-944786c4c30e None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:23.078313 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 561/1085] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:23.084850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241b412-fe9c-4e66-9b90-ef49a308a66f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:23.085135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241b412-fe9c-4e66-9b90-ef49a308a66f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:23.085415 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241b412-fe9c-4e66-9b90-ef49a308a66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:23.105727 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-4241b412-fe9c-4e66-9b90-ef49a308a66f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:23.106996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-4241b412-fe9c-4e66-9b90-ef49a308a66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:23.167711 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:23.185172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 525/1086] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:03:23.465232 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c892a-e2b8-48f6-b94b-944786c4c30e None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:23.492347 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:23.572054 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c892a-e2b8-48f6-b94b-944786c4c30e None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:23.605366 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40da840-cbc9-4170-be7a-711eb49a085d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:23.606022 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40da840-cbc9-4170-be7a-711eb49a085d None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:23.606310 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40da840-cbc9-4170-be7a-711eb49a085d None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:23.606587 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40da840-cbc9-4170-be7a-711eb49a085d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:23.622616 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40da840-cbc9-4170-be7a-711eb49a085d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:03:23.628182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-c40da840-cbc9-4170-be7a-711eb49a085d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:03:23.628182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:23.628182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:23.628182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:23.628182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:23.628182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:23.628182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:23.628182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:23.628182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:23.628182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:23.628182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:23.628182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:23.628182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:03:23.628182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:03:23.628182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:03:23.628182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:03:23.629309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:03:23.629309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:03:23.629309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:03:23.629309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:03:23.629309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:23.629309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:23.629309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:23.629309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:23.629309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:23.629309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:23.629309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:23.629309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:23.629309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:23.629309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:23.629309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:23.629309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:23.630649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:23.630649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:23.630649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:23.630649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:23.630649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:03:23.630649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:03:23.630649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:03:23.630649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:03:23.630649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:03:23.630649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:03:23.630649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 02 21:03:23.630649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:23.630649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 562/1087] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Sep 2 21:03:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:23.635381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241b412-fe9c-4e66-9b90-ef49a308a66f None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:23.741498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241b412-fe9c-4e66-9b90-ef49a308a66f None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:23.775349 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e787c1-6ac8-4d3c-8f9f-9e02d0226cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:23.775957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e787c1-6ac8-4d3c-8f9f-9e02d0226cf1 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:23.776242 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e787c1-6ac8-4d3c-8f9f-9e02d0226cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:23.776515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e787c1-6ac8-4d3c-8f9f-9e02d0226cf1 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:23.777188 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e787c1-6ac8-4d3c-8f9f-9e02d0226cf1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:23.777495 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e787c1-6ac8-4d3c-8f9f-9e02d0226cf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:23.778896 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e787c1-6ac8-4d3c-8f9f-9e02d0226cf1 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:23.787902 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 526/1088] 10.222.0.79 () {56 vars in 1115 bytes} [Fri Sep 2 21:03:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:23.793933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40da840-cbc9-4170-be7a-711eb49a085d None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:23.881223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:23.897570 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40da840-cbc9-4170-be7a-711eb49a085d None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:23.934823 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea669fba-b7b2-47db-8c51-44970305c1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:23.935441 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea669fba-b7b2-47db-8c51-44970305c1de None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:23.935721 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea669fba-b7b2-47db-8c51-44970305c1de None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:23.936147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea669fba-b7b2-47db-8c51-44970305c1de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:23.946882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea669fba-b7b2-47db-8c51-44970305c1de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:23.948338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea669fba-b7b2-47db-8c51-44970305c1de None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:23.962898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-ea669fba-b7b2-47db-8c51-44970305c1de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:03:23.962898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:23.962898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:23.962898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:23.962898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:23.962898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:23.962898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:23.962898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:23.962898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:23.962898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:23.962898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:23.962898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:23.962898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:03:23.962898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:03:23.962898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:03:23.962898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:03:23.965001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:23.965001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:23.965001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:23.965001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:23.965001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:23.965001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:23.965001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:23.965001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:23.965001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:23.965001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:23.965001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:23.965001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:23.965001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:23.965001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:23.965001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:23.965001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:23.965001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:03:23.966132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:03:23.966132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:03:23.966132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:23.966132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 563/1089] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:03:23.971682 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e787c1-6ac8-4d3c-8f9f-9e02d0226cf1 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:24.024315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:24.077323 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e787c1-6ac8-4d3c-8f9f-9e02d0226cf1 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:24.112276 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840cc39-c16f-43bd-aa94-8f21c00a819f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:24.112893 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840cc39-c16f-43bd-aa94-8f21c00a819f None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:24.113167 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840cc39-c16f-43bd-aa94-8f21c00a819f None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:24.113440 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840cc39-c16f-43bd-aa94-8f21c00a819f None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:24.114123 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840cc39-c16f-43bd-aa94-8f21c00a819f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:24.114429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840cc39-c16f-43bd-aa94-8f21c00a819f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:24.116459 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840cc39-c16f-43bd-aa94-8f21c00a819f None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:24.139702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 527/1090] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:24.145437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea669fba-b7b2-47db-8c51-44970305c1de None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:24.250534 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea669fba-b7b2-47db-8c51-44970305c1de None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:24.285481 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f4119-7560-4fc9-a097-f3b099ed42e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:24.286060 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f4119-7560-4fc9-a097-f3b099ed42e4 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:24.286349 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f4119-7560-4fc9-a097-f3b099ed42e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:24.286647 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f4119-7560-4fc9-a097-f3b099ed42e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:24.289875 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:24.296409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f4119-7560-4fc9-a097-f3b099ed42e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:24.297884 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f4119-7560-4fc9-a097-f3b099ed42e4 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:24.310425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-b20f4119-7560-4fc9-a097-f3b099ed42e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:03:24.310425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:24.310425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:24.310425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:24.310425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:24.310425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:24.310425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:24.310425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:24.310425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:24.310425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:24.310425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:24.310425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:24.310425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:03:24.310425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:03:24.310425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:03:24.310425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:03:24.312498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:24.312498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:24.312498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:03:24.312498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:03:24.312498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:03:24.312498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:03:24.312498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:24.312498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:24.312498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:24.312498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:24.312498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:24.312498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:24.312498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:24.312498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:24.312498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:24.312498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:24.312498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:24.312498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:24.313466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:24.313466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:24.313466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:03:24.313466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:03:24.313466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:03:24.313466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:03:24.313466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:03:24.313466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:03:24.313466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 02 21:03:24.313466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:24.313466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 564/1091] 10.222.0.79 () {56 vars in 1093 bytes} [Fri Sep 2 21:03:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:03:24.318505 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840cc39-c16f-43bd-aa94-8f21c00a819f None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:24.427234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840cc39-c16f-43bd-aa94-8f21c00a819f None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:24.438348 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:24.466370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363bba9-0f2e-4e40-84c2-3d46e29d25ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:24.466988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363bba9-0f2e-4e40-84c2-3d46e29d25ba None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:24.467798 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363bba9-0f2e-4e40-84c2-3d46e29d25ba None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:24.468077 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363bba9-0f2e-4e40-84c2-3d46e29d25ba None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:24.468828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363bba9-0f2e-4e40-84c2-3d46e29d25ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:24.469137 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363bba9-0f2e-4e40-84c2-3d46e29d25ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:24.470665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363bba9-0f2e-4e40-84c2-3d46e29d25ba None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:24.490217 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 528/1092] 10.222.0.79 () {56 vars in 1133 bytes} [Fri Sep 2 21:03:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:24.497975 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f4119-7560-4fc9-a097-f3b099ed42e4 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:24.606943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f4119-7560-4fc9-a097-f3b099ed42e4 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:24.643137 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5799fc-7182-4368-9585-a6a5a37bb156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:24.643755 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5799fc-7182-4368-9585-a6a5a37bb156 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:24.644036 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5799fc-7182-4368-9585-a6a5a37bb156 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:24.644310 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5799fc-7182-4368-9585-a6a5a37bb156 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:24.712177 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:24.719945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5799fc-7182-4368-9585-a6a5a37bb156 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:24.721673 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5799fc-7182-4368-9585-a6a5a37bb156 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:24.828738 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 565/1093] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:03:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:03:24.835063 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363bba9-0f2e-4e40-84c2-3d46e29d25ba None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:24.940571 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363bba9-0f2e-4e40-84c2-3d46e29d25ba None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:24.978441 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79b2de-411f-41f1-ba9b-0d8de46a48ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:24.979838 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79b2de-411f-41f1-ba9b-0d8de46a48ba None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:24.980135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79b2de-411f-41f1-ba9b-0d8de46a48ba None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:24.980430 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79b2de-411f-41f1-ba9b-0d8de46a48ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:24.990282 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d628f-64b5-469b-a26f-4747586d6cc0 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:24.990850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d628f-64b5-469b-a26f-4747586d6cc0 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:24.990850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d628f-64b5-469b-a26f-4747586d6cc0 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:24.992175 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 566/1094] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:24.993248 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79b2de-411f-41f1-ba9b-0d8de46a48ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:24.994866 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79b2de-411f-41f1-ba9b-0d8de46a48ba None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:24.997881 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec132455-5a2b-427f-98f3-6f6b33d57bbb None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:24.998180 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec132455-5a2b-427f-98f3-6f6b33d57bbb None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:24.999074 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec132455-5a2b-427f-98f3-6f6b33d57bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:25.011476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-cc79b2de-411f-41f1-ba9b-0d8de46a48ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:03:25.011476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:25.011476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:25.011476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:25.011476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:25.011476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:25.011476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:25.011476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:25.011476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:25.011476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:25.011476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:25.011476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:25.011476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:03:25.011476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:03:25.011476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:03:25.011476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:03:25.012648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:25.012648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:25.012648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:25.012648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:25.012648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:25.012648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:25.012648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:25.012648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:25.012648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:25.012648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:25.012648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:25.012648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:25.012648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:25.012648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:25.012648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:25.012648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:25.012648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:03:25.013674 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:03:25.013674 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:03:25.013674 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:25.013674 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 529/1095] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:25.018500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-ec132455-5a2b-427f-98f3-6f6b33d57bbb None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:25.018654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79b2de-411f-41f1-ba9b-0d8de46a48ba None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:25.019706 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ec132455-5a2b-427f-98f3-6f6b33d57bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:25.038200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:25.089495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 567/1096] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:03:25.123785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79b2de-411f-41f1-ba9b-0d8de46a48ba None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:25.158780 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98d1d2-5dd9-4597-aa3c-fb1b27ca5d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:25.159388 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98d1d2-5dd9-4597-aa3c-fb1b27ca5d4e None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:25.159668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98d1d2-5dd9-4597-aa3c-fb1b27ca5d4e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:25.159943 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98d1d2-5dd9-4597-aa3c-fb1b27ca5d4e None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:25.160584 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98d1d2-5dd9-4597-aa3c-fb1b27ca5d4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:25.160891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98d1d2-5dd9-4597-aa3c-fb1b27ca5d4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:25.162318 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98d1d2-5dd9-4597-aa3c-fb1b27ca5d4e None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:25.173688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 530/1097] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:25.179420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec132455-5a2b-427f-98f3-6f6b33d57bbb None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:25.206897 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:25.277944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec132455-5a2b-427f-98f3-6f6b33d57bbb None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:25.311746 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd8163-4220-4293-b450-82fbe6bd4169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:25.312447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd8163-4220-4293-b450-82fbe6bd4169 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:25.312725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd8163-4220-4293-b450-82fbe6bd4169 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:25.312993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd8163-4220-4293-b450-82fbe6bd4169 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:25.319594 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd8163-4220-4293-b450-82fbe6bd4169 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:25.321027 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd8163-4220-4293-b450-82fbe6bd4169 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:25.332939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-edcd8163-4220-4293-b450-82fbe6bd4169 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:03:25.332939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:25.332939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:25.332939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:25.332939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:25.332939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:25.332939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:25.332939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:25.332939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:25.332939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:25.332939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:25.332939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:25.332939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:03:25.332939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:03:25.332939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:03:25.333918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:03:25.333918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:25.333918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:25.333918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:25.333918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:25.333918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:25.333918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:25.333918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:25.333918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:25.333918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:25.333918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:25.333918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:25.333918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:25.333918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:25.333918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:25.333918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:25.333918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:25.334854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:03:25.334854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:03:25.334854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:03:25.334854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:03:25.334854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:03:25.334854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:03:25.334854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:03:25.334854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:25.334854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 568/1098] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:03:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:25.339975 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98d1d2-5dd9-4597-aa3c-fb1b27ca5d4e None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:25.364275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd8163-4220-4293-b450-82fbe6bd4169 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:25.429564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:25.453991 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:25.455260 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98d1d2-5dd9-4597-aa3c-fb1b27ca5d4e None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:25.469032 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd8163-4220-4293-b450-82fbe6bd4169 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:25.489839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496e52b-fd6a-4503-83d3-8e288d20c95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:25.490455 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496e52b-fd6a-4503-83d3-8e288d20c95b None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:25.490739 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496e52b-fd6a-4503-83d3-8e288d20c95b None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:25.491013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496e52b-fd6a-4503-83d3-8e288d20c95b None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:25.491707 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496e52b-fd6a-4503-83d3-8e288d20c95b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:25.492015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496e52b-fd6a-4503-83d3-8e288d20c95b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:25.493542 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496e52b-fd6a-4503-83d3-8e288d20c95b None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:25.502699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd38bde-661a-4189-b6fd-c58049e45788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:25.503344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd38bde-661a-4189-b6fd-c58049e45788 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:25.503653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd38bde-661a-4189-b6fd-c58049e45788 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:25.503933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd38bde-661a-4189-b6fd-c58049e45788 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:25.506312 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 531/1099] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:03:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:25.512259 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496e52b-fd6a-4503-83d3-8e288d20c95b None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:25.516996 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd38bde-661a-4189-b6fd-c58049e45788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:03:25.521783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-fcd38bde-661a-4189-b6fd-c58049e45788 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:25.521783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:25.521783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:25.521783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:25.521783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:25.521783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:25.521783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:25.521783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:25.521783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:25.521783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:25.521783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:25.521783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:25.521783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:03:25.521783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:03:25.521783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:03:25.521783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:03:25.522760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:03:25.522760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:03:25.522760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:03:25.522760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:03:25.522760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:25.522760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:25.522760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:25.522760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:25.522760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:25.522760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:25.522760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:25.522760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:25.522760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:25.522760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:25.522760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:25.522760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:25.523784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:25.523784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:25.523784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:25.523784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:25.523784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:03:25.523784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:03:25.523784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:03:25.523784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:03:25.523784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:03:25.523784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:03:25.523784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:25.523784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:25.523784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 569/1100] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:03:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:03:25.528698 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd38bde-661a-4189-b6fd-c58049e45788 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:25.615867 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496e52b-fd6a-4503-83d3-8e288d20c95b None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:25.631922 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd38bde-661a-4189-b6fd-c58049e45788 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:25.650097 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872044b-5000-4e8f-9a4a-c94c3e5d439c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:25.650700 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872044b-5000-4e8f-9a4a-c94c3e5d439c None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:25.650985 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872044b-5000-4e8f-9a4a-c94c3e5d439c None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:25.651256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872044b-5000-4e8f-9a4a-c94c3e5d439c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:25.651977 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872044b-5000-4e8f-9a4a-c94c3e5d439c None admin] RBAC: Adding query filter params (role.id=5916d78324aa4a8584dbcc3a45e32746, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=632071470f7d409ab7b0129d120320c7) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:25.652285 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872044b-5000-4e8f-9a4a-c94c3e5d439c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:25.653696 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872044b-5000-4e8f-9a4a-c94c3e5d439c None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:25.660038 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 532/1101] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:03:25 2022] GET /identity/v3/role_assignments?user.id=632071470f7d409ab7b0129d120320c7&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=5916d78324aa4a8584dbcc3a45e32746 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:25.668874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276610e-357f-4260-8d60-ddbebe1dc162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:25.669576 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276610e-357f-4260-8d60-ddbebe1dc162 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:25.670027 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276610e-357f-4260-8d60-ddbebe1dc162 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:25.670371 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276610e-357f-4260-8d60-ddbebe1dc162 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:25.671122 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276610e-357f-4260-8d60-ddbebe1dc162 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:25.671500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276610e-357f-4260-8d60-ddbebe1dc162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:25.672988 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276610e-357f-4260-8d60-ddbebe1dc162 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:25.683435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 570/1102] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:03:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:25.690024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872044b-5000-4e8f-9a4a-c94c3e5d439c None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:25.693119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:25.801366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872044b-5000-4e8f-9a4a-c94c3e5d439c None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:25.838255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b489b9-9231-4c91-94b8-4449da829563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:25.838901 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b489b9-9231-4c91-94b8-4449da829563 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:25.839188 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b489b9-9231-4c91-94b8-4449da829563 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:25.839463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b489b9-9231-4c91-94b8-4449da829563 None admin] PATH_INFO: `/v3/users/c66091c62af84e8083f0353863662765` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:25.840632 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b489b9-9231-4c91-94b8-4449da829563 None admin] RBAC: Authorizing `identity:get_user(user_id=c66091c62af84e8083f0353863662765)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:25.842683 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b489b9-9231-4c91-94b8-4449da829563 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:25.844353 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 533/1103] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:03:25 2022] GET /identity/v3/users/c66091c62af84e8083f0353863662765 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:25.850570 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276610e-357f-4260-8d60-ddbebe1dc162 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:25.862612 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:25.958162 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276610e-357f-4260-8d60-ddbebe1dc162 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:25.994575 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1d23d-cdf6-4cd6-a3c3-7bf845741eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:26.014369 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1d23d-cdf6-4cd6-a3c3-7bf845741eed None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:26.014369 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1d23d-cdf6-4cd6-a3c3-7bf845741eed None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:26.014369 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1d23d-cdf6-4cd6-a3c3-7bf845741eed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:26.068687 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1d23d-cdf6-4cd6-a3c3-7bf845741eed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:26.069966 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1d23d-cdf6-4cd6-a3c3-7bf845741eed None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:26.081554 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:26.178719 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 571/1104] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:03:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:03:26.184733 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b489b9-9231-4c91-94b8-4449da829563 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:26.258596 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:26.293622 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b489b9-9231-4c91-94b8-4449da829563 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:26.330152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb75d1a-c567-49cf-80ee-7a2f576ba77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:26.330714 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb75d1a-c567-49cf-80ee-7a2f576ba77d None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:26.331005 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb75d1a-c567-49cf-80ee-7a2f576ba77d None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:26.331286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb75d1a-c567-49cf-80ee-7a2f576ba77d None admin] PATH_INFO: `/v3/projects/c9d306c7517c481aa3a32658928a4c95` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:26.332433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb75d1a-c567-49cf-80ee-7a2f576ba77d None admin] RBAC: Authorizing `identity:get_project(project_id=c9d306c7517c481aa3a32658928a4c95)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:26.333893 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb75d1a-c567-49cf-80ee-7a2f576ba77d None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:26.335538 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 534/1105] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:03:26 2022] GET /identity/v3/projects/c9d306c7517c481aa3a32658928a4c95 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:26.341760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1d23d-cdf6-4cd6-a3c3-7bf845741eed None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:26.448270 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1d23d-cdf6-4cd6-a3c3-7bf845741eed None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:26.459679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:26.485610 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366d364-4eb9-49fc-bc9b-209b978f3cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:26.486251 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366d364-4eb9-49fc-bc9b-209b978f3cfa None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:26.486540 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366d364-4eb9-49fc-bc9b-209b978f3cfa None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:26.486817 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366d364-4eb9-49fc-bc9b-209b978f3cfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:26.487587 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366d364-4eb9-49fc-bc9b-209b978f3cfa None admin] RBAC: Adding query filter params (role.id=32e6a7f83b444d1ca9e5891a2b175f9a, scope.project.id=c9d306c7517c481aa3a32658928a4c95, user.id=c66091c62af84e8083f0353863662765) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:26.487893 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366d364-4eb9-49fc-bc9b-209b978f3cfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:26.489337 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366d364-4eb9-49fc-bc9b-209b978f3cfa None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:26.495847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 572/1106] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:03:26 2022] GET /identity/v3/role_assignments?user.id=c66091c62af84e8083f0353863662765&scope.project.id=c9d306c7517c481aa3a32658928a4c95&role.id=32e6a7f83b444d1ca9e5891a2b175f9a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:28.473563 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a9dd5-adc0-467e-838e-7a4e2361c55d None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:28.474135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a9dd5-adc0-467e-838e-7a4e2361c55d None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:28.474135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a9dd5-adc0-467e-838e-7a4e2361c55d None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:28.475470 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 535/1107] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:28.481211 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab96d6-9d84-4c3c-936a-c66846a71af7 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:28.481679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab96d6-9d84-4c3c-936a-c66846a71af7 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:28.481772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab96d6-9d84-4c3c-936a-c66846a71af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:28.501687 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-f9ab96d6-9d84-4c3c-936a-c66846a71af7 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:28.502953 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f9ab96d6-9d84-4c3c-936a-c66846a71af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:28.570935 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 573/1108] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:03:28.841565 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a9dd5-adc0-467e-838e-7a4e2361c55d None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:28.943154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a9dd5-adc0-467e-838e-7a4e2361c55d None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:28.976954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb08eb1-7302-439d-b88e-f2f37e1f2ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:28.977581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb08eb1-7302-439d-b88e-f2f37e1f2ccc None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:28.977911 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb08eb1-7302-439d-b88e-f2f37e1f2ccc None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:28.978169 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb08eb1-7302-439d-b88e-f2f37e1f2ccc None admin] PATH_INFO: `/v3/domains/default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:28.979336 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb08eb1-7302-439d-b88e-f2f37e1f2ccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:28.980762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb08eb1-7302-439d-b88e-f2f37e1f2ccc None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:28.982358 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 536/1109] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:03:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:28.988161 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab96d6-9d84-4c3c-936a-c66846a71af7 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:29.089059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab96d6-9d84-4c3c-936a-c66846a71af7 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:29.090600 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:29.123764 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c837f2-0488-4dcd-abfe-7abfd7b90240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:29.124381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c837f2-0488-4dcd-abfe-7abfd7b90240 None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:29.124667 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c837f2-0488-4dcd-abfe-7abfd7b90240 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:29.124938 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c837f2-0488-4dcd-abfe-7abfd7b90240 None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:29.125589 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c837f2-0488-4dcd-abfe-7abfd7b90240 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:29.127068 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c837f2-0488-4dcd-abfe-7abfd7b90240 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:29.226138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 574/1110] 10.222.0.79 () {60 vars in 1132 bytes} [Fri Sep 2 21:03:28 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:03:31.214548 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd49c40-a163-433b-b6b6-e228f33305a7 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:31.215080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd49c40-a163-433b-b6b6-e228f33305a7 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:31.215080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd49c40-a163-433b-b6b6-e228f33305a7 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:31.216411 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 537/1111] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:31.221789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ffd77-c0d4-4dc8-9a94-a0db1f130e6b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:31.222253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ffd77-c0d4-4dc8-9a94-a0db1f130e6b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:31.222377 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ffd77-c0d4-4dc8-9a94-a0db1f130e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:31.240400 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-103ffd77-c0d4-4dc8-9a94-a0db1f130e6b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:31.241575 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-103ffd77-c0d4-4dc8-9a94-a0db1f130e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:31.306663 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 575/1112] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:31.580715 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd49c40-a163-433b-b6b6-e228f33305a7 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:31.589635 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:31.684995 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd49c40-a163-433b-b6b6-e228f33305a7 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:31.723706 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b38ca-8536-409c-b9dd-4c2f4b09af58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:31.724347 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b38ca-8536-409c-b9dd-4c2f4b09af58 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:31.724633 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b38ca-8536-409c-b9dd-4c2f4b09af58 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:31.724912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b38ca-8536-409c-b9dd-4c2f4b09af58 None admin] PATH_INFO: `/v3/roles/5feee6c423414badb9c65ac4076a7f45` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:31.726339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b38ca-8536-409c-b9dd-4c2f4b09af58 None admin] RBAC: Authorizing `identity:get_role(role_id=5feee6c423414badb9c65ac4076a7f45)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:31.727705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b38ca-8536-409c-b9dd-4c2f4b09af58 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:31.729035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 538/1113] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:03:31 2022] GET /identity/v3/roles/5feee6c423414badb9c65ac4076a7f45 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:31.734985 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ffd77-c0d4-4dc8-9a94-a0db1f130e6b None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:31.820957 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:31.833400 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ffd77-c0d4-4dc8-9a94-a0db1f130e6b None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:31.867639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771c541-1c90-4c61-8475-cf36178d0485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:31.868297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771c541-1c90-4c61-8475-cf36178d0485 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:31.868582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771c541-1c90-4c61-8475-cf36178d0485 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:31.868858 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771c541-1c90-4c61-8475-cf36178d0485 None admin] PATH_INFO: `/v3/users/927c05b9c58d42db91036c504c80f5b6` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:31.881959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771c541-1c90-4c61-8475-cf36178d0485 None admin] RBAC: Authorizing `identity:get_user(user_id=927c05b9c58d42db91036c504c80f5b6)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:31.883412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771c541-1c90-4c61-8475-cf36178d0485 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:31.885039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 576/1114] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:03:31 2022] GET /identity/v3/users/927c05b9c58d42db91036c504c80f5b6 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:31.891489 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b38ca-8536-409c-b9dd-4c2f4b09af58 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:31.967383 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:31.991770 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b38ca-8536-409c-b9dd-4c2f4b09af58 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:32.026851 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8b0c6-c993-48e5-a10b-fec1c18db975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:32.027461 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8b0c6-c993-48e5-a10b-fec1c18db975 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:32.027747 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8b0c6-c993-48e5-a10b-fec1c18db975 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:32.028026 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8b0c6-c993-48e5-a10b-fec1c18db975 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:32.095706 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8b0c6-c993-48e5-a10b-fec1c18db975 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:32.097080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8b0c6-c993-48e5-a10b-fec1c18db975 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:32.169483 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:32.195670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 539/1115] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:03:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:03:32.204185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771c541-1c90-4c61-8475-cf36178d0485 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:32.371308 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771c541-1c90-4c61-8475-cf36178d0485 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:32.408988 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58514b-b00e-4597-b527-b53edff500fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:32.409618 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58514b-b00e-4597-b527-b53edff500fd None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:32.409927 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58514b-b00e-4597-b527-b53edff500fd None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:32.410200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58514b-b00e-4597-b527-b53edff500fd None admin] PATH_INFO: `/v3/projects/c9d306c7517c481aa3a32658928a4c95` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:32.411316 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58514b-b00e-4597-b527-b53edff500fd None admin] RBAC: Authorizing `identity:get_project(project_id=c9d306c7517c481aa3a32658928a4c95)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:32.412746 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58514b-b00e-4597-b527-b53edff500fd None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:32.414408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 577/1116] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:03:32 2022] GET /identity/v3/projects/c9d306c7517c481aa3a32658928a4c95 => generated 311 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:32.421233 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8b0c6-c993-48e5-a10b-fec1c18db975 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:32.520007 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8b0c6-c993-48e5-a10b-fec1c18db975 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:32.553365 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a815cf-d46c-410b-b4ea-22782189ea3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:32.554069 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a815cf-d46c-410b-b4ea-22782189ea3b None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:32.554344 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a815cf-d46c-410b-b4ea-22782189ea3b None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:32.554614 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a815cf-d46c-410b-b4ea-22782189ea3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:32.555329 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a815cf-d46c-410b-b4ea-22782189ea3b None admin] RBAC: Adding query filter params (role.id=5feee6c423414badb9c65ac4076a7f45, scope.project.id=c9d306c7517c481aa3a32658928a4c95, user.id=927c05b9c58d42db91036c504c80f5b6) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:32.555637 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a815cf-d46c-410b-b4ea-22782189ea3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:32.557044 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a815cf-d46c-410b-b4ea-22782189ea3b None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:32.563392 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 540/1117] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:03:32 2022] GET /identity/v3/role_assignments?user.id=927c05b9c58d42db91036c504c80f5b6&scope.project.id=c9d306c7517c481aa3a32658928a4c95&role.id=5feee6c423414badb9c65ac4076a7f45 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:34.469926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43d6b6-2431-40d3-9022-b2320f2b031f None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:34.470467 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43d6b6-2431-40d3-9022-b2320f2b031f None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:34.470467 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43d6b6-2431-40d3-9022-b2320f2b031f None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:34.471818 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 578/1118] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:34.477173 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55161a3c-9b42-4142-8213-c9ee937a4a87 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:34.477601 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55161a3c-9b42-4142-8213-c9ee937a4a87 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:34.477733 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55161a3c-9b42-4142-8213-c9ee937a4a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:34.496313 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-55161a3c-9b42-4142-8213-c9ee937a4a87 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:34.497506 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-55161a3c-9b42-4142-8213-c9ee937a4a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:34.526365 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:34.564057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 541/1119] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:34.853235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43d6b6-2431-40d3-9022-b2320f2b031f None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:34.869078 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:34.956494 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43d6b6-2431-40d3-9022-b2320f2b031f None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:34.990358 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d75e8-117e-4b7f-98cb-f4d4098582af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:34.990989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d75e8-117e-4b7f-98cb-f4d4098582af None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:34.991272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d75e8-117e-4b7f-98cb-f4d4098582af None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:34.991550 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d75e8-117e-4b7f-98cb-f4d4098582af None admin] PATH_INFO: `/v3/roles/5feee6c423414badb9c65ac4076a7f45` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:34.992924 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d75e8-117e-4b7f-98cb-f4d4098582af None admin] RBAC: Authorizing `identity:get_role(role_id=5feee6c423414badb9c65ac4076a7f45)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:34.994319 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d75e8-117e-4b7f-98cb-f4d4098582af None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:34.995670 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 579/1120] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:03:34 2022] GET /identity/v3/roles/5feee6c423414badb9c65ac4076a7f45 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:35.002258 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55161a3c-9b42-4142-8213-c9ee937a4a87 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:35.114859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55161a3c-9b42-4142-8213-c9ee937a4a87 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:35.149365 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98d815-55d6-477b-b363-fab582917a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:35.150022 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98d815-55d6-477b-b363-fab582917a7f None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:35.150311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98d815-55d6-477b-b363-fab582917a7f None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:35.150581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98d815-55d6-477b-b363-fab582917a7f None admin] PATH_INFO: `/v3/users/927c05b9c58d42db91036c504c80f5b6` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:35.151714 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98d815-55d6-477b-b363-fab582917a7f None admin] RBAC: Authorizing `identity:get_user(user_id=927c05b9c58d42db91036c504c80f5b6)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:35.153142 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98d815-55d6-477b-b363-fab582917a7f None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:35.154801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 542/1121] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:03:35 2022] GET /identity/v3/users/927c05b9c58d42db91036c504c80f5b6 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:35.160676 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d75e8-117e-4b7f-98cb-f4d4098582af None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:35.242882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:35.261054 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d75e8-117e-4b7f-98cb-f4d4098582af None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:35.296434 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546179dc-30d4-4f5f-95e9-4a43966ac8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:35.297056 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546179dc-30d4-4f5f-95e9-4a43966ac8ee None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:35.297343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546179dc-30d4-4f5f-95e9-4a43966ac8ee None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:35.297631 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546179dc-30d4-4f5f-95e9-4a43966ac8ee None admin] PATH_INFO: `/v3/projects/c9d306c7517c481aa3a32658928a4c95` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:35.298810 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546179dc-30d4-4f5f-95e9-4a43966ac8ee None admin] RBAC: Authorizing `identity:get_project(project_id=c9d306c7517c481aa3a32658928a4c95)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:35.300241 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546179dc-30d4-4f5f-95e9-4a43966ac8ee None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:35.301913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 580/1122] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:03:35 2022] GET /identity/v3/projects/c9d306c7517c481aa3a32658928a4c95 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:35.308974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98d815-55d6-477b-b363-fab582917a7f None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:35.349558 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:35.416255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98d815-55d6-477b-b363-fab582917a7f None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:35.450500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd61f8-b380-4c12-bc45-aaa62e8ca5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:35.451298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd61f8-b380-4c12-bc45-aaa62e8ca5fb None admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:35.451586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd61f8-b380-4c12-bc45-aaa62e8ca5fb None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:35.451863 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd61f8-b380-4c12-bc45-aaa62e8ca5fb None admin] PATH_INFO: `/v3/projects/c9d306c7517c481aa3a32658928a4c95/users/927c05b9c58d42db91036c504c80f5b6/roles/5feee6c423414badb9c65ac4076a7f45` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:35.454275 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd61f8-b380-4c12-bc45-aaa62e8ca5fb None admin] RBAC: Authorizing `identity:create_grant(project_id=c9d306c7517c481aa3a32658928a4c95, user_id=927c05b9c58d42db91036c504c80f5b6, role_id=5feee6c423414badb9c65ac4076a7f45)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:35.455699 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd61f8-b380-4c12-bc45-aaa62e8ca5fb None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:35.528218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 543/1123] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:03:35 2022] PUT /identity/v3/projects/c9d306c7517c481aa3a32658928a4c95/users/927c05b9c58d42db91036c504c80f5b6/roles/5feee6c423414badb9c65ac4076a7f45 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:03:37.503694 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa6ae7-5d36-4bb7-9405-e6cc75b13619 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:37.504267 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa6ae7-5d36-4bb7-9405-e6cc75b13619 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:37.504267 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa6ae7-5d36-4bb7-9405-e6cc75b13619 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:37.505573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 581/1124] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:37.511026 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df1933-0077-4518-aeb6-74ba96fdb261 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:37.511490 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df1933-0077-4518-aeb6-74ba96fdb261 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:37.511605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df1933-0077-4518-aeb6-74ba96fdb261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:37.530573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-e5df1933-0077-4518-aeb6-74ba96fdb261 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:37.531789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e5df1933-0077-4518-aeb6-74ba96fdb261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:37.598187 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 544/1125] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:37.876837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa6ae7-5d36-4bb7-9405-e6cc75b13619 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:37.978147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa6ae7-5d36-4bb7-9405-e6cc75b13619 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:38.012091 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef0319-7262-41f8-b40d-bbab794c4241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:38.012713 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef0319-7262-41f8-b40d-bbab794c4241 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:38.012995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef0319-7262-41f8-b40d-bbab794c4241 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:38.013899 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef0319-7262-41f8-b40d-bbab794c4241 None admin] PATH_INFO: `/v3/roles/5feee6c423414badb9c65ac4076a7f45` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:38.015277 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef0319-7262-41f8-b40d-bbab794c4241 None admin] RBAC: Authorizing `identity:get_role(role_id=5feee6c423414badb9c65ac4076a7f45)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:38.016652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef0319-7262-41f8-b40d-bbab794c4241 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:38.018010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 582/1126] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:03:37 2022] GET /identity/v3/roles/5feee6c423414badb9c65ac4076a7f45 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:38.023907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df1933-0077-4518-aeb6-74ba96fdb261 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:38.051149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:38.124485 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df1933-0077-4518-aeb6-74ba96fdb261 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:38.158731 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9dd29-962a-40f8-82a3-1690f99c19bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:38.159287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9dd29-962a-40f8-82a3-1690f99c19bd None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:38.159570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9dd29-962a-40f8-82a3-1690f99c19bd None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:38.159851 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9dd29-962a-40f8-82a3-1690f99c19bd None admin] PATH_INFO: `/v3/users/927c05b9c58d42db91036c504c80f5b6` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:38.160988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9dd29-962a-40f8-82a3-1690f99c19bd None admin] RBAC: Authorizing `identity:get_user(user_id=927c05b9c58d42db91036c504c80f5b6)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:38.162457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9dd29-962a-40f8-82a3-1690f99c19bd None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:38.164029 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 545/1127] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:03:38 2022] GET /identity/v3/users/927c05b9c58d42db91036c504c80f5b6 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:38.170414 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef0319-7262-41f8-b40d-bbab794c4241 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:38.189131 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:38.270544 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef0319-7262-41f8-b40d-bbab794c4241 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:38.304835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1746643-0389-4520-a5c6-b6962bda1c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:38.305438 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1746643-0389-4520-a5c6-b6962bda1c77 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:38.305721 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1746643-0389-4520-a5c6-b6962bda1c77 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:38.306030 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1746643-0389-4520-a5c6-b6962bda1c77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:38.371561 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1746643-0389-4520-a5c6-b6962bda1c77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:38.373216 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1746643-0389-4520-a5c6-b6962bda1c77 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:38.391297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:38.471072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 583/1128] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:03:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:03:38.477032 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9dd29-962a-40f8-82a3-1690f99c19bd None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:38.570341 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:38.577350 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9dd29-962a-40f8-82a3-1690f99c19bd None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:38.610680 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67921d-a330-4114-bb7b-ae803c7a4bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:38.611302 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67921d-a330-4114-bb7b-ae803c7a4bb7 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:38.611583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67921d-a330-4114-bb7b-ae803c7a4bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:38.611859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67921d-a330-4114-bb7b-ae803c7a4bb7 None admin] PATH_INFO: `/v3/projects/c9d306c7517c481aa3a32658928a4c95` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:38.612975 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67921d-a330-4114-bb7b-ae803c7a4bb7 None admin] RBAC: Authorizing `identity:get_project(project_id=c9d306c7517c481aa3a32658928a4c95)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:38.614443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67921d-a330-4114-bb7b-ae803c7a4bb7 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:38.616125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 546/1129] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:03:38 2022] GET /identity/v3/projects/c9d306c7517c481aa3a32658928a4c95 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:38.622414 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1746643-0389-4520-a5c6-b6962bda1c77 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:38.721893 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1746643-0389-4520-a5c6-b6962bda1c77 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:38.738836 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:38.755954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7e95d-99d8-4ee1-b616-9288773318ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:38.756556 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7e95d-99d8-4ee1-b616-9288773318ee None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:38.756840 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7e95d-99d8-4ee1-b616-9288773318ee None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:38.757116 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7e95d-99d8-4ee1-b616-9288773318ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:38.757862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7e95d-99d8-4ee1-b616-9288773318ee None admin] RBAC: Adding query filter params (role.id=5feee6c423414badb9c65ac4076a7f45, scope.project.id=c9d306c7517c481aa3a32658928a4c95, user.id=927c05b9c58d42db91036c504c80f5b6) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:38.758179 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7e95d-99d8-4ee1-b616-9288773318ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:38.759604 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7e95d-99d8-4ee1-b616-9288773318ee None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:38.765909 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 584/1130] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:03:38 2022] GET /identity/v3/role_assignments?user.id=927c05b9c58d42db91036c504c80f5b6&scope.project.id=c9d306c7517c481aa3a32658928a4c95&role.id=5feee6c423414badb9c65ac4076a7f45 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:40.721360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700f448-f2f4-4601-8924-18e37842db7f None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:40.721867 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700f448-f2f4-4601-8924-18e37842db7f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:40.721964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700f448-f2f4-4601-8924-18e37842db7f None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:40.723262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 547/1131] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:03:40.728414 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84435b-c590-44e8-b42e-418ad7d50bcf None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:40.728830 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84435b-c590-44e8-b42e-418ad7d50bcf None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:40.728965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84435b-c590-44e8-b42e-418ad7d50bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:40.749961 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-3c84435b-c590-44e8-b42e-418ad7d50bcf None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:40.754228 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-3c84435b-c590-44e8-b42e-418ad7d50bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:40.818365 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 585/1132] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:41.089464 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700f448-f2f4-4601-8924-18e37842db7f None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:41.189432 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700f448-f2f4-4601-8924-18e37842db7f None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:41.223687 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56798a8a-74f1-4c0a-8ceb-4b4b4bed23ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:41.224311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56798a8a-74f1-4c0a-8ceb-4b4b4bed23ef None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:41.224602 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56798a8a-74f1-4c0a-8ceb-4b4b4bed23ef None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:41.224884 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56798a8a-74f1-4c0a-8ceb-4b4b4bed23ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:41.226032 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56798a8a-74f1-4c0a-8ceb-4b4b4bed23ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:41.227472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56798a8a-74f1-4c0a-8ceb-4b4b4bed23ef None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:41.229047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 548/1133] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:03:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:41.235990 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84435b-c590-44e8-b42e-418ad7d50bcf None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:41.333580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84435b-c590-44e8-b42e-418ad7d50bcf None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:41.347342 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:41.367772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e19ffe-56b5-4209-85fb-34c4c1685dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:41.368377 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e19ffe-56b5-4209-85fb-34c4c1685dcb None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:41.368660 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e19ffe-56b5-4209-85fb-34c4c1685dcb None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:41.368934 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e19ffe-56b5-4209-85fb-34c4c1685dcb None admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:41.369592 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e19ffe-56b5-4209-85fb-34c4c1685dcb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:41.371066 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e19ffe-56b5-4209-85fb-34c4c1685dcb None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:41.449791 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 586/1134] 10.222.0.79 () {60 vars in 1141 bytes} [Fri Sep 2 21:03:41 2022] POST /identity/v3/projects => generated 311 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:03:43.391390 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68a92a-03d3-4393-9cd4-5773545abf13 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:43.391925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68a92a-03d3-4393-9cd4-5773545abf13 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:43.391925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68a92a-03d3-4393-9cd4-5773545abf13 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:43.393259 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 549/1135] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:43.398494 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ff7bb-b66c-4bd1-a278-a1c0e2580799 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:43.398910 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ff7bb-b66c-4bd1-a278-a1c0e2580799 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:43.399091 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ff7bb-b66c-4bd1-a278-a1c0e2580799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:43.418668 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-bd6ff7bb-b66c-4bd1-a278-a1c0e2580799 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:43.420543 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-bd6ff7bb-b66c-4bd1-a278-a1c0e2580799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:43.487564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 587/1136] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:43.768563 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68a92a-03d3-4393-9cd4-5773545abf13 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:43.799580 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:43.872182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68a92a-03d3-4393-9cd4-5773545abf13 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:43.906922 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4393bb9-5b66-40bc-baae-af757514fdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:43.907546 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4393bb9-5b66-40bc-baae-af757514fdcd None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:43.907831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4393bb9-5b66-40bc-baae-af757514fdcd None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:43.908108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4393bb9-5b66-40bc-baae-af757514fdcd None admin] PATH_INFO: `/v3/domains/default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:43.909233 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4393bb9-5b66-40bc-baae-af757514fdcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:43.910699 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4393bb9-5b66-40bc-baae-af757514fdcd None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:43.912266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 550/1137] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:03:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:43.918094 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ff7bb-b66c-4bd1-a278-a1c0e2580799 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:44.011033 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:44.018085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ff7bb-b66c-4bd1-a278-a1c0e2580799 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:44.050979 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5dd8b5-0b0f-4342-9053-4f18e3d3b6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:44.051582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dd8b5-0b0f-4342-9053-4f18e3d3b6fc None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:44.051858 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dd8b5-0b0f-4342-9053-4f18e3d3b6fc None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:44.052131 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dd8b5-0b0f-4342-9053-4f18e3d3b6fc None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:44.052773 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5dd8b5-0b0f-4342-9053-4f18e3d3b6fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:44.054247 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5dd8b5-0b0f-4342-9053-4f18e3d3b6fc None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:44.116005 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 588/1138] 10.222.0.79 () {60 vars in 1132 bytes} [Fri Sep 2 21:03:43 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:03:46.147500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d44973-5c08-49f3-ad64-0f602683358e None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:46.148048 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d44973-5c08-49f3-ad64-0f602683358e None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:46.148048 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d44973-5c08-49f3-ad64-0f602683358e None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:46.149297 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 551/1139] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:46.154629 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76f62a-954c-443e-b341-c221b3b7f04c None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:46.155064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76f62a-954c-443e-b341-c221b3b7f04c None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:46.155186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76f62a-954c-443e-b341-c221b3b7f04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:46.173576 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-da76f62a-954c-443e-b341-c221b3b7f04c None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:46.174804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-da76f62a-954c-443e-b341-c221b3b7f04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:46.246485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 589/1140] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:46.562626 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d44973-5c08-49f3-ad64-0f602683358e None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:46.685570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:46.691136 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d44973-5c08-49f3-ad64-0f602683358e None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:46.733164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2effc76-0c68-44a9-9cb4-35d7e4d8f15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:46.733834 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2effc76-0c68-44a9-9cb4-35d7e4d8f15e None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:46.734132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2effc76-0c68-44a9-9cb4-35d7e4d8f15e None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:46.734411 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2effc76-0c68-44a9-9cb4-35d7e4d8f15e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:46.745555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2effc76-0c68-44a9-9cb4-35d7e4d8f15e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:03:46.752892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-e2effc76-0c68-44a9-9cb4-35d7e4d8f15e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:46.752892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:46.752892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:46.752892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:46.752892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:46.752892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:46.752892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:46.752892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:46.752892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:46.752892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:46.752892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:46.752892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:46.752892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:03:46.752892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:03:46.752892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:03:46.752892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:03:46.755508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:03:46.755508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:03:46.755508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:03:46.755508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:03:46.755508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:46.755508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:46.755508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:46.755508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:46.755508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:46.755508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:46.755508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:46.755508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:46.755508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:46.755508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:46.755508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:46.755508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:46.756496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:46.756496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:46.756496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:46.756496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:46.756496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:03:46.756496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:03:46.756496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:03:46.756496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:03:46.756496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:03:46.756496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:03:46.756496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:46.756496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:46.756496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 552/1141] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:03:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:46.761202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76f62a-954c-443e-b341-c221b3b7f04c None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:46.854355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:46.878342 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76f62a-954c-443e-b341-c221b3b7f04c None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:46.916328 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2082941-bbe9-4a73-83ee-60c7f6e491e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:46.916943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2082941-bbe9-4a73-83ee-60c7f6e491e1 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:46.917237 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2082941-bbe9-4a73-83ee-60c7f6e491e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:46.917516 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2082941-bbe9-4a73-83ee-60c7f6e491e1 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:46.918235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2082941-bbe9-4a73-83ee-60c7f6e491e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:46.918544 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2082941-bbe9-4a73-83ee-60c7f6e491e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:46.920475 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2082941-bbe9-4a73-83ee-60c7f6e491e1 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:46.929224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 590/1142] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:03:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:46.936589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2effc76-0c68-44a9-9cb4-35d7e4d8f15e None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:47.055744 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2effc76-0c68-44a9-9cb4-35d7e4d8f15e None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:47.088927 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf53d38-7127-4f0d-bac2-bfa61bd5d8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:47.089550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf53d38-7127-4f0d-bac2-bfa61bd5d8d8 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:47.089845 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf53d38-7127-4f0d-bac2-bfa61bd5d8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:47.090125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf53d38-7127-4f0d-bac2-bfa61bd5d8d8 None admin] PATH_INFO: `/v3/users/4d539e0328b74b88a73c97adc754097d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:47.103944 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf53d38-7127-4f0d-bac2-bfa61bd5d8d8 None admin] RBAC: Authorizing `identity:get_user(user_id=4d539e0328b74b88a73c97adc754097d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:47.105443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf53d38-7127-4f0d-bac2-bfa61bd5d8d8 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:47.107764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 553/1143] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:03:46 2022] GET /identity/v3/users/4d539e0328b74b88a73c97adc754097d => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:47.113792 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2082941-bbe9-4a73-83ee-60c7f6e491e1 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:47.213663 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2082941-bbe9-4a73-83ee-60c7f6e491e1 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:47.247728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd3484-cb36-4031-abb9-1ccffd032b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:47.248331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd3484-cb36-4031-abb9-1ccffd032b1b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:47.248615 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd3484-cb36-4031-abb9-1ccffd032b1b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:47.248885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd3484-cb36-4031-abb9-1ccffd032b1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:47.260711 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:47.319022 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd3484-cb36-4031-abb9-1ccffd032b1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:47.320500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd3484-cb36-4031-abb9-1ccffd032b1b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:47.419795 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 591/1144] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:03:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:03:47.425815 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf53d38-7127-4f0d-bac2-bfa61bd5d8d8 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:47.444129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:47.524796 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf53d38-7127-4f0d-bac2-bfa61bd5d8d8 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:47.559550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4302b-b675-44dc-ba52-5724192e7d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:47.560756 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4302b-b675-44dc-ba52-5724192e7d7a None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:47.561041 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4302b-b675-44dc-ba52-5724192e7d7a None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:47.561316 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4302b-b675-44dc-ba52-5724192e7d7a None admin] PATH_INFO: `/v3/projects/d2f0eca9e4c745d0ac886f03d09d3fa5` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:47.562464 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4302b-b675-44dc-ba52-5724192e7d7a None admin] RBAC: Authorizing `identity:get_project(project_id=d2f0eca9e4c745d0ac886f03d09d3fa5)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:47.563894 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4302b-b675-44dc-ba52-5724192e7d7a None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:47.565659 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 554/1145] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:03:47 2022] GET /identity/v3/projects/d2f0eca9e4c745d0ac886f03d09d3fa5 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:47.572222 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd3484-cb36-4031-abb9-1ccffd032b1b None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:47.615931 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:47.671956 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd3484-cb36-4031-abb9-1ccffd032b1b None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:47.706478 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95635451-04df-4414-90c9-a39d81b9346e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:47.707079 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95635451-04df-4414-90c9-a39d81b9346e None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:47.707356 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95635451-04df-4414-90c9-a39d81b9346e None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:47.707627 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95635451-04df-4414-90c9-a39d81b9346e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:47.708352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95635451-04df-4414-90c9-a39d81b9346e None admin] RBAC: Adding query filter params (role.id=32e6a7f83b444d1ca9e5891a2b175f9a, scope.project.id=d2f0eca9e4c745d0ac886f03d09d3fa5, user.id=4d539e0328b74b88a73c97adc754097d) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:47.708659 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95635451-04df-4414-90c9-a39d81b9346e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:47.710148 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95635451-04df-4414-90c9-a39d81b9346e None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:47.715549 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 592/1146] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:03:47 2022] GET /identity/v3/role_assignments?user.id=4d539e0328b74b88a73c97adc754097d&scope.project.id=d2f0eca9e4c745d0ac886f03d09d3fa5&role.id=32e6a7f83b444d1ca9e5891a2b175f9a => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:49.595049 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87382ec8-4d02-4e35-b305-cb77963e1b60 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:49.595591 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87382ec8-4d02-4e35-b305-cb77963e1b60 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:49.595591 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87382ec8-4d02-4e35-b305-cb77963e1b60 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:49.596916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 555/1147] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:49.602265 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b791e9-f217-457f-bd9e-f4ba43a24564 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:49.602670 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b791e9-f217-457f-bd9e-f4ba43a24564 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:49.602819 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b791e9-f217-457f-bd9e-f4ba43a24564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:49.620771 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-66b791e9-f217-457f-bd9e-f4ba43a24564 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:49.622009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-66b791e9-f217-457f-bd9e-f4ba43a24564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:49.688498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 593/1148] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:49.962773 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87382ec8-4d02-4e35-b305-cb77963e1b60 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:50.047886 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:50.064088 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87382ec8-4d02-4e35-b305-cb77963e1b60 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:50.098396 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b5a76-54de-4286-9819-bee1d727b1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:50.099016 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b5a76-54de-4286-9819-bee1d727b1af None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:50.099293 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b5a76-54de-4286-9819-bee1d727b1af None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:50.099565 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b5a76-54de-4286-9819-bee1d727b1af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:50.110086 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b5a76-54de-4286-9819-bee1d727b1af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:03:50.114783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-5f1b5a76-54de-4286-9819-bee1d727b1af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:50.114783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:50.114783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:50.114783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:50.114783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:50.114783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:50.114783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:50.114783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:50.114783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:50.114783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:50.114783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:50.114783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:50.114783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:03:50.114783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:03:50.114783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:03:50.114783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:03:50.116152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:03:50.116152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:03:50.116152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:03:50.116152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:03:50.116152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:50.116152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:50.116152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:50.116152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:50.116152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:50.116152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:50.116152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:50.116152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:50.116152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:50.116152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:50.116152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:50.116152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:50.117227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:50.117227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:50.117227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:50.117227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:50.117227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:03:50.117227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:03:50.117227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:03:50.117227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:03:50.117227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:03:50.117227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:03:50.117227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:50.117227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:50.117227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 556/1149] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:03:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:50.122199 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b791e9-f217-457f-bd9e-f4ba43a24564 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:50.156405 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:50.222750 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b791e9-f217-457f-bd9e-f4ba43a24564 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:50.257561 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255d63f-f23c-4141-8144-fb6e5041cc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:50.258194 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255d63f-f23c-4141-8144-fb6e5041cc3c None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:50.258472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255d63f-f23c-4141-8144-fb6e5041cc3c None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:50.258744 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255d63f-f23c-4141-8144-fb6e5041cc3c None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:50.259405 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255d63f-f23c-4141-8144-fb6e5041cc3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:50.259705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255d63f-f23c-4141-8144-fb6e5041cc3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:50.261069 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255d63f-f23c-4141-8144-fb6e5041cc3c None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:50.270394 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 594/1150] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:03:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:50.276323 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b5a76-54de-4286-9819-bee1d727b1af None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:50.388527 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b5a76-54de-4286-9819-bee1d727b1af None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:50.426971 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd63af3-7a9b-44a3-9f89-ad2a7633279c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:50.427597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd63af3-7a9b-44a3-9f89-ad2a7633279c None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:50.427881 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd63af3-7a9b-44a3-9f89-ad2a7633279c None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:50.428157 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd63af3-7a9b-44a3-9f89-ad2a7633279c None admin] PATH_INFO: `/v3/users/4d539e0328b74b88a73c97adc754097d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:50.429305 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd63af3-7a9b-44a3-9f89-ad2a7633279c None admin] RBAC: Authorizing `identity:get_user(user_id=4d539e0328b74b88a73c97adc754097d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:50.430768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd63af3-7a9b-44a3-9f89-ad2a7633279c None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:50.432347 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 557/1151] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:03:50 2022] GET /identity/v3/users/4d539e0328b74b88a73c97adc754097d => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:50.439302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255d63f-f23c-4141-8144-fb6e5041cc3c None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:50.540365 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:50.544073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255d63f-f23c-4141-8144-fb6e5041cc3c None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:50.577957 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fd310-caa9-410c-bb40-a3b1751d7bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:50.578654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fd310-caa9-410c-bb40-a3b1751d7bf0 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:50.578937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fd310-caa9-410c-bb40-a3b1751d7bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:50.579210 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fd310-caa9-410c-bb40-a3b1751d7bf0 None admin] PATH_INFO: `/v3/projects/d2f0eca9e4c745d0ac886f03d09d3fa5` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:50.580344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fd310-caa9-410c-bb40-a3b1751d7bf0 None admin] RBAC: Authorizing `identity:get_project(project_id=d2f0eca9e4c745d0ac886f03d09d3fa5)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:50.581775 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fd310-caa9-410c-bb40-a3b1751d7bf0 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:50.583416 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 595/1152] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:03:50 2022] GET /identity/v3/projects/d2f0eca9e4c745d0ac886f03d09d3fa5 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:50.589419 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd63af3-7a9b-44a3-9f89-ad2a7633279c None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:50.604697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:50.697774 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd63af3-7a9b-44a3-9f89-ad2a7633279c None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:50.733628 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172dc027-d652-4861-ba8a-0acc6eed748f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:50.734304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dc027-d652-4861-ba8a-0acc6eed748f None admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:50.734585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dc027-d652-4861-ba8a-0acc6eed748f None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:50.734864 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dc027-d652-4861-ba8a-0acc6eed748f None admin] PATH_INFO: `/v3/projects/d2f0eca9e4c745d0ac886f03d09d3fa5/users/4d539e0328b74b88a73c97adc754097d/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:50.736763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172dc027-d652-4861-ba8a-0acc6eed748f None admin] RBAC: Authorizing `identity:create_grant(project_id=d2f0eca9e4c745d0ac886f03d09d3fa5, user_id=4d539e0328b74b88a73c97adc754097d, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:50.738225 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172dc027-d652-4861-ba8a-0acc6eed748f None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:50.814619 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 558/1153] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:03:50 2022] PUT /identity/v3/projects/d2f0eca9e4c745d0ac886f03d09d3fa5/users/4d539e0328b74b88a73c97adc754097d/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:03:52.724839 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390927f-b911-4f13-a76c-966746c46cca None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:52.725335 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390927f-b911-4f13-a76c-966746c46cca None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:52.725453 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390927f-b911-4f13-a76c-966746c46cca None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:52.726741 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 596/1154] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:52.732416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e42b3-55ac-41fc-a3ba-476513282f96 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:52.732832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e42b3-55ac-41fc-a3ba-476513282f96 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:52.732969 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e42b3-55ac-41fc-a3ba-476513282f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:52.751082 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-583e42b3-55ac-41fc-a3ba-476513282f96 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:52.752269 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-583e42b3-55ac-41fc-a3ba-476513282f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:52.819998 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 559/1155] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:53.098288 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390927f-b911-4f13-a76c-966746c46cca None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:53.198788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390927f-b911-4f13-a76c-966746c46cca None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:53.231519 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72be550-9089-479d-9c3a-29000c11d247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:53.232131 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72be550-9089-479d-9c3a-29000c11d247 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:53.232413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72be550-9089-479d-9c3a-29000c11d247 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:53.232681 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72be550-9089-479d-9c3a-29000c11d247 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:53.243030 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72be550-9089-479d-9c3a-29000c11d247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:03:53.248240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-a72be550-9089-479d-9c3a-29000c11d247 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:53.248240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:53.248240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:53.248240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:53.248240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:53.248240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:53.248240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:53.248240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:53.248240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:53.248240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:53.248240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:53.248240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:53.248240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:03:53.248240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:03:53.248240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:03:53.248240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:03:53.249344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:03:53.249344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:03:53.249344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:03:53.249344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:03:53.249344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:53.249344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:53.249344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:53.249344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:53.249344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:53.249344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:53.249344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:53.249344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:53.249344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:53.249344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:53.249344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:53.249344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:53.250223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:53.250223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:53.250223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:53.250223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:53.250223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:03:53.250223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:03:53.250223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:03:53.250223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:03:53.250223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:03:53.250223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:03:53.250223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:03:53.250223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:03:53.250223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 597/1156] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:03:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:53.255624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e42b3-55ac-41fc-a3ba-476513282f96 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:53.257910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:53.357920 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e42b3-55ac-41fc-a3ba-476513282f96 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:53.398463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df719dbe-69ae-4794-98e3-03b2f80edb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:53.399081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df719dbe-69ae-4794-98e3-03b2f80edb96 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:53.399367 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df719dbe-69ae-4794-98e3-03b2f80edb96 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:53.399646 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df719dbe-69ae-4794-98e3-03b2f80edb96 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:53.400328 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df719dbe-69ae-4794-98e3-03b2f80edb96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:53.400638 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df719dbe-69ae-4794-98e3-03b2f80edb96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:53.402039 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df719dbe-69ae-4794-98e3-03b2f80edb96 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:53.410616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 560/1157] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:03:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:53.416511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72be550-9089-479d-9c3a-29000c11d247 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:53.445107 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:53.517081 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72be550-9089-479d-9c3a-29000c11d247 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:53.550045 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726cb59-de16-4565-ae41-13ae21dd7603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:53.550671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726cb59-de16-4565-ae41-13ae21dd7603 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:53.550973 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726cb59-de16-4565-ae41-13ae21dd7603 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:53.551233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726cb59-de16-4565-ae41-13ae21dd7603 None admin] PATH_INFO: `/v3/users/4d539e0328b74b88a73c97adc754097d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:53.552351 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726cb59-de16-4565-ae41-13ae21dd7603 None admin] RBAC: Authorizing `identity:get_user(user_id=4d539e0328b74b88a73c97adc754097d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:53.553786 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726cb59-de16-4565-ae41-13ae21dd7603 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:53.555397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 598/1158] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:03:53 2022] GET /identity/v3/users/4d539e0328b74b88a73c97adc754097d => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:53.561872 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df719dbe-69ae-4794-98e3-03b2f80edb96 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:53.626725 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:53.661669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df719dbe-69ae-4794-98e3-03b2f80edb96 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:53.694980 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a28e8f-90fa-4e07-ad30-4ba87f699f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:53.695650 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a28e8f-90fa-4e07-ad30-4ba87f699f9f None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:53.695866 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a28e8f-90fa-4e07-ad30-4ba87f699f9f None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:53.696141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a28e8f-90fa-4e07-ad30-4ba87f699f9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:53.762091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a28e8f-90fa-4e07-ad30-4ba87f699f9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:53.764162 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a28e8f-90fa-4e07-ad30-4ba87f699f9f None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:53.822860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:53.865774 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 561/1159] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:03:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:03:53.871990 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726cb59-de16-4565-ae41-13ae21dd7603 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:53.966746 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:53.973085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726cb59-de16-4565-ae41-13ae21dd7603 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:54.006676 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3e6a0-580e-49cb-8d2d-c44b5ca9e9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:54.007297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3e6a0-580e-49cb-8d2d-c44b5ca9e9ea None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:54.007585 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3e6a0-580e-49cb-8d2d-c44b5ca9e9ea None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:54.007865 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3e6a0-580e-49cb-8d2d-c44b5ca9e9ea None admin] PATH_INFO: `/v3/projects/d2f0eca9e4c745d0ac886f03d09d3fa5` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:54.008985 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3e6a0-580e-49cb-8d2d-c44b5ca9e9ea None admin] RBAC: Authorizing `identity:get_project(project_id=d2f0eca9e4c745d0ac886f03d09d3fa5)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:54.010459 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3e6a0-580e-49cb-8d2d-c44b5ca9e9ea None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:54.012084 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 599/1160] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:03:53 2022] GET /identity/v3/projects/d2f0eca9e4c745d0ac886f03d09d3fa5 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:54.018627 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a28e8f-90fa-4e07-ad30-4ba87f699f9f None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:54.116880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a28e8f-90fa-4e07-ad30-4ba87f699f9f None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:54.151320 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ed449-ddd8-4f7e-8425-63fad90ed0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:54.151917 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ed449-ddd8-4f7e-8425-63fad90ed0a2 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:54.152194 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ed449-ddd8-4f7e-8425-63fad90ed0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:54.152466 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ed449-ddd8-4f7e-8425-63fad90ed0a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:54.153328 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ed449-ddd8-4f7e-8425-63fad90ed0a2 None admin] RBAC: Adding query filter params (role.id=32e6a7f83b444d1ca9e5891a2b175f9a, scope.project.id=d2f0eca9e4c745d0ac886f03d09d3fa5, user.id=4d539e0328b74b88a73c97adc754097d) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:54.153640 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ed449-ddd8-4f7e-8425-63fad90ed0a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:54.155174 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ed449-ddd8-4f7e-8425-63fad90ed0a2 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:54.160844 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 562/1161] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:03:54 2022] GET /identity/v3/role_assignments?user.id=4d539e0328b74b88a73c97adc754097d&scope.project.id=d2f0eca9e4c745d0ac886f03d09d3fa5&role.id=32e6a7f83b444d1ca9e5891a2b175f9a => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:03:56.115131 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b425307-fbb1-4243-bce5-4c45bd8b4985 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:56.115660 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b425307-fbb1-4243-bce5-4c45bd8b4985 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:56.115660 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b425307-fbb1-4243-bce5-4c45bd8b4985 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:56.116946 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 600/1162] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:56.122737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d780d56-3352-4b48-bfe0-0bbf579eac73 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:56.123140 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d780d56-3352-4b48-bfe0-0bbf579eac73 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:56.123279 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d780d56-3352-4b48-bfe0-0bbf579eac73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:56.141939 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-2d780d56-3352-4b48-bfe0-0bbf579eac73 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:56.143117 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-2d780d56-3352-4b48-bfe0-0bbf579eac73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:56.165471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:56.209801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 563/1163] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:56.485896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b425307-fbb1-4243-bce5-4c45bd8b4985 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:56.587620 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b425307-fbb1-4243-bce5-4c45bd8b4985 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:56.621534 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8acf98-12d8-45ab-86e8-fc6ee627236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:56.622342 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8acf98-12d8-45ab-86e8-fc6ee627236f None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:56.622682 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8acf98-12d8-45ab-86e8-fc6ee627236f None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:56.622998 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8acf98-12d8-45ab-86e8-fc6ee627236f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:56.652207 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:56.691925 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8acf98-12d8-45ab-86e8-fc6ee627236f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:56.693416 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8acf98-12d8-45ab-86e8-fc6ee627236f None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:56.800503 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 601/1164] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:03:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:03:56.806420 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d780d56-3352-4b48-bfe0-0bbf579eac73 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:56.904286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d780d56-3352-4b48-bfe0-0bbf579eac73 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:56.938198 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375595d8-6bbb-4d4f-a748-b66817db6536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:56.938831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375595d8-6bbb-4d4f-a748-b66817db6536 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:56.939117 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375595d8-6bbb-4d4f-a748-b66817db6536 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:56.939397 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375595d8-6bbb-4d4f-a748-b66817db6536 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:56.946435 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375595d8-6bbb-4d4f-a748-b66817db6536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:56.947865 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375595d8-6bbb-4d4f-a748-b66817db6536 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:56.959472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-375595d8-6bbb-4d4f-a748-b66817db6536 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 02 21:03:56.959472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:56.959472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 02 21:03:56.959472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 02 21:03:56.959472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:03:56.959472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:03:56.959472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:03:56.959472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:03:56.959472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 02 21:03:56.959472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:56.959472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:03:56.959472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:56.959472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:03:56.959472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:03:56.959472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:03:56.959472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:03:56.959472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:03:56.960577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:03:56.960577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:03:56.960577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:03:56.960577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:03:56.960577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:03:56.960577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:03:56.960577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:03:56.960577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:03:56.960577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:03:56.960577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:03:56.960577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:03:56.960577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:03:56.960577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:03:56.960577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:03:56.960577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:03:56.960577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:03:56.961552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:03:56.961552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:03:56.961552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:03:56.961552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:03:56.961552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:03:56.961552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:03:56.961552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:03:56.961552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:03:56.961552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:03:56.961552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:03:56.961552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 02 21:03:56.961552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:03:56.961552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 02 21:03:56.961552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:03:56.961552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 564/1165] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Sep 2 21:03:56 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:03:56.967379 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8acf98-12d8-45ab-86e8-fc6ee627236f None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:57.026743 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:57.064754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8acf98-12d8-45ab-86e8-fc6ee627236f None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:57.099383 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a9aa0-6cb8-41ed-be16-f8ccb94aeb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:57.099987 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a9aa0-6cb8-41ed-be16-f8ccb94aeb4b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:57.100269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a9aa0-6cb8-41ed-be16-f8ccb94aeb4b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:57.100542 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a9aa0-6cb8-41ed-be16-f8ccb94aeb4b None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:57.101183 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a9aa0-6cb8-41ed-be16-f8ccb94aeb4b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:03:57.101499 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a9aa0-6cb8-41ed-be16-f8ccb94aeb4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:57.102901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a9aa0-6cb8-41ed-be16-f8ccb94aeb4b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:57.109956 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 602/1166] 10.222.0.79 () {56 vars in 1115 bytes} [Fri Sep 2 21:03:56 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:03:59.029304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c4fe2-03ec-43d6-b243-927c6ad40825 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:59.029848 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c4fe2-03ec-43d6-b243-927c6ad40825 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:59.029848 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c4fe2-03ec-43d6-b243-927c6ad40825 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:59.031135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 565/1167] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:03:59.036257 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bae83a-9f21-4dd4-88d1-9724d20f8657 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:59.036675 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bae83a-9f21-4dd4-88d1-9724d20f8657 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:59.036817 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bae83a-9f21-4dd4-88d1-9724d20f8657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:59.055372 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-18bae83a-9f21-4dd4-88d1-9724d20f8657 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:03:59.056545 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-18bae83a-9f21-4dd4-88d1-9724d20f8657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:03:59.121715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 603/1168] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:03:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:03:59.389412 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c4fe2-03ec-43d6-b243-927c6ad40825 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:03:59.409632 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:03:59.491305 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c4fe2-03ec-43d6-b243-927c6ad40825 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:03:59.524630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69aed2e-7077-4071-bf8c-bb442750086c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:03:59.525229 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aed2e-7077-4071-bf8c-bb442750086c None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:03:59.525507 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aed2e-7077-4071-bf8c-bb442750086c None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:03:59.525778 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aed2e-7077-4071-bf8c-bb442750086c None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:03:59.526481 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69aed2e-7077-4071-bf8c-bb442750086c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:03:59.528521 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69aed2e-7077-4071-bf8c-bb442750086c None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:03:59.626584 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 566/1169] 10.222.0.79 () {60 vars in 1138 bytes} [Fri Sep 2 21:03:59 2022] POST /identity/v3/domains => generated 267 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:04:01.585555 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d357a-81d2-4ca9-95e4-76da0f3088ae None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:01.586118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d357a-81d2-4ca9-95e4-76da0f3088ae None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:01.586118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d357a-81d2-4ca9-95e4-76da0f3088ae None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:01.587495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 604/1170] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:04:01.592689 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3327c8-4df1-4c5a-b924-d7b5c1cfc9a3 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:01.593142 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3327c8-4df1-4c5a-b924-d7b5c1cfc9a3 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:01.593235 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3327c8-4df1-4c5a-b924-d7b5c1cfc9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:01.611830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-2f3327c8-4df1-4c5a-b924-d7b5c1cfc9a3 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:04:01.613127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-2f3327c8-4df1-4c5a-b924-d7b5c1cfc9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:04:01.681499 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 567/1171] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:04:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:04:01.965973 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d357a-81d2-4ca9-95e4-76da0f3088ae None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:04:02.023377 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:04:02.068812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d357a-81d2-4ca9-95e4-76da0f3088ae None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:04:02.108116 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7c5f3-bb13-48e5-9f37-c09f662a90b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:04:02.108734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7c5f3-bb13-48e5-9f37-c09f662a90b1 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:02.109015 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7c5f3-bb13-48e5-9f37-c09f662a90b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:02.109285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7c5f3-bb13-48e5-9f37-c09f662a90b1 None admin] PATH_INFO: `/v3/domains/f29c92ee190042eda864bf92cf60ea1a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:02.119437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7c5f3-bb13-48e5-9f37-c09f662a90b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f29c92ee190042eda864bf92cf60ea1a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:04:02.120878 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7c5f3-bb13-48e5-9f37-c09f662a90b1 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:04:02.123231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 605/1172] 10.222.0.79 () {56 vars in 1183 bytes} [Fri Sep 2 21:04:01 2022] GET /identity/v3/domains/f29c92ee190042eda864bf92cf60ea1a => generated 267 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:04:02.129327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3327c8-4df1-4c5a-b924-d7b5c1cfc9a3 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:04:02.140422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:04:02.231662 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3327c8-4df1-4c5a-b924-d7b5c1cfc9a3 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:04:02.266119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11734605-6e44-408d-8d9d-484db16f14d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:04:02.266722 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11734605-6e44-408d-8d9d-484db16f14d4 None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:02.267006 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11734605-6e44-408d-8d9d-484db16f14d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:02.267284 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11734605-6e44-408d-8d9d-484db16f14d4 None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:02.267934 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11734605-6e44-408d-8d9d-484db16f14d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:04:02.269398 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11734605-6e44-408d-8d9d-484db16f14d4 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:04:02.420738 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 568/1173] 10.222.0.79 () {60 vars in 1141 bytes} [Fri Sep 2 21:04:02 2022] POST /identity/v3/projects => generated 361 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:04:04.375746 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdf868-843b-41da-aaf7-f2cb602fecdb None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:04.376368 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdf868-843b-41da-aaf7-f2cb602fecdb None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:04.376368 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdf868-843b-41da-aaf7-f2cb602fecdb None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:04.377661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 606/1174] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:04:04.383311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb35845-d988-470d-8169-00f73c96a33c None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:04.383754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb35845-d988-470d-8169-00f73c96a33c None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:04.383928 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb35845-d988-470d-8169-00f73c96a33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:04.403253 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-5cb35845-d988-470d-8169-00f73c96a33c None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:04:04.404440 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-5cb35845-d988-470d-8169-00f73c96a33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:04:04.462004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:04:04.475544 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 569/1175] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:04:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:04:04.760174 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cdf868-843b-41da-aaf7-f2cb602fecdb None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:04:04.863063 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cdf868-843b-41da-aaf7-f2cb602fecdb None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:04:04.879030 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:04:04.897107 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff50c38-5016-47bf-9466-c191e237acb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:04:04.897736 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff50c38-5016-47bf-9466-c191e237acb7 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:04.898049 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff50c38-5016-47bf-9466-c191e237acb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:04.898331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff50c38-5016-47bf-9466-c191e237acb7 None admin] PATH_INFO: `/v3/domains/f29c92ee190042eda864bf92cf60ea1a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:04.899434 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff50c38-5016-47bf-9466-c191e237acb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f29c92ee190042eda864bf92cf60ea1a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:04:04.900867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff50c38-5016-47bf-9466-c191e237acb7 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:04:04.903240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 607/1176] 10.222.0.79 () {56 vars in 1183 bytes} [Fri Sep 2 21:04:04 2022] GET /identity/v3/domains/f29c92ee190042eda864bf92cf60ea1a => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:04:04.909131 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb35845-d988-470d-8169-00f73c96a33c None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:04:05.014944 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb35845-d988-470d-8169-00f73c96a33c None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:04:05.049274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611db0e-e7f8-43ff-b973-192c25803bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:04:05.049900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611db0e-e7f8-43ff-b973-192c25803bc0 None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:05.050182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611db0e-e7f8-43ff-b973-192c25803bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:05.051739 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611db0e-e7f8-43ff-b973-192c25803bc0 None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:05.051739 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611db0e-e7f8-43ff-b973-192c25803bc0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:04:05.052669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611db0e-e7f8-43ff-b973-192c25803bc0 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:04:05.310953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 570/1177] 10.222.0.79 () {60 vars in 1132 bytes} [Fri Sep 2 21:04:04 2022] POST /identity/v3/users => generated 311 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:04:07.295043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fa2dd-205f-4780-8fe1-acb7ee56a5bf None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:07.295583 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fa2dd-205f-4780-8fe1-acb7ee56a5bf None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:07.295583 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fa2dd-205f-4780-8fe1-acb7ee56a5bf None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:07.296945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 608/1178] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:04:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:04:07.302304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324f39a-32e1-4b3c-b3a6-b32c6156ba63 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:07.302767 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324f39a-32e1-4b3c-b3a6-b32c6156ba63 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:07.302859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324f39a-32e1-4b3c-b3a6-b32c6156ba63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:07.321321 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-f324f39a-32e1-4b3c-b3a6-b32c6156ba63 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:04:07.322547 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f324f39a-32e1-4b3c-b3a6-b32c6156ba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:04:07.365958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:04:07.393707 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 571/1179] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:04:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:04:07.666923 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fa2dd-205f-4780-8fe1-acb7ee56a5bf None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:04:07.771182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fa2dd-205f-4780-8fe1-acb7ee56a5bf None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:04:07.867659 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b621966-2545-4603-998b-0bb37d26db38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:04:07.868291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b621966-2545-4603-998b-0bb37d26db38 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:07.868575 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b621966-2545-4603-998b-0bb37d26db38 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:07.868853 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b621966-2545-4603-998b-0bb37d26db38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:07.880689 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b621966-2545-4603-998b-0bb37d26db38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:04:07.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-2b621966-2545-4603-998b-0bb37d26db38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:04:07.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:04:07.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:04:07.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:04:07.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:04:07.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:04:07.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:04:07.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:04:07.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:04:07.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:04:07.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:04:07.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:04:07.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:04:07.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:04:07.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:04:07.885465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:04:07.886779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:04:07.886779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:04:07.886779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:04:07.886779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:04:07.886779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:04:07.886779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:04:07.886779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:04:07.886779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:04:07.886779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:04:07.886779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:04:07.886779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:04:07.886779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:04:07.886779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:04:07.886779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:04:07.886779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:04:07.886779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:04:07.887633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:04:07.887633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:04:07.887633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:04:07.887633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:04:07.887633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:04:07.887633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:04:07.887633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:04:07.887633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:04:07.887633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:04:07.887633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:04:07.887633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:04:07.887633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:04:07.887633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 609/1180] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:04:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:04:07.892930 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324f39a-32e1-4b3c-b3a6-b32c6156ba63 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:04:07.996089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324f39a-32e1-4b3c-b3a6-b32c6156ba63 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:04:08.036090 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34428111-f021-4307-9dc8-f442a47b3dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:04:08.036694 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34428111-f021-4307-9dc8-f442a47b3dae None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:08.036983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34428111-f021-4307-9dc8-f442a47b3dae None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:08.037262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34428111-f021-4307-9dc8-f442a47b3dae None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:08.037969 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34428111-f021-4307-9dc8-f442a47b3dae None admin] RBAC: Adding query filter params (name=admin) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:04:08.038283 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34428111-f021-4307-9dc8-f442a47b3dae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:04:08.039661 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34428111-f021-4307-9dc8-f442a47b3dae None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:04:08.048481 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 572/1181] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:04:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:04:08.054363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b621966-2545-4603-998b-0bb37d26db38 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:04:08.100070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:04:08.156212 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b621966-2545-4603-998b-0bb37d26db38 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:04:08.190126 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba035e2-2090-4a26-ab67-b1a57299bdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:04:08.190756 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba035e2-2090-4a26-ab67-b1a57299bdd2 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:08.191040 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba035e2-2090-4a26-ab67-b1a57299bdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:08.191317 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba035e2-2090-4a26-ab67-b1a57299bdd2 None admin] PATH_INFO: `/v3/users/1c30afd57a2a477b85561e77a9faa3f8` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:08.204637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba035e2-2090-4a26-ab67-b1a57299bdd2 None admin] RBAC: Authorizing `identity:get_user(user_id=1c30afd57a2a477b85561e77a9faa3f8)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:04:08.206115 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba035e2-2090-4a26-ab67-b1a57299bdd2 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:04:08.207748 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 610/1182] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:04:08 2022] GET /identity/v3/users/1c30afd57a2a477b85561e77a9faa3f8 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:04:08.214033 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34428111-f021-4307-9dc8-f442a47b3dae None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:04:08.260161 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:04:08.341163 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34428111-f021-4307-9dc8-f442a47b3dae None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:04:08.388315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35e9f4-cea4-4b88-932f-593edca7ac08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:04:08.389139 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35e9f4-cea4-4b88-932f-593edca7ac08 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:08.389553 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35e9f4-cea4-4b88-932f-593edca7ac08 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:08.389977 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35e9f4-cea4-4b88-932f-593edca7ac08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:08.467567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35e9f4-cea4-4b88-932f-593edca7ac08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:04:08.469016 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35e9f4-cea4-4b88-932f-593edca7ac08 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:04:08.506145 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:04:08.569260 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 573/1183] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:04:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:04:08.575654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba035e2-2090-4a26-ab67-b1a57299bdd2 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:04:08.684589 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba035e2-2090-4a26-ab67-b1a57299bdd2 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:04:08.686322 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:04:08.721059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b988f47-dd0b-4d87-97b8-a5e0c7716166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:04:08.721688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b988f47-dd0b-4d87-97b8-a5e0c7716166 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:08.722000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b988f47-dd0b-4d87-97b8-a5e0c7716166 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:08.722274 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b988f47-dd0b-4d87-97b8-a5e0c7716166 None admin] PATH_INFO: `/v3/projects/7cb710a39ba7401c93e09c3594080ece` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:08.723393 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b988f47-dd0b-4d87-97b8-a5e0c7716166 None admin] RBAC: Authorizing `identity:get_project(project_id=7cb710a39ba7401c93e09c3594080ece)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:04:08.724823 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b988f47-dd0b-4d87-97b8-a5e0c7716166 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:04:08.726484 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 611/1184] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:04:08 2022] GET /identity/v3/projects/7cb710a39ba7401c93e09c3594080ece => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:04:08.733230 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35e9f4-cea4-4b88-932f-593edca7ac08 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:04:08.832748 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35e9f4-cea4-4b88-932f-593edca7ac08 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:04:08.869094 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c27d13-ee45-4caf-b788-789c7dab2d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:04:08.869690 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c27d13-ee45-4caf-b788-789c7dab2d92 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:08.870004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c27d13-ee45-4caf-b788-789c7dab2d92 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:08.870282 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c27d13-ee45-4caf-b788-789c7dab2d92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:08.871387 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c27d13-ee45-4caf-b788-789c7dab2d92 None admin] RBAC: Adding query filter params (role.id=32e6a7f83b444d1ca9e5891a2b175f9a, scope.project.id=7cb710a39ba7401c93e09c3594080ece, user.id=1c30afd57a2a477b85561e77a9faa3f8) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:04:08.871699 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c27d13-ee45-4caf-b788-789c7dab2d92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:04:08.873116 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c27d13-ee45-4caf-b788-789c7dab2d92 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:04:08.878508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 574/1185] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:04:08 2022] GET /identity/v3/role_assignments?user.id=1c30afd57a2a477b85561e77a9faa3f8&scope.project.id=7cb710a39ba7401c93e09c3594080ece&role.id=32e6a7f83b444d1ca9e5891a2b175f9a => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:04:10.815150 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d42c61-d95d-46f0-aa1f-2d1abddb82cf None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:10.815713 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d42c61-d95d-46f0-aa1f-2d1abddb82cf None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:10.815713 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d42c61-d95d-46f0-aa1f-2d1abddb82cf None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:10.817038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 612/1186] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:04:10.822154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f286c-f0a1-4cd9-b7f5-f581a73da0b3 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:10.822597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f286c-f0a1-4cd9-b7f5-f581a73da0b3 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:10.822709 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f286c-f0a1-4cd9-b7f5-f581a73da0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:10.829744 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:04:10.842788 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-f92f286c-f0a1-4cd9-b7f5-f581a73da0b3 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:04:10.843973 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f92f286c-f0a1-4cd9-b7f5-f581a73da0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:04:10.910831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 575/1187] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:04:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:04:11.179781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d42c61-d95d-46f0-aa1f-2d1abddb82cf None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:04:11.282144 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d42c61-d95d-46f0-aa1f-2d1abddb82cf None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:04:11.319819 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340ee0d-b594-43d3-9477-6c589b8aa5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:04:11.320454 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340ee0d-b594-43d3-9477-6c589b8aa5d4 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:11.320744 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340ee0d-b594-43d3-9477-6c589b8aa5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:11.321019 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340ee0d-b594-43d3-9477-6c589b8aa5d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:11.333847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340ee0d-b594-43d3-9477-6c589b8aa5d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:04:11.338725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-7340ee0d-b594-43d3-9477-6c589b8aa5d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:04:11.338725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:04:11.338725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:04:11.338725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:04:11.338725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:04:11.338725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:04:11.338725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:04:11.338725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:04:11.338725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:04:11.338725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:04:11.338725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:04:11.338725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:04:11.338725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:04:11.338725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:04:11.338725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:04:11.338725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:04:11.341244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:04:11.341244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:04:11.341244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:04:11.341244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:04:11.341244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:04:11.341244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:04:11.341244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:04:11.341244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:04:11.341244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:04:11.341244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:04:11.341244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:04:11.341244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:04:11.341244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:04:11.341244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:04:11.341244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:04:11.341244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:04:11.342999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:04:11.342999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:04:11.342999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:04:11.342999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:04:11.342999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:04:11.342999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:04:11.342999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:04:11.342999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:04:11.342999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:04:11.342999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:04:11.342999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:04:11.342999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:04:11.342999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 613/1188] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:04:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:04:11.349070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f286c-f0a1-4cd9-b7f5-f581a73da0b3 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:04:11.455579 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f286c-f0a1-4cd9-b7f5-f581a73da0b3 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:04:11.487209 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:04:11.494455 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504658c0-c2d3-42ee-818f-22976120ccf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:04:11.495495 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504658c0-c2d3-42ee-818f-22976120ccf5 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:11.496188 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504658c0-c2d3-42ee-818f-22976120ccf5 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:11.496659 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504658c0-c2d3-42ee-818f-22976120ccf5 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:11.497774 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504658c0-c2d3-42ee-818f-22976120ccf5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:04:11.498296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504658c0-c2d3-42ee-818f-22976120ccf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:04:11.505699 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504658c0-c2d3-42ee-818f-22976120ccf5 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:04:11.510656 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 576/1189] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:04:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:04:11.518001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340ee0d-b594-43d3-9477-6c589b8aa5d4 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:04:11.549905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:04:11.619486 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340ee0d-b594-43d3-9477-6c589b8aa5d4 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:04:11.656007 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1a343-0922-4d72-9818-93b04da95d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:04:11.656637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1a343-0922-4d72-9818-93b04da95d7f None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:11.656986 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1a343-0922-4d72-9818-93b04da95d7f None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:11.657264 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1a343-0922-4d72-9818-93b04da95d7f None admin] PATH_INFO: `/v3/users/1c30afd57a2a477b85561e77a9faa3f8` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:11.658446 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1a343-0922-4d72-9818-93b04da95d7f None admin] RBAC: Authorizing `identity:get_user(user_id=1c30afd57a2a477b85561e77a9faa3f8)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:04:11.659900 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1a343-0922-4d72-9818-93b04da95d7f None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:04:11.661519 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 614/1190] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:04:11 2022] GET /identity/v3/users/1c30afd57a2a477b85561e77a9faa3f8 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:04:11.667471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504658c0-c2d3-42ee-818f-22976120ccf5 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:04:11.772650 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504658c0-c2d3-42ee-818f-22976120ccf5 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:04:11.807206 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e71c9-d861-4ee3-916a-bb2e5618c4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:04:11.807860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e71c9-d861-4ee3-916a-bb2e5618c4fd None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:11.808159 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e71c9-d861-4ee3-916a-bb2e5618c4fd None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:11.808494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e71c9-d861-4ee3-916a-bb2e5618c4fd None admin] PATH_INFO: `/v3/projects/7cb710a39ba7401c93e09c3594080ece` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:11.809616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e71c9-d861-4ee3-916a-bb2e5618c4fd None admin] RBAC: Authorizing `identity:get_project(project_id=7cb710a39ba7401c93e09c3594080ece)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:04:11.811176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e71c9-d861-4ee3-916a-bb2e5618c4fd None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:04:11.812949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 577/1191] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:04:11 2022] GET /identity/v3/projects/7cb710a39ba7401c93e09c3594080ece => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:04:11.819099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1a343-0922-4d72-9818-93b04da95d7f None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:04:11.919310 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:04:11.923115 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1a343-0922-4d72-9818-93b04da95d7f None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:04:11.958667 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf83bc-e579-4a66-acc1-ea4c772021a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:04:11.959317 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf83bc-e579-4a66-acc1-ea4c772021a1 None admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:11.959603 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf83bc-e579-4a66-acc1-ea4c772021a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:11.959973 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf83bc-e579-4a66-acc1-ea4c772021a1 None admin] PATH_INFO: `/v3/projects/7cb710a39ba7401c93e09c3594080ece/users/1c30afd57a2a477b85561e77a9faa3f8/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:11.962104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf83bc-e579-4a66-acc1-ea4c772021a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cb710a39ba7401c93e09c3594080ece, user_id=1c30afd57a2a477b85561e77a9faa3f8, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:04:11.963891 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf83bc-e579-4a66-acc1-ea4c772021a1 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:04:12.024148 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 615/1192] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:04:11 2022] PUT /identity/v3/projects/7cb710a39ba7401c93e09c3594080ece/users/1c30afd57a2a477b85561e77a9faa3f8/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:04:13.938005 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafd1fa-2488-4796-8d14-244669993e62 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:13.938537 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafd1fa-2488-4796-8d14-244669993e62 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:13.938537 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafd1fa-2488-4796-8d14-244669993e62 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:13.939872 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 578/1193] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:04:13.945047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf499e4-55d2-4400-bc95-2b3225a88187 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:13.945477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf499e4-55d2-4400-bc95-2b3225a88187 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:13.945576 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf499e4-55d2-4400-bc95-2b3225a88187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:13.964751 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-2bf499e4-55d2-4400-bc95-2b3225a88187 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:04:13.965980 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-2bf499e4-55d2-4400-bc95-2b3225a88187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:04:14.031502 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 616/1194] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:04:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:04:14.305659 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafd1fa-2488-4796-8d14-244669993e62 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:04:14.368219 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:04:14.411717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafd1fa-2488-4796-8d14-244669993e62 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:04:14.445478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12337064-7459-40b0-9cad-da2669f91129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:04:14.446125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12337064-7459-40b0-9cad-da2669f91129 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:14.446404 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12337064-7459-40b0-9cad-da2669f91129 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:14.446675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12337064-7459-40b0-9cad-da2669f91129 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:14.457019 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12337064-7459-40b0-9cad-da2669f91129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:04:14.462228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-12337064-7459-40b0-9cad-da2669f91129 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:04:14.462228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:04:14.462228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:04:14.462228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:04:14.462228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:04:14.462228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:04:14.462228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:04:14.462228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:04:14.462228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:04:14.462228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:04:14.462228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:04:14.462228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:04:14.462228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:04:14.462228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:04:14.462228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:04:14.462228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:04:14.463370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:04:14.463370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:04:14.463370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:04:14.463370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:04:14.463370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:04:14.463370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:04:14.463370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:04:14.463370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:04:14.463370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:04:14.463370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:04:14.463370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:04:14.463370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:04:14.463370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:04:14.463370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:04:14.463370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:04:14.463370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:04:14.464805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:04:14.464805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:04:14.464805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:04:14.464805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:04:14.464805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:04:14.464805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:04:14.464805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:04:14.464805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:04:14.464805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:04:14.464805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:04:14.464805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:04:14.464805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:04:14.464805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 579/1195] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:04:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:04:14.470087 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf499e4-55d2-4400-bc95-2b3225a88187 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:04:14.554450 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:04:14.573164 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf499e4-55d2-4400-bc95-2b3225a88187 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:04:14.599413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54b3ae-5daf-4508-8a98-d0f5df2b577d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:04:14.600119 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54b3ae-5daf-4508-8a98-d0f5df2b577d None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:14.600399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54b3ae-5daf-4508-8a98-d0f5df2b577d None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:14.600667 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54b3ae-5daf-4508-8a98-d0f5df2b577d None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:14.601318 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f54b3ae-5daf-4508-8a98-d0f5df2b577d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:04:14.601613 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f54b3ae-5daf-4508-8a98-d0f5df2b577d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:04:14.603105 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f54b3ae-5daf-4508-8a98-d0f5df2b577d None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:04:14.611791 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 617/1196] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:04:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:04:14.617442 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12337064-7459-40b0-9cad-da2669f91129 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:04:14.732985 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12337064-7459-40b0-9cad-da2669f91129 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:04:14.754627 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:04:14.766276 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c4d02-8265-4806-9046-a733bcde1061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:04:14.766904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c4d02-8265-4806-9046-a733bcde1061 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:14.767184 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c4d02-8265-4806-9046-a733bcde1061 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:14.767461 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c4d02-8265-4806-9046-a733bcde1061 None admin] PATH_INFO: `/v3/users/1c30afd57a2a477b85561e77a9faa3f8` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:14.768584 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c4d02-8265-4806-9046-a733bcde1061 None admin] RBAC: Authorizing `identity:get_user(user_id=1c30afd57a2a477b85561e77a9faa3f8)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:04:14.770035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c4d02-8265-4806-9046-a733bcde1061 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:04:14.771605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 580/1197] 10.222.0.79 () {56 vars in 1177 bytes} [Fri Sep 2 21:04:14 2022] GET /identity/v3/users/1c30afd57a2a477b85561e77a9faa3f8 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:04:14.778321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54b3ae-5daf-4508-8a98-d0f5df2b577d None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:04:14.884231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54b3ae-5daf-4508-8a98-d0f5df2b577d None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:04:14.918152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef754ee-7cb2-4d5d-b20f-81949bfa1422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:04:14.918753 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef754ee-7cb2-4d5d-b20f-81949bfa1422 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:14.919040 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef754ee-7cb2-4d5d-b20f-81949bfa1422 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:14.919321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef754ee-7cb2-4d5d-b20f-81949bfa1422 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:14.937277 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:04:14.986126 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef754ee-7cb2-4d5d-b20f-81949bfa1422 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:04:14.987588 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef754ee-7cb2-4d5d-b20f-81949bfa1422 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:04:15.083780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 618/1198] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:04:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:04:15.090365 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c4d02-8265-4806-9046-a733bcde1061 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:04:15.203286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c4d02-8265-4806-9046-a733bcde1061 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:04:15.236822 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626701d-9b1c-4b8e-af10-59459869242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:04:15.237436 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626701d-9b1c-4b8e-af10-59459869242f None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:15.237715 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626701d-9b1c-4b8e-af10-59459869242f None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:15.238018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626701d-9b1c-4b8e-af10-59459869242f None admin] PATH_INFO: `/v3/projects/7cb710a39ba7401c93e09c3594080ece` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:15.239131 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626701d-9b1c-4b8e-af10-59459869242f None admin] RBAC: Authorizing `identity:get_project(project_id=7cb710a39ba7401c93e09c3594080ece)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:04:15.240552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626701d-9b1c-4b8e-af10-59459869242f None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:04:15.242195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 581/1199] 10.222.0.79 () {56 vars in 1186 bytes} [Fri Sep 2 21:04:15 2022] GET /identity/v3/projects/7cb710a39ba7401c93e09c3594080ece => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:04:15.248447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef754ee-7cb2-4d5d-b20f-81949bfa1422 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:04:15.298582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:04:15.349753 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef754ee-7cb2-4d5d-b20f-81949bfa1422 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:04:15.383415 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ececee4-084c-4b0e-9b0b-41638cd9e2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:04:15.384017 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ececee4-084c-4b0e-9b0b-41638cd9e2e3 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:04:15.384300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ececee4-084c-4b0e-9b0b-41638cd9e2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:04:15.384576 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ececee4-084c-4b0e-9b0b-41638cd9e2e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:04:15.385291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ececee4-084c-4b0e-9b0b-41638cd9e2e3 None admin] RBAC: Adding query filter params (role.id=32e6a7f83b444d1ca9e5891a2b175f9a, scope.project.id=7cb710a39ba7401c93e09c3594080ece, user.id=1c30afd57a2a477b85561e77a9faa3f8) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:04:15.385603 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ececee4-084c-4b0e-9b0b-41638cd9e2e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:04:15.388535 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ececee4-084c-4b0e-9b0b-41638cd9e2e3 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:04:15.398319 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 619/1200] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:04:15 2022] GET /identity/v3/role_assignments?user.id=1c30afd57a2a477b85561e77a9faa3f8&scope.project.id=7cb710a39ba7401c93e09c3594080ece&role.id=32e6a7f83b444d1ca9e5891a2b175f9a => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:04:25.232799 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=71 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:04:25.393381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=43 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:34.700153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84253b7e-ddd0-4f51-8920-92a42bb7d46d None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:34.700694 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84253b7e-ddd0-4f51-8920-92a42bb7d46d None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:34.700694 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84253b7e-ddd0-4f51-8920-92a42bb7d46d None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:34.702081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 582/1201] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:05:34.707554 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32345150-18c4-4547-879d-ed66bf543fb5 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:34.708004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32345150-18c4-4547-879d-ed66bf543fb5 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:34.708114 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32345150-18c4-4547-879d-ed66bf543fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:34.727650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-32345150-18c4-4547-879d-ed66bf543fb5 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:05:34.728878 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-32345150-18c4-4547-879d-ed66bf543fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:05:34.797002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 620/1202] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:05:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:05:35.069834 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84253b7e-ddd0-4f51-8920-92a42bb7d46d None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:35.173609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84253b7e-ddd0-4f51-8920-92a42bb7d46d None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:35.210127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eaadda-fc29-42f9-a398-d898ffebb82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:35.210775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eaadda-fc29-42f9-a398-d898ffebb82c None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:35.211060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eaadda-fc29-42f9-a398-d898ffebb82c None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:35.211338 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eaadda-fc29-42f9-a398-d898ffebb82c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:35.222364 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eaadda-fc29-42f9-a398-d898ffebb82c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:35.223891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eaadda-fc29-42f9-a398-d898ffebb82c None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:35.238522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-c0eaadda-fc29-42f9-a398-d898ffebb82c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:35.238522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:35.238522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:35.238522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:35.238522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:35.238522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:35.238522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:35.238522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:35.238522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:35.238522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:35.238522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:35.238522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:35.238522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:05:35.238522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:05:35.238522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:05:35.238522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:05:35.240278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:35.240278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:35.240278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:35.240278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:35.240278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:35.240278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:35.240278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:35.240278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:35.240278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:35.240278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:35.240278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:35.240278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:35.240278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:35.240278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:35.240278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:35.240278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:35.240278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:05:35.241466 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:05:35.241466 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:35.241466 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:05:35.241466 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 583/1203] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:35.246716 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32345150-18c4-4547-879d-ed66bf543fb5 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:35.347829 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32345150-18c4-4547-879d-ed66bf543fb5 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:35.376996 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:35.382983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b6547-0116-49e5-97de-3ff1985d258d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:35.383595 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b6547-0116-49e5-97de-3ff1985d258d None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:35.383878 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b6547-0116-49e5-97de-3ff1985d258d None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:35.384154 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b6547-0116-49e5-97de-3ff1985d258d None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:35.384796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b6547-0116-49e5-97de-3ff1985d258d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:35.385102 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b6547-0116-49e5-97de-3ff1985d258d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:35.386511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b6547-0116-49e5-97de-3ff1985d258d None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:35.397621 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 621/1204] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:35.403654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eaadda-fc29-42f9-a398-d898ffebb82c None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:35.456931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:35.503596 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eaadda-fc29-42f9-a398-d898ffebb82c None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:35.537584 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2dc07-f618-42f9-9370-25f5748e6c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:35.538222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2dc07-f618-42f9-9370-25f5748e6c24 None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:35.538509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2dc07-f618-42f9-9370-25f5748e6c24 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:35.538787 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2dc07-f618-42f9-9370-25f5748e6c24 None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:35.539452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2dc07-f618-42f9-9370-25f5748e6c24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:35.540895 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2dc07-f618-42f9-9370-25f5748e6c24 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:35.649054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 584/1205] 10.222.0.79 () {60 vars in 1132 bytes} [Fri Sep 2 21:05:35 2022] POST /identity/v3/users => generated 251 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:05:37.627145 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579c997-acf7-40e6-aa7d-85b70f20e144 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:37.627705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579c997-acf7-40e6-aa7d-85b70f20e144 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:37.627705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579c997-acf7-40e6-aa7d-85b70f20e144 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:37.629054 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 622/1206] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:05:37.634310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c64f62-1486-445d-93c9-7350327aceae None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:37.634719 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c64f62-1486-445d-93c9-7350327aceae None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:37.634872 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c64f62-1486-445d-93c9-7350327aceae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:37.654086 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-48c64f62-1486-445d-93c9-7350327aceae None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:05:37.659462 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-48c64f62-1486-445d-93c9-7350327aceae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:05:37.726119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 585/1207] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:05:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:05:37.998585 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579c997-acf7-40e6-aa7d-85b70f20e144 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:38.103613 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579c997-acf7-40e6-aa7d-85b70f20e144 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:38.137981 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec65a4-2ebf-4b33-9151-c93a6087a1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:38.138604 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec65a4-2ebf-4b33-9151-c93a6087a1c7 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:38.138886 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec65a4-2ebf-4b33-9151-c93a6087a1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:38.139158 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec65a4-2ebf-4b33-9151-c93a6087a1c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:38.150065 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec65a4-2ebf-4b33-9151-c93a6087a1c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:05:38.154827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-50ec65a4-2ebf-4b33-9151-c93a6087a1c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:05:38.154827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:38.154827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:38.154827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:38.154827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:38.154827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:38.154827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:38.154827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:38.154827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:38.154827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:38.154827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:38.154827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:38.154827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:05:38.154827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:05:38.154827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:05:38.154827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:05:38.156028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:05:38.156028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:05:38.156028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:05:38.156028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:05:38.156028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:38.156028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:38.156028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:38.156028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:38.156028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:38.156028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:38.156028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:38.156028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:38.156028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:38.156028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:38.156028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:38.156028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:38.157071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:38.157071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:38.157071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:38.157071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:38.157071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:05:38.157071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:05:38.157071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:05:38.157071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:05:38.157071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:05:38.157071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:05:38.157071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:05:38.157071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:05:38.157071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 623/1208] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:05:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:38.161978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c64f62-1486-445d-93c9-7350327aceae None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:38.203041 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:38.264629 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c64f62-1486-445d-93c9-7350327aceae None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:38.298512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007eced0-e828-48d5-8b6b-dafed4ea4496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:38.299197 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007eced0-e828-48d5-8b6b-dafed4ea4496 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:38.299439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007eced0-e828-48d5-8b6b-dafed4ea4496 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:38.299713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007eced0-e828-48d5-8b6b-dafed4ea4496 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:38.300425 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007eced0-e828-48d5-8b6b-dafed4ea4496 None admin] RBAC: Adding query filter params (name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:38.300724 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007eced0-e828-48d5-8b6b-dafed4ea4496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:38.302948 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007eced0-e828-48d5-8b6b-dafed4ea4496 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:38.311097 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 586/1209] 10.222.0.79 () {56 vars in 1103 bytes} [Fri Sep 2 21:05:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:38.316882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec65a4-2ebf-4b33-9151-c93a6087a1c7 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:38.370112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:38.419637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec65a4-2ebf-4b33-9151-c93a6087a1c7 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:38.455075 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a017e6-95c4-4960-85ab-e9150b61a587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:38.455704 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a017e6-95c4-4960-85ab-e9150b61a587 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:38.455986 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a017e6-95c4-4960-85ab-e9150b61a587 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:38.456300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a017e6-95c4-4960-85ab-e9150b61a587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:38.466846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a017e6-95c4-4960-85ab-e9150b61a587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:38.468294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a017e6-95c4-4960-85ab-e9150b61a587 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:38.483446 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-13a017e6-95c4-4960-85ab-e9150b61a587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:38.483446 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:38.483446 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:38.483446 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:38.483446 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:38.483446 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:38.483446 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:38.483446 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:38.483446 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:38.483446 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:38.483446 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:38.483446 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:38.483446 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:05:38.483446 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:05:38.483446 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:05:38.483446 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:05:38.484890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:38.484890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:38.484890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:38.484890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:38.484890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:38.484890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:38.484890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:38.484890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:38.484890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:38.484890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:38.484890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:38.484890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:38.484890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:38.484890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:38.484890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:38.484890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:38.484890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:05:38.486247 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:05:38.486247 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:38.486247 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:05:38.486247 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 624/1210] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:38.491434 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007eced0-e828-48d5-8b6b-dafed4ea4496 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:38.598117 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:38.601516 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007eced0-e828-48d5-8b6b-dafed4ea4496 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:38.635281 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b63e7-ffc2-4243-b33f-fb6904c3753d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:38.635953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b63e7-ffc2-4243-b33f-fb6904c3753d None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:38.636162 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b63e7-ffc2-4243-b33f-fb6904c3753d None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:38.636440 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b63e7-ffc2-4243-b33f-fb6904c3753d None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:38.637085 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b63e7-ffc2-4243-b33f-fb6904c3753d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:38.637391 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b63e7-ffc2-4243-b33f-fb6904c3753d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:38.638812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b63e7-ffc2-4243-b33f-fb6904c3753d None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:38.651242 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 587/1211] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:38.657093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a017e6-95c4-4960-85ab-e9150b61a587 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:38.760777 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a017e6-95c4-4960-85ab-e9150b61a587 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:38.762448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:38.795443 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3b3ef-6ccd-4617-8293-4e8b2416e066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:38.796347 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3b3ef-6ccd-4617-8293-4e8b2416e066 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:38.796347 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3b3ef-6ccd-4617-8293-4e8b2416e066 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:38.796596 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3b3ef-6ccd-4617-8293-4e8b2416e066 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:38.805879 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3b3ef-6ccd-4617-8293-4e8b2416e066 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:38.807331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3b3ef-6ccd-4617-8293-4e8b2416e066 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:38.820733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-5da3b3ef-6ccd-4617-8293-4e8b2416e066 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:05:38.820733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:38.820733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:38.820733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:38.820733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:38.820733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:38.820733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:38.820733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:38.820733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:38.820733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:38.820733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:38.820733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:38.820733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:05:38.820733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:05:38.820733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:05:38.820733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:05:38.829407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:38.829407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:38.829407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:05:38.829407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:05:38.829407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:05:38.829407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:05:38.829407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:38.829407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:38.829407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:38.829407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:38.829407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:38.829407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:38.829407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:38.829407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:38.829407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:38.829407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:38.829407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:38.829407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:38.830634 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:38.830634 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:38.830634 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:05:38.830634 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:05:38.830634 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:05:38.830634 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:05:38.830634 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:05:38.830634 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:05:38.830634 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:05:38.830634 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:05:38.830634 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 625/1212] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:38.831573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b63e7-ffc2-4243-b33f-fb6904c3753d None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:38.937313 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b63e7-ffc2-4243-b33f-fb6904c3753d None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:38.972858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181a24a-acbe-4b3a-82bd-724bde5adffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:38.973469 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181a24a-acbe-4b3a-82bd-724bde5adffd None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:38.974364 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181a24a-acbe-4b3a-82bd-724bde5adffd None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:38.974746 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181a24a-acbe-4b3a-82bd-724bde5adffd None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:38.975488 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181a24a-acbe-4b3a-82bd-724bde5adffd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:38.975795 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181a24a-acbe-4b3a-82bd-724bde5adffd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:38.977220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181a24a-acbe-4b3a-82bd-724bde5adffd None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:38.995784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 588/1213] 10.222.0.79 () {56 vars in 1143 bytes} [Fri Sep 2 21:05:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:39.002110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3b3ef-6ccd-4617-8293-4e8b2416e066 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:39.106285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3b3ef-6ccd-4617-8293-4e8b2416e066 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:39.140233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e7213-108a-4a59-99fd-6c9b971f1cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:39.140834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e7213-108a-4a59-99fd-6c9b971f1cf7 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:39.141118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e7213-108a-4a59-99fd-6c9b971f1cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:39.141392 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e7213-108a-4a59-99fd-6c9b971f1cf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:39.192802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:39.231227 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e7213-108a-4a59-99fd-6c9b971f1cf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:39.232685 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e7213-108a-4a59-99fd-6c9b971f1cf7 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:39.341310 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 626/1214] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:05:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:05:39.347869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181a24a-acbe-4b3a-82bd-724bde5adffd None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:39.367401 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:39.450644 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181a24a-acbe-4b3a-82bd-724bde5adffd None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:39.484239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e712f-4d72-4100-b7d8-3141bbf76824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:39.484855 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e712f-4d72-4100-b7d8-3141bbf76824 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:39.485132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e712f-4d72-4100-b7d8-3141bbf76824 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:39.485403 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e712f-4d72-4100-b7d8-3141bbf76824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:39.495982 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e712f-4d72-4100-b7d8-3141bbf76824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:39.497486 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e712f-4d72-4100-b7d8-3141bbf76824 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:39.513324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-080e712f-4d72-4100-b7d8-3141bbf76824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:39.513324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:39.513324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:39.513324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:39.513324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:39.513324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:39.513324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:39.513324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:39.513324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:39.513324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:39.513324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:39.513324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:39.513324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:05:39.513324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:05:39.513324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:05:39.513324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:05:39.514900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:39.514900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:39.514900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:39.514900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:39.514900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:39.514900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:39.514900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:39.514900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:39.514900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:39.514900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:39.514900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:39.514900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:39.514900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:39.514900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:39.514900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:39.514900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:39.514900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:05:39.516676 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:05:39.516676 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:39.516676 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:05:39.516676 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 589/1215] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:39.523906 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e7213-108a-4a59-99fd-6c9b971f1cf7 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:39.594538 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:39.636472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e7213-108a-4a59-99fd-6c9b971f1cf7 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:39.671039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09564d63-775d-45b8-b5d1-82fc6873db07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:39.671762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09564d63-775d-45b8-b5d1-82fc6873db07 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:39.671934 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09564d63-775d-45b8-b5d1-82fc6873db07 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:39.672203 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09564d63-775d-45b8-b5d1-82fc6873db07 None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:39.672834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09564d63-775d-45b8-b5d1-82fc6873db07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:39.673135 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09564d63-775d-45b8-b5d1-82fc6873db07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:39.674660 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09564d63-775d-45b8-b5d1-82fc6873db07 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:39.687949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 627/1216] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:39.694875 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e712f-4d72-4100-b7d8-3141bbf76824 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:39.764489 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:39.794410 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e712f-4d72-4100-b7d8-3141bbf76824 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:39.829933 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017592b4-8730-446e-aa29-9d1c83350bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:39.830568 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017592b4-8730-446e-aa29-9d1c83350bfa None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:39.830857 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017592b4-8730-446e-aa29-9d1c83350bfa None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:39.831133 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017592b4-8730-446e-aa29-9d1c83350bfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:39.839173 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017592b4-8730-446e-aa29-9d1c83350bfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:39.840644 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017592b4-8730-446e-aa29-9d1c83350bfa None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:39.852916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-017592b4-8730-446e-aa29-9d1c83350bfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:05:39.852916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:39.852916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:39.852916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:39.852916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:39.852916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:39.852916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:39.852916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:39.852916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:39.852916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:39.852916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:39.852916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:39.852916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:05:39.852916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:05:39.852916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:05:39.860522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:05:39.860522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:39.860522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:39.860522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:39.860522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:39.860522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:39.860522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:39.860522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:39.860522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:39.860522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:39.860522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:39.860522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:39.860522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:39.860522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:39.860522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:39.860522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:39.860522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:39.861730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:05:39.861730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:05:39.861730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:05:39.861730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:05:39.861730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:05:39.861730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:05:39.861730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:05:39.861730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:05:39.861730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 590/1217] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:05:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:39.862420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09564d63-775d-45b8-b5d1-82fc6873db07 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:39.960738 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09564d63-775d-45b8-b5d1-82fc6873db07 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:39.983711 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:39.995650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e454332-6c63-4f02-947b-3129ca88505e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:39.996259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e454332-6c63-4f02-947b-3129ca88505e None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:39.996547 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e454332-6c63-4f02-947b-3129ca88505e None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:39.996826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e454332-6c63-4f02-947b-3129ca88505e None admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:39.997517 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e454332-6c63-4f02-947b-3129ca88505e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:39.997846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e454332-6c63-4f02-947b-3129ca88505e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:39.999295 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e454332-6c63-4f02-947b-3129ca88505e None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:40.011032 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 628/1218] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:05:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:40.017337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017592b4-8730-446e-aa29-9d1c83350bfa None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:40.120765 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017592b4-8730-446e-aa29-9d1c83350bfa None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:40.150456 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:40.156832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e57a7-702b-4709-948c-5191b4ef3346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:40.157435 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e57a7-702b-4709-948c-5191b4ef3346 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:40.157714 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e57a7-702b-4709-948c-5191b4ef3346 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:40.158017 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e57a7-702b-4709-948c-5191b4ef3346 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:40.158744 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e57a7-702b-4709-948c-5191b4ef3346 None admin] RBAC: Adding query filter params (role.id=1c1ddcbda0754702bb016952e90405ca, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=aa0f9604ee2e43b4967cbdc779e63e71) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:40.159098 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e57a7-702b-4709-948c-5191b4ef3346 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:40.160504 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e57a7-702b-4709-948c-5191b4ef3346 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:40.166515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 591/1219] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:05:40 2022] GET /identity/v3/role_assignments?user.id=aa0f9604ee2e43b4967cbdc779e63e71&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=1c1ddcbda0754702bb016952e90405ca => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:42.110366 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6db10f-64b6-4bde-bcdc-493b6c707687 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:42.110899 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6db10f-64b6-4bde-bcdc-493b6c707687 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:42.110899 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6db10f-64b6-4bde-bcdc-493b6c707687 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:42.112299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 629/1220] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:05:42.118667 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6a01f-0951-4791-b99c-e99ddd3375e1 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:42.119160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6a01f-0951-4791-b99c-e99ddd3375e1 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:42.119251 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6a01f-0951-4791-b99c-e99ddd3375e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:42.137861 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-11d6a01f-0951-4791-b99c-e99ddd3375e1 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:05:42.139101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-11d6a01f-0951-4791-b99c-e99ddd3375e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:05:42.212810 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 592/1221] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:05:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:05:42.490997 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6db10f-64b6-4bde-bcdc-493b6c707687 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:42.592474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6db10f-64b6-4bde-bcdc-493b6c707687 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:42.627041 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385b350-defd-4912-9392-13da3ab7bd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:42.627660 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385b350-defd-4912-9392-13da3ab7bd45 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:42.627945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385b350-defd-4912-9392-13da3ab7bd45 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:42.628244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385b350-defd-4912-9392-13da3ab7bd45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:42.638391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385b350-defd-4912-9392-13da3ab7bd45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:05:42.643284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-6385b350-defd-4912-9392-13da3ab7bd45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:05:42.643284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:42.643284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:42.643284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:42.643284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:42.643284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:42.643284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:42.643284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:42.643284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:42.643284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:42.643284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:42.643284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:42.643284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:05:42.643284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:05:42.643284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:05:42.643284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:05:42.644408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:05:42.644408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:05:42.644408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:05:42.644408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:05:42.644408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:42.644408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:42.644408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:42.644408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:42.644408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:42.644408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:42.644408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:42.644408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:42.644408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:42.644408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:42.644408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:42.644408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:42.646269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:42.646269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:42.646269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:42.646269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:42.646269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:05:42.646269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:05:42.646269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:05:42.646269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:05:42.646269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:05:42.646269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:05:42.646269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:05:42.646269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:05:42.646269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 630/1222] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:05:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:05:42.651270 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6a01f-0951-4791-b99c-e99ddd3375e1 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:42.755170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6a01f-0951-4791-b99c-e99ddd3375e1 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:42.778856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:42.789755 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5596a58-787c-40ca-b5ef-e02c7b4c6921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:42.790392 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5596a58-787c-40ca-b5ef-e02c7b4c6921 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:42.790668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5596a58-787c-40ca-b5ef-e02c7b4c6921 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:42.790943 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5596a58-787c-40ca-b5ef-e02c7b4c6921 None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:42.791600 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5596a58-787c-40ca-b5ef-e02c7b4c6921 None admin] RBAC: Adding query filter params (name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:42.791902 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5596a58-787c-40ca-b5ef-e02c7b4c6921 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:42.793251 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5596a58-787c-40ca-b5ef-e02c7b4c6921 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:42.800867 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 593/1223] 10.222.0.79 () {56 vars in 1103 bytes} [Fri Sep 2 21:05:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:42.807032 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385b350-defd-4912-9392-13da3ab7bd45 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:42.851409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:42.907021 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385b350-defd-4912-9392-13da3ab7bd45 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:42.939155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d044788-87a0-4d54-83b8-484df7791c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:42.939781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d044788-87a0-4d54-83b8-484df7791c8e None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:42.940060 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d044788-87a0-4d54-83b8-484df7791c8e None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:42.940337 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d044788-87a0-4d54-83b8-484df7791c8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:42.951848 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d044788-87a0-4d54-83b8-484df7791c8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:42.953385 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d044788-87a0-4d54-83b8-484df7791c8e None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:42.968016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-5d044788-87a0-4d54-83b8-484df7791c8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:42.968016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:42.968016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:42.968016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:42.968016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:42.968016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:42.968016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:42.968016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:42.968016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:42.968016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:42.968016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:42.968016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:42.968016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:05:42.968016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:05:42.968016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:05:42.968016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:05:42.969189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:42.969189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:42.969189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:42.969189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:42.969189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:42.969189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:42.969189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:42.969189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:42.969189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:42.969189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:42.969189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:42.969189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:42.969189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:42.969189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:42.969189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:42.969189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:42.969189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:05:42.970496 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:05:42.970496 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:42.970496 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:05:42.970496 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 631/1224] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:42.975191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5596a58-787c-40ca-b5ef-e02c7b4c6921 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:43.092262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5596a58-787c-40ca-b5ef-e02c7b4c6921 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:43.125728 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451edd0a-1217-4971-86ba-81b73f8c7183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:43.126423 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451edd0a-1217-4971-86ba-81b73f8c7183 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:43.126709 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451edd0a-1217-4971-86ba-81b73f8c7183 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:43.127193 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451edd0a-1217-4971-86ba-81b73f8c7183 None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:43.127851 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451edd0a-1217-4971-86ba-81b73f8c7183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:43.128161 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451edd0a-1217-4971-86ba-81b73f8c7183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:43.130098 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451edd0a-1217-4971-86ba-81b73f8c7183 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:43.143716 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 594/1225] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:43.150232 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d044788-87a0-4d54-83b8-484df7791c8e None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:43.243113 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:43.249551 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d044788-87a0-4d54-83b8-484df7791c8e None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:43.283348 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc77bbb-7bc7-41d0-9aea-ae3475033a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:43.283986 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc77bbb-7bc7-41d0-9aea-ae3475033a8f None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:43.284273 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc77bbb-7bc7-41d0-9aea-ae3475033a8f None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:43.289789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc77bbb-7bc7-41d0-9aea-ae3475033a8f None admin] PATH_INFO: `/v3/users/placement` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:43.292505 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc77bbb-7bc7-41d0-9aea-ae3475033a8f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:43.293982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc77bbb-7bc7-41d0-9aea-ae3475033a8f None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:43.313110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-6bc77bbb-7bc7-41d0-9aea-ae3475033a8f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:05:43.313110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:43.313110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:43.313110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:43.313110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:43.313110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:43.313110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:43.313110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:43.313110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:43.313110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:43.313110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:43.313110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:43.313110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:05:43.313110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:05:43.313110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:05:43.313110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:05:43.315138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:43.315138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:43.315138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:05:43.315138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:05:43.315138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:05:43.315138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:05:43.315138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:43.315138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:43.315138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:43.315138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:43.315138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:43.315138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:43.315138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:43.315138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:43.315138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:43.315138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:43.315138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:43.315138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:43.317398 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:43.317398 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:43.317398 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:05:43.317398 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:05:43.317398 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:05:43.317398 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:05:43.317398 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:05:43.317398 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:05:43.317398 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:05:43.317398 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:05:43.317398 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 632/1226] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:43.324447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451edd0a-1217-4971-86ba-81b73f8c7183 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:43.372513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:43.428341 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451edd0a-1217-4971-86ba-81b73f8c7183 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:43.462797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775391f-d189-4cd5-b2e1-b604fc8efe26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:43.463399 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775391f-d189-4cd5-b2e1-b604fc8efe26 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:43.463681 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775391f-d189-4cd5-b2e1-b604fc8efe26 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:43.463955 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775391f-d189-4cd5-b2e1-b604fc8efe26 None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:43.464678 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775391f-d189-4cd5-b2e1-b604fc8efe26 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:43.464985 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775391f-d189-4cd5-b2e1-b604fc8efe26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:43.466437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775391f-d189-4cd5-b2e1-b604fc8efe26 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:43.483661 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 595/1227] 10.222.0.79 () {56 vars in 1143 bytes} [Fri Sep 2 21:05:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:43.490121 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc77bbb-7bc7-41d0-9aea-ae3475033a8f None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:43.591274 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc77bbb-7bc7-41d0-9aea-ae3475033a8f None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:43.625475 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f54f3-9369-4e0b-81e2-d0e0b4af71c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:43.626055 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f54f3-9369-4e0b-81e2-d0e0b4af71c4 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:43.626336 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f54f3-9369-4e0b-81e2-d0e0b4af71c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:43.626604 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f54f3-9369-4e0b-81e2-d0e0b4af71c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:43.637903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f54f3-9369-4e0b-81e2-d0e0b4af71c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:43.639351 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f54f3-9369-4e0b-81e2-d0e0b4af71c4 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:43.654053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-a84f54f3-9369-4e0b-81e2-d0e0b4af71c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:43.654053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:43.654053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:43.654053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:43.654053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:43.654053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:43.654053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:43.654053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:43.654053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:43.654053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:43.654053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:43.654053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:43.654053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:05:43.654053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:05:43.654053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:05:43.654053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:05:43.655253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:43.655253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:43.655253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:43.655253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:43.655253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:43.655253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:43.655253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:43.655253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:43.655253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:43.655253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:43.655253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:43.655253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:43.655253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:43.655253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:43.655253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:43.655253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:43.655253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:05:43.656245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:05:43.656245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:43.656245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:05:43.656245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 633/1228] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:43.661308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775391f-d189-4cd5-b2e1-b604fc8efe26 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:43.767608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775391f-d189-4cd5-b2e1-b604fc8efe26 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:43.769948 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:43.801646 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77602c-70e4-487b-a4c3-95ce2e7453ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:43.802732 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77602c-70e4-487b-a4c3-95ce2e7453ed None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:43.802732 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77602c-70e4-487b-a4c3-95ce2e7453ed None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:43.802985 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77602c-70e4-487b-a4c3-95ce2e7453ed None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:43.803529 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77602c-70e4-487b-a4c3-95ce2e7453ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:43.803801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77602c-70e4-487b-a4c3-95ce2e7453ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:43.805168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77602c-70e4-487b-a4c3-95ce2e7453ed None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:43.816380 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 596/1229] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:43.822969 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f54f3-9369-4e0b-81e2-d0e0b4af71c4 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:43.832445 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:43.923875 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f54f3-9369-4e0b-81e2-d0e0b4af71c4 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:43.958254 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5e8f8-741b-469f-a74d-7eaf5411792f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:43.958963 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5e8f8-741b-469f-a74d-7eaf5411792f None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:43.959243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5e8f8-741b-469f-a74d-7eaf5411792f None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:43.959515 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5e8f8-741b-469f-a74d-7eaf5411792f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:43.966215 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5e8f8-741b-469f-a74d-7eaf5411792f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:43.967657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5e8f8-741b-469f-a74d-7eaf5411792f None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:43.979299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-49d5e8f8-741b-469f-a74d-7eaf5411792f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:05:43.979299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:43.979299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:43.979299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:43.979299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:43.979299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:43.979299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:43.979299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:43.979299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:43.979299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:43.979299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:43.979299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:43.979299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:05:43.979299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:05:43.979299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:05:43.980376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:05:43.980376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:43.980376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:43.980376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:43.980376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:43.980376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:43.980376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:43.980376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:43.980376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:43.980376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:43.980376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:43.980376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:43.980376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:43.980376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:43.980376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:43.980376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:43.980376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:43.981635 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:05:43.981635 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:05:43.981635 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:05:43.981635 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:05:43.981635 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:05:43.981635 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:05:43.981635 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:05:43.981635 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:05:43.981635 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 634/1230] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:05:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:43.986472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77602c-70e4-487b-a4c3-95ce2e7453ed None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:44.086953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77602c-70e4-487b-a4c3-95ce2e7453ed None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:44.120223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b6519-2153-40a7-bce9-7fee7a97fc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:44.120827 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b6519-2153-40a7-bce9-7fee7a97fc56 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:44.121104 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b6519-2153-40a7-bce9-7fee7a97fc56 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:44.121376 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b6519-2153-40a7-bce9-7fee7a97fc56 None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:44.122094 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b6519-2153-40a7-bce9-7fee7a97fc56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:44.122402 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b6519-2153-40a7-bce9-7fee7a97fc56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:44.123807 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b6519-2153-40a7-bce9-7fee7a97fc56 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:44.136346 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 597/1231] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:05:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:44.142543 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5e8f8-741b-469f-a74d-7eaf5411792f None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:44.209659 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:44.244525 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5e8f8-741b-469f-a74d-7eaf5411792f None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:44.278655 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c5fe1-78ec-4987-96aa-66ae345eb4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:44.279353 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c5fe1-78ec-4987-96aa-66ae345eb4c3 None admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:44.279641 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c5fe1-78ec-4987-96aa-66ae345eb4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:44.279960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c5fe1-78ec-4987-96aa-66ae345eb4c3 None admin] PATH_INFO: `/v3/projects/61c5f56764934c4a90ad38357b46f397/users/aa0f9604ee2e43b4967cbdc779e63e71/roles/1c1ddcbda0754702bb016952e90405ca` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:44.294582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c5fe1-78ec-4987-96aa-66ae345eb4c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=61c5f56764934c4a90ad38357b46f397, user_id=aa0f9604ee2e43b4967cbdc779e63e71, role_id=1c1ddcbda0754702bb016952e90405ca)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:44.296028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c5fe1-78ec-4987-96aa-66ae345eb4c3 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:44.372317 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 635/1232] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:05:44 2022] PUT /identity/v3/projects/61c5f56764934c4a90ad38357b46f397/users/aa0f9604ee2e43b4967cbdc779e63e71/roles/1c1ddcbda0754702bb016952e90405ca => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:05:46.283289 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8976e1-5ffe-4809-807d-259e721570b4 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:46.283919 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8976e1-5ffe-4809-807d-259e721570b4 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:46.283919 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8976e1-5ffe-4809-807d-259e721570b4 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:46.285181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 598/1233] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:05:46.291188 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0501c0-ede9-4c8c-a2f3-b9c344fe4a0b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:46.296838 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0501c0-ede9-4c8c-a2f3-b9c344fe4a0b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:46.296838 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0501c0-ede9-4c8c-a2f3-b9c344fe4a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:46.311039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-4f0501c0-ede9-4c8c-a2f3-b9c344fe4a0b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:05:46.312224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-4f0501c0-ede9-4c8c-a2f3-b9c344fe4a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:05:46.381962 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 636/1234] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:05:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:05:46.652119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8976e1-5ffe-4809-807d-259e721570b4 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:46.678375 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:46.772770 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8976e1-5ffe-4809-807d-259e721570b4 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:46.808363 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ff369-2e48-4260-b22c-1d170d5c6740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:46.809009 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ff369-2e48-4260-b22c-1d170d5c6740 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:46.809295 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ff369-2e48-4260-b22c-1d170d5c6740 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:46.809576 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ff369-2e48-4260-b22c-1d170d5c6740 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:46.820543 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ff369-2e48-4260-b22c-1d170d5c6740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:05:46.827059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-4e0ff369-2e48-4260-b22c-1d170d5c6740 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:05:46.827059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:46.827059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:46.827059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:46.827059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:46.827059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:46.827059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:46.827059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:46.827059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:46.827059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:46.827059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:46.827059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:46.827059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:05:46.827059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:05:46.827059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:05:46.827059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:05:46.828110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:05:46.828110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:05:46.828110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:05:46.828110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:05:46.828110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:46.828110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:46.828110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:46.828110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:46.828110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:46.828110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:46.828110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:46.828110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:46.828110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:46.828110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:46.828110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:46.828110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:46.829062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:46.829062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:46.829062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:46.829062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:46.829062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:05:46.829062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:05:46.829062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:05:46.829062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:05:46.829062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:05:46.829062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:05:46.829062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 02 21:05:46.829062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:05:46.829062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 599/1235] 10.222.0.79 () {56 vars in 1102 bytes} [Fri Sep 2 21:05:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:05:46.832852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0501c0-ede9-4c8c-a2f3-b9c344fe4a0b None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:46.880506 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:46.932865 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0501c0-ede9-4c8c-a2f3-b9c344fe4a0b None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:46.967027 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5e22d-62fb-406e-bd65-2f0b2d998a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:46.967637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5e22d-62fb-406e-bd65-2f0b2d998a43 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:46.967921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5e22d-62fb-406e-bd65-2f0b2d998a43 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:46.968196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5e22d-62fb-406e-bd65-2f0b2d998a43 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:46.968860 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5e22d-62fb-406e-bd65-2f0b2d998a43 None admin] RBAC: Adding query filter params (name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:46.969168 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5e22d-62fb-406e-bd65-2f0b2d998a43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:46.970616 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5e22d-62fb-406e-bd65-2f0b2d998a43 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:46.979015 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 637/1236] 10.222.0.79 () {56 vars in 1103 bytes} [Fri Sep 2 21:05:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:46.985284 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ff369-2e48-4260-b22c-1d170d5c6740 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:47.072724 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:47.090760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ff369-2e48-4260-b22c-1d170d5c6740 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:47.125264 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b37af-e224-4003-85d2-03b88fb40b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:47.125921 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b37af-e224-4003-85d2-03b88fb40b26 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:47.126203 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b37af-e224-4003-85d2-03b88fb40b26 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:47.126477 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b37af-e224-4003-85d2-03b88fb40b26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:47.136679 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b37af-e224-4003-85d2-03b88fb40b26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:47.138260 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b37af-e224-4003-85d2-03b88fb40b26 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:47.153433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-d95b37af-e224-4003-85d2-03b88fb40b26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:47.153433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:47.153433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:47.153433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:47.153433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:47.153433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:47.153433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:47.153433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:47.153433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:47.153433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:47.153433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:47.153433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:47.153433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:05:47.153433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:05:47.153433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:05:47.153433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:05:47.154663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:47.154663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:47.154663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:47.154663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:47.154663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:47.154663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:47.154663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:47.154663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:47.154663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:47.154663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:47.154663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:47.154663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:47.154663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:47.154663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:47.154663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:47.154663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:47.154663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:05:47.155578 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:05:47.155578 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:47.155578 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:05:47.155578 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 600/1237] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:47.160685 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5e22d-62fb-406e-bd65-2f0b2d998a43 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:47.262690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5e22d-62fb-406e-bd65-2f0b2d998a43 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:47.271393 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:47.297860 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5738e5-4874-4205-abbe-d71768faccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:47.298526 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5738e5-4874-4205-abbe-d71768faccbd None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:47.298743 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5738e5-4874-4205-abbe-d71768faccbd None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:47.299022 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5738e5-4874-4205-abbe-d71768faccbd None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:47.299682 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5738e5-4874-4205-abbe-d71768faccbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:47.299976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5738e5-4874-4205-abbe-d71768faccbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:47.301355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5738e5-4874-4205-abbe-d71768faccbd None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:47.313622 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 638/1238] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:47.320737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b37af-e224-4003-85d2-03b88fb40b26 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:47.425856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b37af-e224-4003-85d2-03b88fb40b26 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:47.460982 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf6c61-c09b-47e4-ba83-829dd01abe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:47.461599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf6c61-c09b-47e4-ba83-829dd01abe1b None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:47.461906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf6c61-c09b-47e4-ba83-829dd01abe1b None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:47.462184 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf6c61-c09b-47e4-ba83-829dd01abe1b None admin] PATH_INFO: `/v3/users/placement` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:47.464955 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:47.469818 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf6c61-c09b-47e4-ba83-829dd01abe1b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:47.471258 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf6c61-c09b-47e4-ba83-829dd01abe1b None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:47.482550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-73bf6c61-c09b-47e4-ba83-829dd01abe1b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:05:47.482550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:47.482550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:47.482550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:47.482550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:47.482550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:47.482550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:47.482550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:47.482550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:47.482550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:47.482550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:47.482550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:47.482550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:05:47.482550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:05:47.482550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:05:47.482550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:05:47.486389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:47.486389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:47.486389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:05:47.486389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:05:47.486389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:05:47.486389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:05:47.486389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:47.486389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:47.486389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:47.486389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:47.486389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:47.486389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:47.486389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:47.486389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:47.486389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:47.486389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:47.486389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:47.486389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:47.487616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:47.487616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:47.487616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:05:47.487616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:05:47.487616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:05:47.487616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:05:47.487616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:05:47.487616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:05:47.487616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:05:47.487616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:05:47.487616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 601/1239] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:47.490206 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5738e5-4874-4205-abbe-d71768faccbd None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:47.594505 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5738e5-4874-4205-abbe-d71768faccbd None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:47.628860 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d25af-7cb9-48e2-90d4-a65178bfa49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:47.629462 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d25af-7cb9-48e2-90d4-a65178bfa49c None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:47.629746 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d25af-7cb9-48e2-90d4-a65178bfa49c None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:47.630045 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d25af-7cb9-48e2-90d4-a65178bfa49c None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:47.631344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d25af-7cb9-48e2-90d4-a65178bfa49c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:47.631647 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d25af-7cb9-48e2-90d4-a65178bfa49c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:47.633314 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d25af-7cb9-48e2-90d4-a65178bfa49c None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:47.651103 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 639/1240] 10.222.0.79 () {56 vars in 1143 bytes} [Fri Sep 2 21:05:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:47.657075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf6c61-c09b-47e4-ba83-829dd01abe1b None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:47.761602 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf6c61-c09b-47e4-ba83-829dd01abe1b None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:47.795050 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbbef7-e165-454e-9351-5ecc90792e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:47.795659 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbbef7-e165-454e-9351-5ecc90792e2f None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:47.795943 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbbef7-e165-454e-9351-5ecc90792e2f None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:47.796220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbbef7-e165-454e-9351-5ecc90792e2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:47.858732 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:47.865910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbbef7-e165-454e-9351-5ecc90792e2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:47.867464 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbbef7-e165-454e-9351-5ecc90792e2f None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:47.967150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 602/1241] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:05:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:05:47.973285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d25af-7cb9-48e2-90d4-a65178bfa49c None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:48.001909 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:48.077413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d25af-7cb9-48e2-90d4-a65178bfa49c None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:48.112743 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17814476-1bdb-475f-b0e7-eed859fc4b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:48.113309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17814476-1bdb-475f-b0e7-eed859fc4b17 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:48.113594 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17814476-1bdb-475f-b0e7-eed859fc4b17 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:48.113898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17814476-1bdb-475f-b0e7-eed859fc4b17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:48.124576 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17814476-1bdb-475f-b0e7-eed859fc4b17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:48.126064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17814476-1bdb-475f-b0e7-eed859fc4b17 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:48.142008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-17814476-1bdb-475f-b0e7-eed859fc4b17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:48.142008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:48.142008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:48.142008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:48.142008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:48.142008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:48.142008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:48.142008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:48.142008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:48.142008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:48.142008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:48.142008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:48.142008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:05:48.142008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:05:48.142008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:05:48.142008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:05:48.143413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:48.143413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:48.143413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:48.143413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:48.143413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:48.143413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:48.143413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:48.143413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:48.143413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:48.143413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:48.143413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:48.143413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:48.143413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:48.143413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:48.143413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:48.143413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:48.143413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:05:48.144903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:05:48.144903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:48.144903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:05:48.144903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 640/1242] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:05:48.150491 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbbef7-e165-454e-9351-5ecc90792e2f None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:48.250195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:48.257115 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbbef7-e165-454e-9351-5ecc90792e2f None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:48.293133 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3299faa-fc93-4361-9aae-9e468f778027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:48.293747 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299faa-fc93-4361-9aae-9e468f778027 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:48.294063 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299faa-fc93-4361-9aae-9e468f778027 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:48.294344 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299faa-fc93-4361-9aae-9e468f778027 None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:48.294999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3299faa-fc93-4361-9aae-9e468f778027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:48.295321 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3299faa-fc93-4361-9aae-9e468f778027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:48.296686 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3299faa-fc93-4361-9aae-9e468f778027 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:48.311892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 603/1243] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:48.318615 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17814476-1bdb-475f-b0e7-eed859fc4b17 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:48.400084 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:48.421510 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17814476-1bdb-475f-b0e7-eed859fc4b17 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:48.455747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28626362-b068-43d5-9867-652b3e04ca2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:48.456371 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28626362-b068-43d5-9867-652b3e04ca2c None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:48.456660 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28626362-b068-43d5-9867-652b3e04ca2c None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:48.456940 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28626362-b068-43d5-9867-652b3e04ca2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:48.463484 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28626362-b068-43d5-9867-652b3e04ca2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:48.464920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28626362-b068-43d5-9867-652b3e04ca2c None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:48.476355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-28626362-b068-43d5-9867-652b3e04ca2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:05:48.476355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:48.476355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:48.476355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:48.476355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:48.476355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:48.476355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:48.476355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:48.476355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:48.476355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:48.476355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:48.476355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:48.476355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:05:48.476355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:05:48.476355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:05:48.477437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:05:48.477437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:48.477437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:48.477437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:48.477437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:48.477437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:48.477437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:48.477437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:48.477437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:48.477437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:48.477437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:48.477437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:48.477437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:48.477437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:48.477437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:48.477437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:48.477437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:48.478375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:05:48.478375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:05:48.478375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:05:48.478375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:05:48.478375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:05:48.478375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:05:48.478375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:05:48.478375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:05:48.478375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 641/1244] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:05:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:48.483512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3299faa-fc93-4361-9aae-9e468f778027 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:48.585295 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3299faa-fc93-4361-9aae-9e468f778027 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:48.618977 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da7356-bd46-48cf-b013-b517da7efe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:48.619590 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da7356-bd46-48cf-b013-b517da7efe2f None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:48.619873 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da7356-bd46-48cf-b013-b517da7efe2f None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:48.620153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da7356-bd46-48cf-b013-b517da7efe2f None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:48.620850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da7356-bd46-48cf-b013-b517da7efe2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:48.621162 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da7356-bd46-48cf-b013-b517da7efe2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:48.622620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da7356-bd46-48cf-b013-b517da7efe2f None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:48.635246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 604/1245] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:05:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:48.641332 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28626362-b068-43d5-9867-652b3e04ca2c None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:48.746762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28626362-b068-43d5-9867-652b3e04ca2c None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:48.780684 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b432e6-19ff-458f-8a39-7de3744cc92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:48.781287 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b432e6-19ff-458f-8a39-7de3744cc92b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:48.781573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b432e6-19ff-458f-8a39-7de3744cc92b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:48.781888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b432e6-19ff-458f-8a39-7de3744cc92b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:48.782652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b432e6-19ff-458f-8a39-7de3744cc92b None admin] RBAC: Adding query filter params (role.id=1c1ddcbda0754702bb016952e90405ca, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=aa0f9604ee2e43b4967cbdc779e63e71) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:48.782965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b432e6-19ff-458f-8a39-7de3744cc92b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:48.784399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b432e6-19ff-458f-8a39-7de3744cc92b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:48.791310 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 642/1246] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:05:48 2022] GET /identity/v3/role_assignments?user.id=aa0f9604ee2e43b4967cbdc779e63e71&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=1c1ddcbda0754702bb016952e90405ca => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:50.848432 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a7d0c-55a6-4ecf-80da-20908fbec17e None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:50.849075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a7d0c-55a6-4ecf-80da-20908fbec17e None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:50.849075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a7d0c-55a6-4ecf-80da-20908fbec17e None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:50.851036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 605/1247] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:05:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:05:50.856875 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1f5c2-1447-4483-bc28-4371b2eb7c4b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:50.857403 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1f5c2-1447-4483-bc28-4371b2eb7c4b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:50.857403 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1f5c2-1447-4483-bc28-4371b2eb7c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:50.865473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:50.882567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-96e1f5c2-1447-4483-bc28-4371b2eb7c4b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:05:50.883843 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-96e1f5c2-1447-4483-bc28-4371b2eb7c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:05:50.961525 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 643/1248] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:05:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:05:51.245118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a7d0c-55a6-4ecf-80da-20908fbec17e None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:51.264079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:51.350784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a7d0c-55a6-4ecf-80da-20908fbec17e None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:51.385333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460eb54-095a-4f31-9ff5-33c003601fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:51.389344 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460eb54-095a-4f31-9ff5-33c003601fe7 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:51.389344 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460eb54-095a-4f31-9ff5-33c003601fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:51.389344 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460eb54-095a-4f31-9ff5-33c003601fe7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:51.398151 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460eb54-095a-4f31-9ff5-33c003601fe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:05:51.402964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-0460eb54-095a-4f31-9ff5-33c003601fe7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:05:51.402964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:51.402964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:51.402964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:51.402964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:51.402964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:51.402964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:51.402964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:51.402964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:51.402964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:51.402964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:51.402964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:51.402964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:05:51.402964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:05:51.402964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:05:51.402964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:05:51.404110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:05:51.404110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:05:51.404110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:05:51.404110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:05:51.404110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:51.404110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:51.404110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:51.404110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:51.404110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:51.404110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:51.404110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:51.404110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:51.404110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:51.404110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:51.404110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:51.404110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:51.405195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:51.405195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:51.405195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:51.405195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:51.405195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:05:51.405195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:05:51.405195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:05:51.405195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:05:51.405195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:05:51.405195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:05:51.405195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:05:51.405195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:05:51.405195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 606/1249] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:05:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:51.412419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1f5c2-1447-4483-bc28-4371b2eb7c4b None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:51.539294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1f5c2-1447-4483-bc28-4371b2eb7c4b None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:51.568374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:51.573391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306b27e-490e-47e5-92bc-9c491f24acb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:51.574032 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306b27e-490e-47e5-92bc-9c491f24acb3 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:51.574321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306b27e-490e-47e5-92bc-9c491f24acb3 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:51.574600 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306b27e-490e-47e5-92bc-9c491f24acb3 None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:51.575264 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306b27e-490e-47e5-92bc-9c491f24acb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:51.575574 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306b27e-490e-47e5-92bc-9c491f24acb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:51.577004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306b27e-490e-47e5-92bc-9c491f24acb3 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:51.585764 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 644/1250] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:05:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:51.591705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460eb54-095a-4f31-9ff5-33c003601fe7 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:51.673479 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:51.696970 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460eb54-095a-4f31-9ff5-33c003601fe7 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:51.731954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94c31b-0403-47ea-aa9d-6901dc2e904c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:51.732575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94c31b-0403-47ea-aa9d-6901dc2e904c None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:51.732852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94c31b-0403-47ea-aa9d-6901dc2e904c None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:51.733125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94c31b-0403-47ea-aa9d-6901dc2e904c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:51.743981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94c31b-0403-47ea-aa9d-6901dc2e904c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:51.745349 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94c31b-0403-47ea-aa9d-6901dc2e904c None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:51.760478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-5b94c31b-0403-47ea-aa9d-6901dc2e904c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:51.760478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:51.760478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:51.760478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:51.760478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:51.760478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:51.760478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:51.760478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:51.760478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:51.760478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:51.760478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:51.760478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:51.760478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:05:51.760478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:05:51.760478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:05:51.760478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:05:51.761702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:51.761702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:51.761702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:51.761702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:51.761702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:51.761702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:51.761702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:51.761702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:51.761702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:51.761702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:51.761702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:51.761702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:51.761702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:51.761702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:51.761702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:51.761702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:51.761702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:05:51.762656 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:05:51.762656 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:51.762656 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:05:51.762656 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 607/1251] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:51.767890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306b27e-490e-47e5-92bc-9c491f24acb3 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:51.873421 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306b27e-490e-47e5-92bc-9c491f24acb3 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:51.908081 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc2550-34d8-4ab5-bc25-e4161ed9581f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:51.908688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc2550-34d8-4ab5-bc25-e4161ed9581f None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:51.908975 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc2550-34d8-4ab5-bc25-e4161ed9581f None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:51.909260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc2550-34d8-4ab5-bc25-e4161ed9581f None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:51.909924 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc2550-34d8-4ab5-bc25-e4161ed9581f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:51.910234 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc2550-34d8-4ab5-bc25-e4161ed9581f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:51.911934 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc2550-34d8-4ab5-bc25-e4161ed9581f None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:51.923649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 645/1252] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:51.929498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94c31b-0403-47ea-aa9d-6901dc2e904c None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:52.031875 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94c31b-0403-47ea-aa9d-6901dc2e904c None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:52.058461 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:52.066285 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0e54d-ec70-4132-9e0d-c635c0684f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:52.067001 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0e54d-ec70-4132-9e0d-c635c0684f21 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:52.068082 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0e54d-ec70-4132-9e0d-c635c0684f21 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:52.068575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0e54d-ec70-4132-9e0d-c635c0684f21 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:52.076270 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0e54d-ec70-4132-9e0d-c635c0684f21 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:52.077707 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0e54d-ec70-4132-9e0d-c635c0684f21 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:52.089761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-e4a0e54d-ec70-4132-9e0d-c635c0684f21 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:05:52.089761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:52.089761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:52.089761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:52.089761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:52.089761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:52.089761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:52.089761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:52.089761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:52.089761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:52.089761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:52.089761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:52.089761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:05:52.089761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:05:52.089761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:05:52.089761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:05:52.090791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:52.090791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:52.090791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:05:52.090791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:05:52.090791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:05:52.090791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:05:52.090791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:52.090791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:52.090791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:52.090791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:52.090791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:52.090791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:52.090791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:52.090791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:52.090791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:52.090791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:52.090791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:52.090791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:52.091764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:52.091764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:52.091764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:05:52.091764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:05:52.091764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:05:52.091764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:05:52.091764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:05:52.091764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:05:52.091764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:05:52.091764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:05:52.091764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 608/1253] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:52.096810 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc2550-34d8-4ab5-bc25-e4161ed9581f None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:52.156484 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:52.204156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc2550-34d8-4ab5-bc25-e4161ed9581f None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:52.240749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd5054-7206-4413-87e8-b73e910a36b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:52.241355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd5054-7206-4413-87e8-b73e910a36b0 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:52.241640 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd5054-7206-4413-87e8-b73e910a36b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:52.241963 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd5054-7206-4413-87e8-b73e910a36b0 None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:52.242703 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd5054-7206-4413-87e8-b73e910a36b0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:52.243014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd5054-7206-4413-87e8-b73e910a36b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:52.244449 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd5054-7206-4413-87e8-b73e910a36b0 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:52.261859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 646/1254] 10.222.0.79 () {56 vars in 1143 bytes} [Fri Sep 2 21:05:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:52.268189 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0e54d-ec70-4132-9e0d-c635c0684f21 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:52.375202 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0e54d-ec70-4132-9e0d-c635c0684f21 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:52.411785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5348a-b9c9-442a-8e64-38ed272bfb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:52.412408 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5348a-b9c9-442a-8e64-38ed272bfb15 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:52.412687 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5348a-b9c9-442a-8e64-38ed272bfb15 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:52.412966 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5348a-b9c9-442a-8e64-38ed272bfb15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:52.469119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:52.481896 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5348a-b9c9-442a-8e64-38ed272bfb15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:52.483340 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5348a-b9c9-442a-8e64-38ed272bfb15 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:52.585122 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 609/1255] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:05:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 02 21:05:52.591188 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd5054-7206-4413-87e8-b73e910a36b0 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:52.691400 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd5054-7206-4413-87e8-b73e910a36b0 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:52.707036 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:52.728652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3e041-7f3b-4b78-ae37-f0d9bc85b3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:52.729280 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3e041-7f3b-4b78-ae37-f0d9bc85b3af None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:52.729566 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3e041-7f3b-4b78-ae37-f0d9bc85b3af None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:52.729867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3e041-7f3b-4b78-ae37-f0d9bc85b3af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:52.740054 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3e041-7f3b-4b78-ae37-f0d9bc85b3af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:52.741509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3e041-7f3b-4b78-ae37-f0d9bc85b3af None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:52.756781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-85c3e041-7f3b-4b78-ae37-f0d9bc85b3af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:52.756781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:52.756781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:52.756781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:52.756781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:52.756781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:52.756781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:52.756781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:52.756781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:52.756781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:52.756781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:52.756781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:52.756781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:05:52.756781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:05:52.756781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:05:52.756781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:05:52.758073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:52.758073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:52.758073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:52.758073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:52.758073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:52.758073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:52.758073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:52.758073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:52.758073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:52.758073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:52.758073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:52.758073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:52.758073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:52.758073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:52.758073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:52.758073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:52.758073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:05:52.759540 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:05:52.759540 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:52.759540 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:05:52.759540 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 647/1256] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:52.763790 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5348a-b9c9-442a-8e64-38ed272bfb15 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:52.858410 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:52.870074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5348a-b9c9-442a-8e64-38ed272bfb15 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:52.904204 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cdc90-754b-4b57-98c0-6b8a506de664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:52.904815 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cdc90-754b-4b57-98c0-6b8a506de664 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:52.905098 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cdc90-754b-4b57-98c0-6b8a506de664 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:52.905371 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cdc90-754b-4b57-98c0-6b8a506de664 None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:52.906052 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668cdc90-754b-4b57-98c0-6b8a506de664 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:52.906357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668cdc90-754b-4b57-98c0-6b8a506de664 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:52.910269 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668cdc90-754b-4b57-98c0-6b8a506de664 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:52.919107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 610/1257] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:52.924972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3e041-7f3b-4b78-ae37-f0d9bc85b3af None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:53.028008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3e041-7f3b-4b78-ae37-f0d9bc85b3af None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:53.061483 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbd33e-3dd4-48f8-b114-c75f198dbf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:53.062132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbd33e-3dd4-48f8-b114-c75f198dbf0b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:53.062423 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbd33e-3dd4-48f8-b114-c75f198dbf0b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:53.062700 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbd33e-3dd4-48f8-b114-c75f198dbf0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:53.070102 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbd33e-3dd4-48f8-b114-c75f198dbf0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:53.071550 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbd33e-3dd4-48f8-b114-c75f198dbf0b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:53.082702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-77cbd33e-3dd4-48f8-b114-c75f198dbf0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:05:53.082702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:53.082702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:53.082702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:53.082702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:53.082702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:53.082702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:53.082702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:53.082702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:53.082702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:53.082702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:53.082702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:53.082702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:05:53.082702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:05:53.082702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:05:53.083834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:05:53.083834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:53.083834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:53.083834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:53.083834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:53.083834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:53.083834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:53.083834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:53.083834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:53.083834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:53.083834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:53.083834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:53.083834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:53.083834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:53.083834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:53.083834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:53.083834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:53.084812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:05:53.084812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:05:53.084812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:05:53.084812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:05:53.084812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:05:53.084812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:05:53.084812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:05:53.084812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:05:53.084812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 648/1258] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:05:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:53.090176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cdc90-754b-4b57-98c0-6b8a506de664 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:53.197520 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cdc90-754b-4b57-98c0-6b8a506de664 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:53.230135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7631a4-9a55-48c1-9a8b-96b2d9137119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:53.230737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7631a4-9a55-48c1-9a8b-96b2d9137119 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:53.231014 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7631a4-9a55-48c1-9a8b-96b2d9137119 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:53.231288 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7631a4-9a55-48c1-9a8b-96b2d9137119 None admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:53.231978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7631a4-9a55-48c1-9a8b-96b2d9137119 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:53.232285 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7631a4-9a55-48c1-9a8b-96b2d9137119 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:53.233724 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7631a4-9a55-48c1-9a8b-96b2d9137119 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:53.245937 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 611/1259] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:05:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:53.252359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbd33e-3dd4-48f8-b114-c75f198dbf0b None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:53.280251 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:53.354591 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbd33e-3dd4-48f8-b114-c75f198dbf0b None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:53.388070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b11e4-66cc-406e-b0bc-9244c839311c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:53.388671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b11e4-66cc-406e-b0bc-9244c839311c None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:53.388955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b11e4-66cc-406e-b0bc-9244c839311c None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:53.389234 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b11e4-66cc-406e-b0bc-9244c839311c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:53.389983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b11e4-66cc-406e-b0bc-9244c839311c None admin] RBAC: Adding query filter params (role.id=32e6a7f83b444d1ca9e5891a2b175f9a, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=aa0f9604ee2e43b4967cbdc779e63e71) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:53.390297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b11e4-66cc-406e-b0bc-9244c839311c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:53.391728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b11e4-66cc-406e-b0bc-9244c839311c None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:53.397345 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 649/1260] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:05:53 2022] GET /identity/v3/role_assignments?user.id=aa0f9604ee2e43b4967cbdc779e63e71&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=32e6a7f83b444d1ca9e5891a2b175f9a => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:55.298320 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820af60a-82e3-4fe4-b105-6a579a7ebe80 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:55.298878 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820af60a-82e3-4fe4-b105-6a579a7ebe80 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:55.298878 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820af60a-82e3-4fe4-b105-6a579a7ebe80 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:55.300215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 612/1261] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:05:55.306106 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40ce5a-d1a1-4a37-9360-986b1aed77da None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:55.306563 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40ce5a-d1a1-4a37-9360-986b1aed77da None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:55.306658 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40ce5a-d1a1-4a37-9360-986b1aed77da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:55.326394 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-8e40ce5a-d1a1-4a37-9360-986b1aed77da None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:05:55.327588 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-8e40ce5a-d1a1-4a37-9360-986b1aed77da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:05:55.397583 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 650/1262] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:05:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:05:55.669935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820af60a-82e3-4fe4-b105-6a579a7ebe80 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:55.681226 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:55.774692 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820af60a-82e3-4fe4-b105-6a579a7ebe80 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:55.808988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36c98e-6201-4f44-a62a-323253b11509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:55.809615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36c98e-6201-4f44-a62a-323253b11509 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:55.809928 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36c98e-6201-4f44-a62a-323253b11509 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:55.810209 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36c98e-6201-4f44-a62a-323253b11509 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:55.820475 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36c98e-6201-4f44-a62a-323253b11509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:05:55.825271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-3b36c98e-6201-4f44-a62a-323253b11509 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:05:55.825271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:55.825271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:55.825271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:55.825271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:55.825271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:55.825271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:55.825271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:55.825271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:55.825271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:55.825271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:55.825271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:55.825271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:05:55.825271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:05:55.825271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:05:55.825271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:05:55.826407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:05:55.826407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:05:55.826407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:05:55.826407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:05:55.826407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:55.826407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:55.826407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:55.826407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:55.826407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:55.826407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:55.826407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:55.826407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:55.826407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:55.826407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:55.826407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:55.826407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:55.827304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:55.827304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:55.827304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:55.827304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:55.827304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:05:55.827304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:05:55.827304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:05:55.827304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:05:55.827304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:05:55.827304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:05:55.827304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:05:55.827304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:05:55.827304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 613/1263] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:05:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:55.832630 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40ce5a-d1a1-4a37-9360-986b1aed77da None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:55.853059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:55.935034 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40ce5a-d1a1-4a37-9360-986b1aed77da None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:55.969618 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d15476-2ef3-44b9-8acc-315e18f604cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:55.970323 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d15476-2ef3-44b9-8acc-315e18f604cf None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:55.970604 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d15476-2ef3-44b9-8acc-315e18f604cf None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:55.970895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d15476-2ef3-44b9-8acc-315e18f604cf None admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:55.971544 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d15476-2ef3-44b9-8acc-315e18f604cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:55.971850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d15476-2ef3-44b9-8acc-315e18f604cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:55.978280 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d15476-2ef3-44b9-8acc-315e18f604cf None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:55.981749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 651/1264] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:05:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:55.987359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36c98e-6201-4f44-a62a-323253b11509 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:56.061477 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:56.096725 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36c98e-6201-4f44-a62a-323253b11509 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:56.141431 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae953a-9609-4527-ae6f-0e4e1b93dce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:56.142080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae953a-9609-4527-ae6f-0e4e1b93dce5 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:56.142366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae953a-9609-4527-ae6f-0e4e1b93dce5 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:56.142635 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae953a-9609-4527-ae6f-0e4e1b93dce5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:56.153793 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae953a-9609-4527-ae6f-0e4e1b93dce5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:56.155255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae953a-9609-4527-ae6f-0e4e1b93dce5 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:56.170457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-7cae953a-9609-4527-ae6f-0e4e1b93dce5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:56.170457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:56.170457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:56.170457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:56.170457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:56.170457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:56.170457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:56.170457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:56.170457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:56.170457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:56.170457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:56.170457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:56.170457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:05:56.170457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:05:56.170457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:05:56.170457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:05:56.171657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:56.171657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:56.171657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:56.171657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:56.171657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:56.171657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:56.171657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:56.171657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:56.171657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:56.171657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:56.171657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:56.171657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:56.171657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:56.171657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:56.171657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:56.171657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:56.171657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:05:56.172772 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:05:56.172772 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:56.172772 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:05:56.172772 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 614/1265] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:56.177683 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d15476-2ef3-44b9-8acc-315e18f604cf None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:56.259727 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:56.278999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d15476-2ef3-44b9-8acc-315e18f604cf None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:56.311333 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab12d67-1826-448f-8d11-51fdf42871ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:56.311983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab12d67-1826-448f-8d11-51fdf42871ae None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:56.312200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab12d67-1826-448f-8d11-51fdf42871ae None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:56.312462 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab12d67-1826-448f-8d11-51fdf42871ae None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:56.313219 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab12d67-1826-448f-8d11-51fdf42871ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:56.313500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab12d67-1826-448f-8d11-51fdf42871ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:56.314894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab12d67-1826-448f-8d11-51fdf42871ae None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:56.327608 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 652/1266] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:56.334017 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae953a-9609-4527-ae6f-0e4e1b93dce5 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:56.444408 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae953a-9609-4527-ae6f-0e4e1b93dce5 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:56.465917 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:56.480064 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b43d4b-d9e6-416a-a384-a457a941191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:56.480692 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b43d4b-d9e6-416a-a384-a457a941191b None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:56.480983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b43d4b-d9e6-416a-a384-a457a941191b None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:56.481250 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b43d4b-d9e6-416a-a384-a457a941191b None admin] PATH_INFO: `/v3/users/placement` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:56.488840 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b43d4b-d9e6-416a-a384-a457a941191b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:56.490707 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b43d4b-d9e6-416a-a384-a457a941191b None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:56.501860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-d5b43d4b-d9e6-416a-a384-a457a941191b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:05:56.501860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:56.501860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:56.501860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:56.501860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:56.501860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:56.501860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:56.501860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:56.501860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:56.501860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:56.501860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:56.501860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:56.501860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:05:56.501860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:05:56.501860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:05:56.501860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:05:56.503013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:56.503013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:56.503013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:05:56.503013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:05:56.503013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:05:56.503013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:05:56.503013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:56.503013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:56.503013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:56.503013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:56.503013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:56.503013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:56.503013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:56.503013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:56.503013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:56.503013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:56.503013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:56.503013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:56.504181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:56.504181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:56.504181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:05:56.504181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:05:56.504181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:05:56.504181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:05:56.504181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:05:56.504181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:05:56.504181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:05:56.504181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:05:56.505983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 615/1267] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:56.513020 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab12d67-1826-448f-8d11-51fdf42871ae None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:56.609893 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab12d67-1826-448f-8d11-51fdf42871ae None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:56.644593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fb248-89e0-4ee1-835d-b463c2624ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:56.645981 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fb248-89e0-4ee1-835d-b463c2624ba9 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:56.646206 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fb248-89e0-4ee1-835d-b463c2624ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:56.646479 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fb248-89e0-4ee1-835d-b463c2624ba9 None admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:56.647195 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fb248-89e0-4ee1-835d-b463c2624ba9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:56.647502 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fb248-89e0-4ee1-835d-b463c2624ba9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:56.648931 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fb248-89e0-4ee1-835d-b463c2624ba9 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:56.657695 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:56.666012 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 653/1268] 10.222.0.79 () {56 vars in 1143 bytes} [Fri Sep 2 21:05:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:56.671893 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b43d4b-d9e6-416a-a384-a457a941191b None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:56.774526 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b43d4b-d9e6-416a-a384-a457a941191b None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:56.810937 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca177e-af2f-4178-9240-2de41e27dd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:56.816982 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca177e-af2f-4178-9240-2de41e27dd15 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:56.816982 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca177e-af2f-4178-9240-2de41e27dd15 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:56.816982 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca177e-af2f-4178-9240-2de41e27dd15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:56.824138 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca177e-af2f-4178-9240-2de41e27dd15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:56.825637 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca177e-af2f-4178-9240-2de41e27dd15 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:56.842218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-9eca177e-af2f-4178-9240-2de41e27dd15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:56.842218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:56.842218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:56.842218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:56.842218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:56.842218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:56.842218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:56.842218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:56.842218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:56.842218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:56.842218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:56.842218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:56.842218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:05:56.842218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:05:56.842218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:05:56.842218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:05:56.851254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:56.851254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:56.851254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:56.851254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:56.851254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:56.851254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:56.851254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:56.851254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:56.851254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:56.851254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:56.851254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:56.851254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:56.851254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:56.851254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:56.851254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:56.851254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:56.851254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:05:56.852530 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:05:56.852530 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:05:56.852530 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:05:56.852530 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 616/1269] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:56.852819 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fb248-89e0-4ee1-835d-b463c2624ba9 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:56.951791 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fb248-89e0-4ee1-835d-b463c2624ba9 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:56.984525 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e3b1f-1407-40d3-b382-9ff6cfff3735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:56.985119 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e3b1f-1407-40d3-b382-9ff6cfff3735 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:56.985399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e3b1f-1407-40d3-b382-9ff6cfff3735 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:56.985675 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e3b1f-1407-40d3-b382-9ff6cfff3735 None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:56.986334 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e3b1f-1407-40d3-b382-9ff6cfff3735 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:56.986640 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e3b1f-1407-40d3-b382-9ff6cfff3735 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:56.988031 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e3b1f-1407-40d3-b382-9ff6cfff3735 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:56.999711 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 654/1270] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:57.006183 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca177e-af2f-4178-9240-2de41e27dd15 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:57.038131 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:57.105281 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca177e-af2f-4178-9240-2de41e27dd15 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:57.140603 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c6bae-70e5-43c2-a404-7958af8e52e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:57.141250 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c6bae-70e5-43c2-a404-7958af8e52e8 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:57.141535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c6bae-70e5-43c2-a404-7958af8e52e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:57.141797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c6bae-70e5-43c2-a404-7958af8e52e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:57.149610 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c6bae-70e5-43c2-a404-7958af8e52e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:57.153720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c6bae-70e5-43c2-a404-7958af8e52e8 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:57.164978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-2b2c6bae-70e5-43c2-a404-7958af8e52e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:05:57.164978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:05:57.164978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:05:57.164978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:05:57.164978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:05:57.164978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:05:57.164978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:05:57.164978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:05:57.164978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:05:57.164978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:05:57.164978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:05:57.164978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:05:57.164978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:05:57.164978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:05:57.164978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:05:57.170593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:05:57.170593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:05:57.170593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:05:57.170593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:05:57.170593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:05:57.170593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:05:57.170593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:05:57.170593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:05:57.170593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:05:57.170593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:05:57.170593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:05:57.170593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:05:57.170593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:05:57.170593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:05:57.170593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:05:57.170593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:05:57.170593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:05:57.172494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:05:57.172494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:05:57.172494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:05:57.172494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:05:57.172494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:05:57.172494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:05:57.172494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:05:57.172494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:05:57.172494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 617/1271] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:05:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:05:57.173678 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e3b1f-1407-40d3-b382-9ff6cfff3735 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:57.244680 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:57.285244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e3b1f-1407-40d3-b382-9ff6cfff3735 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:57.323301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839ce78-9bad-4484-9cd0-2d2bb1a62cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:57.323935 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839ce78-9bad-4484-9cd0-2d2bb1a62cae None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:57.324122 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839ce78-9bad-4484-9cd0-2d2bb1a62cae None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:57.324399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839ce78-9bad-4484-9cd0-2d2bb1a62cae None admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:57.325125 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839ce78-9bad-4484-9cd0-2d2bb1a62cae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:05:57.325435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839ce78-9bad-4484-9cd0-2d2bb1a62cae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:57.326907 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839ce78-9bad-4484-9cd0-2d2bb1a62cae None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:57.339264 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 655/1272] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:05:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:05:57.345606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c6bae-70e5-43c2-a404-7958af8e52e8 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:57.442104 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:05:57.451237 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c6bae-70e5-43c2-a404-7958af8e52e8 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:57.486722 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3da5e-cf37-429b-83fd-f4e61523d522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:05:57.487372 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3da5e-cf37-429b-83fd-f4e61523d522 None admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:57.487656 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3da5e-cf37-429b-83fd-f4e61523d522 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:57.487933 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3da5e-cf37-429b-83fd-f4e61523d522 None admin] PATH_INFO: `/v3/projects/61c5f56764934c4a90ad38357b46f397/users/aa0f9604ee2e43b4967cbdc779e63e71/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:57.490039 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3da5e-cf37-429b-83fd-f4e61523d522 None admin] RBAC: Authorizing `identity:create_grant(project_id=61c5f56764934c4a90ad38357b46f397, user_id=aa0f9604ee2e43b4967cbdc779e63e71, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:05:57.491505 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3da5e-cf37-429b-83fd-f4e61523d522 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:05:57.577847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 618/1273] 10.222.0.79 () {58 vars in 1439 bytes} [Fri Sep 2 21:05:57 2022] PUT /identity/v3/projects/61c5f56764934c4a90ad38357b46f397/users/aa0f9604ee2e43b4967cbdc779e63e71/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:05:59.498357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a23e52-8dd2-4122-be4c-a7bc0ac7a02c None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:59.498918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a23e52-8dd2-4122-be4c-a7bc0ac7a02c None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:59.498918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a23e52-8dd2-4122-be4c-a7bc0ac7a02c None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:59.500251 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 656/1274] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:05:59.506053 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97273a-b24c-4955-ac46-3d3a9ded4d27 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:05:59.506487 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97273a-b24c-4955-ac46-3d3a9ded4d27 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:05:59.506605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97273a-b24c-4955-ac46-3d3a9ded4d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:05:59.525638 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-8b97273a-b24c-4955-ac46-3d3a9ded4d27 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:05:59.526866 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8b97273a-b24c-4955-ac46-3d3a9ded4d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:05:59.595039 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 619/1275] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:05:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:05:59.870554 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a23e52-8dd2-4122-be4c-a7bc0ac7a02c None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:05:59.981008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a23e52-8dd2-4122-be4c-a7bc0ac7a02c None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:05:59.998214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:00.015495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d24363-6b05-4f9c-998b-460149471bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:00.016086 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d24363-6b05-4f9c-998b-460149471bc5 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:00.016371 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d24363-6b05-4f9c-998b-460149471bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:00.016648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d24363-6b05-4f9c-998b-460149471bc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:00.027094 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d24363-6b05-4f9c-998b-460149471bc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 02 21:06:00.031960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-13d24363-6b05-4f9c-998b-460149471bc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:06:00.031960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:00.031960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:06:00.031960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:06:00.031960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:06:00.031960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:06:00.031960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:06:00.031960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:06:00.031960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:06:00.031960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:06:00.031960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:06:00.031960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:06:00.031960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 02 21:06:00.031960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 02 21:06:00.031960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 02 21:06:00.031960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 02 21:06:00.033139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 02 21:06:00.033139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 02 21:06:00.033139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 02 21:06:00.033139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 02 21:06:00.033139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:06:00.033139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:06:00.033139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:06:00.033139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:06:00.033139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:06:00.033139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:06:00.033139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:06:00.033139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:06:00.033139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:06:00.033139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:06:00.033139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:06:00.033139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:06:00.034244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:06:00.034244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:06:00.034244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:06:00.034244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:06:00.034244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 02 21:06:00.034244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 02 21:06:00.034244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 02 21:06:00.034244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 02 21:06:00.034244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 02 21:06:00.034244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 02 21:06:00.034244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 02 21:06:00.034244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:06:00.034244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 657/1276] 10.222.0.79 () {56 vars in 1096 bytes} [Fri Sep 2 21:05:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:06:00.040251 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97273a-b24c-4955-ac46-3d3a9ded4d27 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:00.121969 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:00.139969 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97273a-b24c-4955-ac46-3d3a9ded4d27 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:00.174626 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199b599-c940-46e8-99c3-617a4720bacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:00.175230 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199b599-c940-46e8-99c3-617a4720bacc None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:00.175510 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199b599-c940-46e8-99c3-617a4720bacc None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:00.175792 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199b599-c940-46e8-99c3-617a4720bacc None admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:00.177226 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199b599-c940-46e8-99c3-617a4720bacc None admin] RBAC: Adding query filter params (name=admin) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:00.177531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199b599-c940-46e8-99c3-617a4720bacc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:00.178919 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199b599-c940-46e8-99c3-617a4720bacc None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:00.186828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 620/1277] 10.222.0.79 () {56 vars in 1099 bytes} [Fri Sep 2 21:06:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:06:00.193152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d24363-6b05-4f9c-998b-460149471bc5 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:00.294583 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d24363-6b05-4f9c-998b-460149471bc5 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:00.330493 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad37c65-8d79-48ef-9d5c-48aa4e161fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:00.331124 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad37c65-8d79-48ef-9d5c-48aa4e161fec None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:00.331407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad37c65-8d79-48ef-9d5c-48aa4e161fec None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:00.331682 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad37c65-8d79-48ef-9d5c-48aa4e161fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:00.342325 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad37c65-8d79-48ef-9d5c-48aa4e161fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:00.343788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad37c65-8d79-48ef-9d5c-48aa4e161fec None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:00.361104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-4ad37c65-8d79-48ef-9d5c-48aa4e161fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:06:00.361104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:00.361104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:06:00.361104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:06:00.361104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:06:00.361104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:06:00.361104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:06:00.361104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:06:00.361104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:06:00.361104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:06:00.361104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:06:00.361104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:06:00.361104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:06:00.361104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:06:00.361104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:06:00.361104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:06:00.362846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:06:00.362846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:06:00.362846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:06:00.362846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:06:00.362846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:06:00.362846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:06:00.362846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:06:00.362846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:06:00.362846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:06:00.362846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:06:00.362846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:06:00.362846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:06:00.362846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:06:00.362846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:06:00.362846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:06:00.362846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:06:00.362846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:06:00.364482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:06:00.364482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:06:00.364482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:06:00.364482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 658/1278] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:06:00.369159 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199b599-c940-46e8-99c3-617a4720bacc None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:00.475071 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199b599-c940-46e8-99c3-617a4720bacc None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:00.509523 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1a00e-180c-42b8-b7c7-cdf53eb2c301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:00.510179 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1a00e-180c-42b8-b7c7-cdf53eb2c301 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:00.510443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1a00e-180c-42b8-b7c7-cdf53eb2c301 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:00.510720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1a00e-180c-42b8-b7c7-cdf53eb2c301 None admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:00.511371 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1a00e-180c-42b8-b7c7-cdf53eb2c301 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:00.511679 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1a00e-180c-42b8-b7c7-cdf53eb2c301 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:00.513040 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1a00e-180c-42b8-b7c7-cdf53eb2c301 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:00.525285 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 621/1279] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:06:00.531083 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad37c65-8d79-48ef-9d5c-48aa4e161fec None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:00.562273 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:00.630952 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad37c65-8d79-48ef-9d5c-48aa4e161fec None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:00.665139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678e127-c2fd-4fcd-a0c0-ba9b509e6d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:00.665777 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678e127-c2fd-4fcd-a0c0-ba9b509e6d4f None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:00.666093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678e127-c2fd-4fcd-a0c0-ba9b509e6d4f None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:00.666375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678e127-c2fd-4fcd-a0c0-ba9b509e6d4f None admin] PATH_INFO: `/v3/users/placement` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:00.673979 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678e127-c2fd-4fcd-a0c0-ba9b509e6d4f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:00.677071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678e127-c2fd-4fcd-a0c0-ba9b509e6d4f None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:00.687023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-5678e127-c2fd-4fcd-a0c0-ba9b509e6d4f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:06:00.687023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:00.687023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:06:00.687023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:06:00.687023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:06:00.687023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:06:00.687023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:06:00.687023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:06:00.687023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:06:00.687023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:06:00.687023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:06:00.687023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:06:00.687023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 02 21:06:00.687023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 02 21:06:00.687023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 02 21:06:00.687023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 02 21:06:00.688002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:06:00.688002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:06:00.688002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 02 21:06:00.688002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:06:00.688002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 02 21:06:00.688002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 02 21:06:00.688002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:06:00.688002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:06:00.688002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:06:00.688002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:06:00.688002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:06:00.688002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:06:00.688002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:06:00.688002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:06:00.688002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:06:00.688002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:06:00.688002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:06:00.688002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:06:00.689079 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:06:00.689079 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:06:00.689079 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 02 21:06:00.689079 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 02 21:06:00.689079 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 02 21:06:00.689079 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 02 21:06:00.689079 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 02 21:06:00.689079 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 02 21:06:00.689079 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 02 21:06:00.689079 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:06:00.689079 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 659/1280] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:06:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:06:00.694365 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1a00e-180c-42b8-b7c7-cdf53eb2c301 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:00.698256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:00.794548 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1a00e-180c-42b8-b7c7-cdf53eb2c301 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:00.828657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36503e7a-f2da-4071-84b5-f7d8f10ac537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:00.829261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36503e7a-f2da-4071-84b5-f7d8f10ac537 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:00.829546 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36503e7a-f2da-4071-84b5-f7d8f10ac537 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:00.829843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36503e7a-f2da-4071-84b5-f7d8f10ac537 None admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:00.830582 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36503e7a-f2da-4071-84b5-f7d8f10ac537 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:00.830901 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36503e7a-f2da-4071-84b5-f7d8f10ac537 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:00.832470 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36503e7a-f2da-4071-84b5-f7d8f10ac537 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:00.850761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 622/1281] 10.222.0.79 () {56 vars in 1143 bytes} [Fri Sep 2 21:06:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:06:00.856800 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678e127-c2fd-4fcd-a0c0-ba9b509e6d4f None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:00.951233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:00.960925 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678e127-c2fd-4fcd-a0c0-ba9b509e6d4f None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:00.995496 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd9b2e-b6ae-415a-8abb-2e70b1af5c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:00.996139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd9b2e-b6ae-415a-8abb-2e70b1af5c01 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:00.996427 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd9b2e-b6ae-415a-8abb-2e70b1af5c01 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:00.996703 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd9b2e-b6ae-415a-8abb-2e70b1af5c01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:01.065508 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd9b2e-b6ae-415a-8abb-2e70b1af5c01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:01.066941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd9b2e-b6ae-415a-8abb-2e70b1af5c01 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:01.155348 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:01.166269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 660/1282] 10.222.0.79 () {58 vars in 1282 bytes} [Fri Sep 2 21:06:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 02 21:06:01.172262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36503e7a-f2da-4071-84b5-f7d8f10ac537 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:01.243869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:01.281732 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36503e7a-f2da-4071-84b5-f7d8f10ac537 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:01.315687 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c05b3f-b757-4f07-9dd5-37656db35991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:01.316240 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c05b3f-b757-4f07-9dd5-37656db35991 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:01.316522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c05b3f-b757-4f07-9dd5-37656db35991 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:01.316798 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c05b3f-b757-4f07-9dd5-37656db35991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:01.326808 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c05b3f-b757-4f07-9dd5-37656db35991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:01.328246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c05b3f-b757-4f07-9dd5-37656db35991 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:01.342841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-f4c05b3f-b757-4f07-9dd5-37656db35991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:06:01.342841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:01.342841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:06:01.342841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:06:01.342841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:06:01.342841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:06:01.342841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:06:01.342841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:06:01.342841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:06:01.342841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:06:01.342841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:06:01.342841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:06:01.342841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 02 21:06:01.342841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 02 21:06:01.342841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 02 21:06:01.342841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 02 21:06:01.343988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:06:01.343988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:06:01.343988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:06:01.343988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:06:01.343988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:06:01.343988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:06:01.343988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:06:01.343988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:06:01.343988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:06:01.343988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:06:01.343988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:06:01.343988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:06:01.343988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:06:01.343988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:06:01.343988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:06:01.343988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:06:01.343988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 02 21:06:01.345119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 02 21:06:01.345119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 02 21:06:01.345119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:06:01.345119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 623/1283] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 02 21:06:01.352248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd9b2e-b6ae-415a-8abb-2e70b1af5c01 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:01.454371 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd9b2e-b6ae-415a-8abb-2e70b1af5c01 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:01.489522 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355d5d5-a4ac-4f09-8de0-389dbb6ce1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:01.490153 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355d5d5-a4ac-4f09-8de0-389dbb6ce1ee None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:01.490441 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355d5d5-a4ac-4f09-8de0-389dbb6ce1ee None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:01.490718 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355d5d5-a4ac-4f09-8de0-389dbb6ce1ee None admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:01.491357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355d5d5-a4ac-4f09-8de0-389dbb6ce1ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:01.491662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355d5d5-a4ac-4f09-8de0-389dbb6ce1ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:01.493027 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355d5d5-a4ac-4f09-8de0-389dbb6ce1ee None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:01.504787 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 661/1284] 10.222.0.79 () {56 vars in 1109 bytes} [Fri Sep 2 21:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:06:01.511162 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c05b3f-b757-4f07-9dd5-37656db35991 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:01.614024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c05b3f-b757-4f07-9dd5-37656db35991 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:01.627552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:01.647773 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca01d2-3d90-4f41-afc3-d5b57488dbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:01.648400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca01d2-3d90-4f41-afc3-d5b57488dbf9 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:01.648685 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca01d2-3d90-4f41-afc3-d5b57488dbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:01.648963 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca01d2-3d90-4f41-afc3-d5b57488dbf9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:01.655752 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca01d2-3d90-4f41-afc3-d5b57488dbf9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:01.657197 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca01d2-3d90-4f41-afc3-d5b57488dbf9 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:01.670994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application [None req-c2ca01d2-3d90-4f41-afc3-d5b57488dbf9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:06:01.670994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:01.670994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:06:01.670994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:06:01.670994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:06:01.670994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:06:01.670994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:06:01.670994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:06:01.670994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:06:01.670994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:06:01.670994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:06:01.670994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:06:01.670994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 02 21:06:01.670994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 02 21:06:01.670994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 02 21:06:01.672125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 02 21:06:01.672125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:06:01.672125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:06:01.672125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:06:01.672125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:06:01.672125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:06:01.672125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:06:01.672125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:06:01.672125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application with Lock( Sep 02 21:06:01.672125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:06:01.672125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:06:01.672125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:06:01.672125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:06:01.672125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:06:01.672125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:06:01.672125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:06:01.672125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:06:01.673337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 02 21:06:01.673337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 02 21:06:01.673337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 02 21:06:01.673337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 02 21:06:01.673337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 02 21:06:01.673337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 02 21:06:01.673337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 02 21:06:01.673337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: ERROR keystone.server.flask.application Sep 02 21:06:01.673337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 624/1285] 10.222.0.79 () {56 vars in 1111 bytes} [Fri Sep 2 21:06:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:06:01.678795 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355d5d5-a4ac-4f09-8de0-389dbb6ce1ee None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:01.735989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:01.787941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355d5d5-a4ac-4f09-8de0-389dbb6ce1ee None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:01.821051 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3fc75c-8001-4b74-8900-b48b260ea8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:01.821651 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fc75c-8001-4b74-8900-b48b260ea8a5 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:01.821978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fc75c-8001-4b74-8900-b48b260ea8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:01.822256 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fc75c-8001-4b74-8900-b48b260ea8a5 None admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:01.822944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3fc75c-8001-4b74-8900-b48b260ea8a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:01.823250 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3fc75c-8001-4b74-8900-b48b260ea8a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:01.824690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3fc75c-8001-4b74-8900-b48b260ea8a5 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:01.836880 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 662/1286] 10.222.0.79 () {56 vars in 1148 bytes} [Fri Sep 2 21:06:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:06:01.843040 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca01d2-3d90-4f41-afc3-d5b57488dbf9 None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:01.952032 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca01d2-3d90-4f41-afc3-d5b57488dbf9 None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:01.998653 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69870e4c-ff98-4f54-9036-cd889b2d9ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:01.999837 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69870e4c-ff98-4f54-9036-cd889b2d9ce6 None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:02.000114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69870e4c-ff98-4f54-9036-cd889b2d9ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:02.000384 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69870e4c-ff98-4f54-9036-cd889b2d9ce6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:02.001177 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69870e4c-ff98-4f54-9036-cd889b2d9ce6 None admin] RBAC: Adding query filter params (role.id=32e6a7f83b444d1ca9e5891a2b175f9a, scope.project.id=61c5f56764934c4a90ad38357b46f397, user.id=aa0f9604ee2e43b4967cbdc779e63e71) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:02.001486 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69870e4c-ff98-4f54-9036-cd889b2d9ce6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:02.002972 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69870e4c-ff98-4f54-9036-cd889b2d9ce6 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:02.009327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 625/1287] 10.222.0.79 () {56 vars in 1374 bytes} [Fri Sep 2 21:06:01 2022] GET /identity/v3/role_assignments?user.id=aa0f9604ee2e43b4967cbdc779e63e71&scope.project.id=61c5f56764934c4a90ad38357b46f397&role.id=32e6a7f83b444d1ca9e5891a2b175f9a => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:06:03.988003 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51b2ce-0d22-4b6b-b4ee-3663b46b82e1 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:03.988523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51b2ce-0d22-4b6b-b4ee-3663b46b82e1 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:03.988640 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51b2ce-0d22-4b6b-b4ee-3663b46b82e1 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:03.989954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 663/1288] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:06:03.995160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fced0-c416-431d-adb1-a738ab1433db None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:03.995591 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fced0-c416-431d-adb1-a738ab1433db None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:03.995807 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fced0-c416-431d-adb1-a738ab1433db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:04.014725 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-2d8fced0-c416-431d-adb1-a738ab1433db None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:06:04.015921 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-2d8fced0-c416-431d-adb1-a738ab1433db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:06:04.046047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:04.082808 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 626/1289] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:06:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:06:04.358667 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51b2ce-0d22-4b6b-b4ee-3663b46b82e1 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:04.467302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51b2ce-0d22-4b6b-b4ee-3663b46b82e1 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:04.480000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:04.504426 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9526acb-16a0-4941-be6c-e90444ec899b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:04.505054 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9526acb-16a0-4941-be6c-e90444ec899b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:04.505329 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9526acb-16a0-4941-be6c-e90444ec899b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:04.505599 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9526acb-16a0-4941-be6c-e90444ec899b None admin] PATH_INFO: `/v3/services/placement` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:04.506207 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9526acb-16a0-4941-be6c-e90444ec899b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:04.507622 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9526acb-16a0-4941-be6c-e90444ec899b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:04.516259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-f9526acb-16a0-4941-be6c-e90444ec899b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 21:06:04.516259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:04.516259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:06:04.516259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:06:04.516259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:06:04.516259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:06:04.516259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:06:04.516259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:06:04.516259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 21:06:04.516259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:06:04.516259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:06:04.516259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:06:04.516259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:04.516259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:06:04.516259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:06:04.516259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:06:04.516259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:06:04.517374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:06:04.517374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:06:04.517374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:06:04.517374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:06:04.517374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:06:04.517374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:06:04.517374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:06:04.517374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:06:04.517374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:06:04.517374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:06:04.517374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:06:04.517374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:06:04.517374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:06:04.517374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:06:04.517374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:06:04.517374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:06:04.518409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:06:04.518409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:06:04.518409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:06:04.518409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:06:04.518409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:06:04.518409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:06:04.518409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:06:04.518409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:06:04.518409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:06:04.518409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:06:04.518409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:06:04.518409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:06:04.518409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 21:06:04.518409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:06:04.518409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 664/1290] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Sep 2 21:06:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:06:04.523787 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fced0-c416-431d-adb1-a738ab1433db None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:04.625644 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fced0-c416-431d-adb1-a738ab1433db None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:04.660885 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2850d-1ae9-422a-b06e-8f069766f42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:04.661716 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2850d-1ae9-422a-b06e-8f069766f42b None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:04.662030 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2850d-1ae9-422a-b06e-8f069766f42b None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:04.662312 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2850d-1ae9-422a-b06e-8f069766f42b None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:04.662960 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2850d-1ae9-422a-b06e-8f069766f42b None admin] RBAC: Adding query filter params (name=placement) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:04.663267 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2850d-1ae9-422a-b06e-8f069766f42b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:04.664633 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2850d-1ae9-422a-b06e-8f069766f42b None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:04.669556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 627/1291] 10.222.0.79 () {56 vars in 1116 bytes} [Fri Sep 2 21:06:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:06:04.675376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9526acb-16a0-4941-be6c-e90444ec899b None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:04.779238 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9526acb-16a0-4941-be6c-e90444ec899b None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:04.813633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b86bd-2c84-42cb-9887-741108da993b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:04.814276 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b86bd-2c84-42cb-9887-741108da993b None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:04.814564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b86bd-2c84-42cb-9887-741108da993b None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:04.814844 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b86bd-2c84-42cb-9887-741108da993b None admin] PATH_INFO: `/v3/services` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:04.815477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b86bd-2c84-42cb-9887-741108da993b None admin] RBAC: Adding query filter params (type=placement) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:04.815790 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b86bd-2c84-42cb-9887-741108da993b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:04.817525 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b86bd-2c84-42cb-9887-741108da993b None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:04.822006 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 665/1292] 10.222.0.79 () {56 vars in 1116 bytes} [Fri Sep 2 21:06:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:06:06.772575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75836d38-281d-4336-8b01-31e8d125b112 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:06.773174 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75836d38-281d-4336-8b01-31e8d125b112 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:06.773174 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75836d38-281d-4336-8b01-31e8d125b112 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:06.774532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 628/1293] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:06:06.779806 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38da9a4-e985-47a0-9f29-26ed1ced6352 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:06.783017 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38da9a4-e985-47a0-9f29-26ed1ced6352 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:06.783017 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38da9a4-e985-47a0-9f29-26ed1ced6352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:06.799236 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-e38da9a4-e985-47a0-9f29-26ed1ced6352 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:06:06.800499 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-e38da9a4-e985-47a0-9f29-26ed1ced6352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:06:06.832780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:06.871213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 666/1294] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:06:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 02 21:06:07.142034 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75836d38-281d-4336-8b01-31e8d125b112 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:07.174761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:07.251562 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75836d38-281d-4336-8b01-31e8d125b112 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:07.289341 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746bb7c-1c9a-40bf-9407-e55a9169e986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:07.290068 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746bb7c-1c9a-40bf-9407-e55a9169e986 None admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:07.290352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746bb7c-1c9a-40bf-9407-e55a9169e986 None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:07.290632 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746bb7c-1c9a-40bf-9407-e55a9169e986 None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:07.291416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746bb7c-1c9a-40bf-9407-e55a9169e986 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:07.293031 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746bb7c-1c9a-40bf-9407-e55a9169e986 None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:07.378201 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 629/1295] 10.222.0.79 () {60 vars in 1141 bytes} [Fri Sep 2 21:06:07 2022] POST /identity/v3/services => generated 246 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:06:09.352703 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1d71f-2da6-4766-87d5-40c17eaa47c6 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:09.353261 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1d71f-2da6-4766-87d5-40c17eaa47c6 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:09.353261 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1d71f-2da6-4766-87d5-40c17eaa47c6 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:09.354904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 667/1296] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:06:09.360205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3902565-baf4-40e2-a89c-ff4143695f42 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:09.360640 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3902565-baf4-40e2-a89c-ff4143695f42 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:09.360776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3902565-baf4-40e2-a89c-ff4143695f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:09.380527 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-b3902565-baf4-40e2-a89c-ff4143695f42 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:06:09.381745 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-b3902565-baf4-40e2-a89c-ff4143695f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:06:09.458648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 630/1297] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:06:09 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:06:09.738272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1d71f-2da6-4766-87d5-40c17eaa47c6 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:09.843212 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1d71f-2da6-4766-87d5-40c17eaa47c6 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:09.877123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe278a-d0a6-4364-9cb0-edec3e77a38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:09.877772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe278a-d0a6-4364-9cb0-edec3e77a38a None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:09.878069 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe278a-d0a6-4364-9cb0-edec3e77a38a None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:09.878864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe278a-d0a6-4364-9cb0-edec3e77a38a None admin] PATH_INFO: `/v3/services/placement` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:09.879490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe278a-d0a6-4364-9cb0-edec3e77a38a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:09.880859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe278a-d0a6-4364-9cb0-edec3e77a38a None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:09.889581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-9abe278a-d0a6-4364-9cb0-edec3e77a38a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 21:06:09.889581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:09.889581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:06:09.889581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:06:09.889581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:06:09.889581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:06:09.889581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:06:09.889581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:06:09.889581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 21:06:09.889581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:06:09.889581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:06:09.889581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:06:09.889581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:09.889581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:06:09.889581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:06:09.889581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:06:09.889581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:06:09.890943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:06:09.890943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:06:09.890943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:06:09.890943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:06:09.890943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:06:09.890943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:06:09.890943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:06:09.890943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:06:09.890943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:06:09.890943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:06:09.890943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:06:09.890943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:06:09.890943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:06:09.890943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:06:09.890943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:06:09.890943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:06:09.892023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:06:09.892023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:06:09.892023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:06:09.892023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:06:09.892023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:06:09.892023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:06:09.892023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:06:09.892023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:06:09.892023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:06:09.892023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:06:09.892023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:06:09.892023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:06:09.892023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 21:06:09.892023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:06:09.892023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 668/1298] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Sep 2 21:06:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:06:09.897441 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3902565-baf4-40e2-a89c-ff4143695f42 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:09.918107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:09.999125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3902565-baf4-40e2-a89c-ff4143695f42 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:10.035541 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5b0a1-6850-4234-a4b2-3eec23751fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:10.036170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5b0a1-6850-4234-a4b2-3eec23751fca None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:10.036436 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5b0a1-6850-4234-a4b2-3eec23751fca None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:10.036709 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5b0a1-6850-4234-a4b2-3eec23751fca None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:10.037367 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5b0a1-6850-4234-a4b2-3eec23751fca None admin] RBAC: Adding query filter params (name=placement) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:10.037669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5b0a1-6850-4234-a4b2-3eec23751fca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:10.039126 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5b0a1-6850-4234-a4b2-3eec23751fca None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:10.044979 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 631/1299] 10.222.0.79 () {56 vars in 1116 bytes} [Fri Sep 2 21:06:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:06:10.051525 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe278a-d0a6-4364-9cb0-edec3e77a38a None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:10.087312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:10.166922 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe278a-d0a6-4364-9cb0-edec3e77a38a None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:10.211232 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fc950-682c-4664-a79c-ecb5ea3f39a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:10.211953 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fc950-682c-4664-a79c-ecb5ea3f39a0 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:10.212157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fc950-682c-4664-a79c-ecb5ea3f39a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:10.212435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fc950-682c-4664-a79c-ecb5ea3f39a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:10.213154 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fc950-682c-4664-a79c-ecb5ea3f39a0 None admin] RBAC: Adding query filter params (interface=public, service_id=039d733e37db42bead029ef1ea66d43b, region_id=RegionOne) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:10.213471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fc950-682c-4664-a79c-ecb5ea3f39a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:10.214916 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fc950-682c-4664-a79c-ecb5ea3f39a0 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:10.220908 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 669/1300] 10.222.0.79 () {56 vars in 1251 bytes} [Fri Sep 2 21:06:10 2022] GET /identity/v3/endpoints?service_id=039d733e37db42bead029ef1ea66d43b&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:06:10.226981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5b0a1-6850-4234-a4b2-3eec23751fca None admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:10.322243 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:10.343775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5b0a1-6850-4234-a4b2-3eec23751fca None admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:10.384613 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715cb50-a67a-46a4-ae50-a17e3ded591c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:10.385285 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715cb50-a67a-46a4-ae50-a17e3ded591c None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:10.385498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715cb50-a67a-46a4-ae50-a17e3ded591c None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:10.385770 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715cb50-a67a-46a4-ae50-a17e3ded591c None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:10.386449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715cb50-a67a-46a4-ae50-a17e3ded591c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:10.387828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715cb50-a67a-46a4-ae50-a17e3ded591c None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:10.395888 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 632/1301] 10.222.0.79 () {56 vars in 1087 bytes} [Fri Sep 2 21:06:10 2022] GET /identity/v3/services => generated 2191 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:06:12.330899 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7b506-07ea-4e61-a973-186738261c41 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:12.331534 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7b506-07ea-4e61-a973-186738261c41 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:12.331764 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7b506-07ea-4e61-a973-186738261c41 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:12.333275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 670/1302] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:06:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:06:12.338783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75ad11-4a20-4b2e-a81e-a3e6243481dd None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:12.339329 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75ad11-4a20-4b2e-a81e-a3e6243481dd None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:12.339329 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75ad11-4a20-4b2e-a81e-a3e6243481dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:12.358294 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-9f75ad11-4a20-4b2e-a81e-a3e6243481dd None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:06:12.359501 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-9f75ad11-4a20-4b2e-a81e-a3e6243481dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:06:12.443440 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 633/1303] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:06:12 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 02 21:06:12.714279 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7b506-07ea-4e61-a973-186738261c41 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:12.824228 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:12.830827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7b506-07ea-4e61-a973-186738261c41 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:12.865090 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f252d1-0a2f-43ed-8552-1ffc1c686222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:12.865715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f252d1-0a2f-43ed-8552-1ffc1c686222 None admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:12.866022 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f252d1-0a2f-43ed-8552-1ffc1c686222 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:12.866295 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f252d1-0a2f-43ed-8552-1ffc1c686222 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:12.866874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f252d1-0a2f-43ed-8552-1ffc1c686222 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:12.868268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f252d1-0a2f-43ed-8552-1ffc1c686222 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:12.876690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application [None req-e4f252d1-0a2f-43ed-8552-1ffc1c686222 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 21:06:12.876690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:12.876690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 02 21:06:12.876690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 02 21:06:12.876690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 02 21:06:12.876690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 02 21:06:12.876690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 02 21:06:12.876690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:06:12.876690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 21:06:12.876690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:06:12.876690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 02 21:06:12.876690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:06:12.876690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 02 21:06:12.876690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 02 21:06:12.876690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 02 21:06:12.876690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 02 21:06:12.876690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 02 21:06:12.877802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 02 21:06:12.877802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 02 21:06:12.877802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 02 21:06:12.877802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 02 21:06:12.877802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 02 21:06:12.877802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 02 21:06:12.877802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 02 21:06:12.877802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 02 21:06:12.877802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 02 21:06:12.877802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 02 21:06:12.877802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 02 21:06:12.877802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 02 21:06:12.877802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 02 21:06:12.877802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 02 21:06:12.877802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 02 21:06:12.877802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.get_or_create( Sep 02 21:06:12.879223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 02 21:06:12.879223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application with Lock( Sep 02 21:06:12.879223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 02 21:06:12.879223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self._enter() Sep 02 21:06:12.879223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 02 21:06:12.879223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 02 21:06:12.879223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 02 21:06:12.879223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application return self.creator() Sep 02 21:06:12.879223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 02 21:06:12.879223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application created_value = creator( Sep 02 21:06:12.879223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 02 21:06:12.879223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 02 21:06:12.879223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 02 21:06:12.879223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: ERROR keystone.server.flask.application Sep 02 21:06:12.879223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 671/1304] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Sep 2 21:06:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 02 21:06:12.884550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75ad11-4a20-4b2e-a81e-a3e6243481dd None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:12.961463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:12.983339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75ad11-4a20-4b2e-a81e-a3e6243481dd None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:13.017881 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd942036-9211-41c1-bdd3-a16e4afc47aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:13.018506 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd942036-9211-41c1-bdd3-a16e4afc47aa None admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:13.019333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd942036-9211-41c1-bdd3-a16e4afc47aa None admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:13.019660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd942036-9211-41c1-bdd3-a16e4afc47aa None admin] PATH_INFO: `/v3/services` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:13.020298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd942036-9211-41c1-bdd3-a16e4afc47aa None admin] RBAC: Adding query filter params (name=placement) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:06:13.020606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd942036-9211-41c1-bdd3-a16e4afc47aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:13.022036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd942036-9211-41c1-bdd3-a16e4afc47aa None admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:13.027725 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 634/1305] 10.222.0.79 () {56 vars in 1116 bytes} [Fri Sep 2 21:06:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:06:13.033741 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f252d1-0a2f-43ed-8552-1ffc1c686222 None admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:06:13.139331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f252d1-0a2f-43ed-8552-1ffc1c686222 None admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:06:13.176466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314f99a-4579-4bb6-a18e-845a407913f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:06:13.177081 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314f99a-4579-4bb6-a18e-845a407913f9 None admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:06:13.177370 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314f99a-4579-4bb6-a18e-845a407913f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:06:13.177642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314f99a-4579-4bb6-a18e-845a407913f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:06:13.178345 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314f99a-4579-4bb6-a18e-845a407913f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:06:13.179717 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314f99a-4579-4bb6-a18e-845a407913f9 None admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:06:13.277575 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 672/1306] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:06:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:06:23.048331 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=30 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:06:23.272631 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:01.129441 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd2af4-3d98-45c3-9182-1ae32c4a0b56 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:01.130424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd2af4-3d98-45c3-9182-1ae32c4a0b56 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:01.130851 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd2af4-3d98-45c3-9182-1ae32c4a0b56 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:01.138345 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced22952-e377-4d99-a590-796faf2821bb None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:01.139240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced22952-e377-4d99-a590-796faf2821bb None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:01.139686 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced22952-e377-4d99-a590-796faf2821bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:01.145107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 635/1307] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:14:01 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:14:01.224586 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-ced22952-e377-4d99-a590-796faf2821bb None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:14:01.226155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ced22952-e377-4d99-a590-796faf2821bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:01.377834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 673/1308] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:14:01.666329 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04410f-0d44-4085-a0a6-85f34e795d94 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:01.666785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04410f-0d44-4085-a0a6-85f34e795d94 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:01.667225 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04410f-0d44-4085-a0a6-85f34e795d94 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:01.668686 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 636/1309] 10.222.0.79 () {54 vars in 965 bytes} [Fri Sep 2 21:14:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:14:01.675660 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05d045-5d17-42d6-9de5-4fc88b9e3884 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:01.676056 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05d045-5d17-42d6-9de5-4fc88b9e3884 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:01.676524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05d045-5d17-42d6-9de5-4fc88b9e3884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:01.855324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-1a05d045-5d17-42d6-9de5-4fc88b9e3884 None None] MFA Rules not processed for user `aefaf6998acc4434aab62b9625bd25fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:14:01.859837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-1a05d045-5d17-42d6-9de5-4fc88b9e3884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:01.919520 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:02.056881 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 674/1310] 10.222.0.79 () {58 vars in 1062 bytes} [Fri Sep 2 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:14:02.067695 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04410f-0d44-4085-a0a6-85f34e795d94 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:14:02.069889 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8b04410f-0d44-4085-a0a6-85f34e795d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:02.267859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04410f-0d44-4085-a0a6-85f34e795d94 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:14:02.373512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d316d-312f-40ed-9d2f-5d49b88ca7a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:14:02.374654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d316d-312f-40ed-9d2f-5d49b88ca7a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:02.375277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d316d-312f-40ed-9d2f-5d49b88ca7a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:02.375781 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d316d-312f-40ed-9d2f-5d49b88ca7a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:02.378204 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-fc8d316d-312f-40ed-9d2f-5d49b88ca7a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:02.460209 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:02.522482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d316d-312f-40ed-9d2f-5d49b88ca7a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:14:02.524923 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d316d-312f-40ed-9d2f-5d49b88ca7a7 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:14:02.547228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 637/1311] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:14:04.848931 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e77e1-25c0-4a56-8159-9723f738c3cb None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:04.849482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e77e1-25c0-4a56-8159-9723f738c3cb None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:04.849482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e77e1-25c0-4a56-8159-9723f738c3cb None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:04.850916 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 675/1312] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:14:04.857187 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac59663-1e81-45ed-8766-c5170e45b7da None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:04.857706 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac59663-1e81-45ed-8766-c5170e45b7da None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:04.857942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac59663-1e81-45ed-8766-c5170e45b7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:04.953254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-9ac59663-1e81-45ed-8766-c5170e45b7da None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:14:04.954468 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-9ac59663-1e81-45ed-8766-c5170e45b7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:05.056333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 638/1313] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:14:05.362553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8784e47-4c9a-48b6-8d99-3ebe83bc677b None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:05.362838 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8784e47-4c9a-48b6-8d99-3ebe83bc677b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:05.363117 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8784e47-4c9a-48b6-8d99-3ebe83bc677b None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:05.364453 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 676/1314] 10.222.0.79 () {54 vars in 965 bytes} [Fri Sep 2 21:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:14:05.371062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb276595-089a-4dda-9d6e-77a6ae0174ac None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:05.371350 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb276595-089a-4dda-9d6e-77a6ae0174ac None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:05.371630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb276595-089a-4dda-9d6e-77a6ae0174ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:05.384211 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:05.453205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-bb276595-089a-4dda-9d6e-77a6ae0174ac None None] MFA Rules not processed for user `aefaf6998acc4434aab62b9625bd25fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:14:05.454456 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-bb276595-089a-4dda-9d6e-77a6ae0174ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:05.531895 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 639/1315] 10.222.0.79 () {58 vars in 1062 bytes} [Fri Sep 2 21:14:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:14:05.541779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8784e47-4c9a-48b6-8d99-3ebe83bc677b None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:14:05.543401 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f8784e47-4c9a-48b6-8d99-3ebe83bc677b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:05.647250 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8784e47-4c9a-48b6-8d99-3ebe83bc677b None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:14:05.721126 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:05.723740 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f3b2c-30a2-4d4d-a29b-5a71e143b713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:14:05.724345 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f3b2c-30a2-4d4d-a29b-5a71e143b713 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:05.724631 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f3b2c-30a2-4d4d-a29b-5a71e143b713 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:05.724908 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f3b2c-30a2-4d4d-a29b-5a71e143b713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:05.726558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ef3f3b2c-30a2-4d4d-a29b-5a71e143b713 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:05.839595 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f3b2c-30a2-4d4d-a29b-5a71e143b713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:14:05.840964 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f3b2c-30a2-4d4d-a29b-5a71e143b713 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:14:05.861993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 677/1316] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:14:08.596110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8202c-b753-4c5f-a6e1-dddc88605c59 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:08.596644 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8202c-b753-4c5f-a6e1-dddc88605c59 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:08.596644 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8202c-b753-4c5f-a6e1-dddc88605c59 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:08.598126 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 640/1317] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:14:08.604406 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9da73e-bcf0-40bd-9295-5a22a3ffc095 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:08.604828 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9da73e-bcf0-40bd-9295-5a22a3ffc095 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:08.604963 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9da73e-bcf0-40bd-9295-5a22a3ffc095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:08.676042 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-5e9da73e-bcf0-40bd-9295-5a22a3ffc095 None None] MFA Rules not processed for user `3ce3d1957ee348a49c430d91e7e49b73`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:14:08.677770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-5e9da73e-bcf0-40bd-9295-5a22a3ffc095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:08.736511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:08.783160 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 678/1318] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:14:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:14:09.076623 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8202c-b753-4c5f-a6e1-dddc88605c59 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:14:09.078265 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-09c8202c-b753-4c5f-a6e1-dddc88605c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:09.191076 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8202c-b753-4c5f-a6e1-dddc88605c59 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:14:09.195108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:09.268938 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5b79d-93f2-4211-8ecd-1b3bdf502190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:14:09.269534 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5b79d-93f2-4211-8ecd-1b3bdf502190 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:09.269841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5b79d-93f2-4211-8ecd-1b3bdf502190 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:09.270128 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5b79d-93f2-4211-8ecd-1b3bdf502190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:09.271761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-71d5b79d-93f2-4211-8ecd-1b3bdf502190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:09.386683 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5b79d-93f2-4211-8ecd-1b3bdf502190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:14:09.388358 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5b79d-93f2-4211-8ecd-1b3bdf502190 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:14:09.410134 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 641/1319] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:14:09 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:14:12.546233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb475532-011d-4a4b-a977-edcdcc8ea2a5 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:12.546781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb475532-011d-4a4b-a977-edcdcc8ea2a5 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:12.546781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb475532-011d-4a4b-a977-edcdcc8ea2a5 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:12.548123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 679/1320] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:14:12.553837 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd648a9e-e3a6-4ad8-a69e-337092115a6a None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:12.554268 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd648a9e-e3a6-4ad8-a69e-337092115a6a None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:12.554381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd648a9e-e3a6-4ad8-a69e-337092115a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:12.595584 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:12.621669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-dd648a9e-e3a6-4ad8-a69e-337092115a6a None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:14:12.622931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-dd648a9e-e3a6-4ad8-a69e-337092115a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:12.721340 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 642/1321] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:14:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:14:13.021161 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb475532-011d-4a4b-a977-edcdcc8ea2a5 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:14:13.022778 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-cb475532-011d-4a4b-a977-edcdcc8ea2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:13.126568 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb475532-011d-4a4b-a977-edcdcc8ea2a5 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:14:13.202302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9273b1e-0b3a-4a03-a735-cc0c62d69a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:14:13.202912 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9273b1e-0b3a-4a03-a735-cc0c62d69a71 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:13.203184 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9273b1e-0b3a-4a03-a735-cc0c62d69a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:13.203457 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9273b1e-0b3a-4a03-a735-cc0c62d69a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:13.205136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-c9273b1e-0b3a-4a03-a735-cc0c62d69a71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:13.214514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:13.326590 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9273b1e-0b3a-4a03-a735-cc0c62d69a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:14:13.327953 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9273b1e-0b3a-4a03-a735-cc0c62d69a71 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:14:13.346287 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 680/1322] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:14:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:14:16.509693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490067bf-7bf3-4af3-91eb-0d574041b901 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:16.510313 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490067bf-7bf3-4af3-91eb-0d574041b901 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:16.510313 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490067bf-7bf3-4af3-91eb-0d574041b901 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:16.511673 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 643/1323] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:14:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:14:16.517269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89081b-6edd-453c-bb2f-855d13de2017 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:16.517714 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89081b-6edd-453c-bb2f-855d13de2017 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:16.517936 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89081b-6edd-453c-bb2f-855d13de2017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:16.585799 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-0c89081b-6edd-453c-bb2f-855d13de2017 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:14:16.587643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-0c89081b-6edd-453c-bb2f-855d13de2017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:16.651557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:16.694435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 681/1324] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:14:16.991867 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490067bf-7bf3-4af3-91eb-0d574041b901 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:14:16.994035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-490067bf-7bf3-4af3-91eb-0d574041b901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:17.111887 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490067bf-7bf3-4af3-91eb-0d574041b901 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:14:17.125733 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:17.192462 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfa24d-a52c-496c-81e0-f6ca41de559a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:14:17.193071 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfa24d-a52c-496c-81e0-f6ca41de559a service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:17.193355 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfa24d-a52c-496c-81e0-f6ca41de559a service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:17.193634 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfa24d-a52c-496c-81e0-f6ca41de559a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:17.195281 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-13bfa24d-a52c-496c-81e0-f6ca41de559a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:17.317769 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfa24d-a52c-496c-81e0-f6ca41de559a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:14:17.319277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfa24d-a52c-496c-81e0-f6ca41de559a service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:14:17.338517 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 644/1325] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:14:19.356626 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf79705-b294-492a-9c78-9b0553dbf3ea None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:19.357190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf79705-b294-492a-9c78-9b0553dbf3ea None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:19.357190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf79705-b294-492a-9c78-9b0553dbf3ea None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:19.358581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 682/1326] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:14:19.363892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdf93a-45c7-43a7-9fc1-186cb38a8204 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:19.364314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdf93a-45c7-43a7-9fc1-186cb38a8204 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:19.364456 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdf93a-45c7-43a7-9fc1-186cb38a8204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:19.419193 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:19.439884 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-e5bdf93a-45c7-43a7-9fc1-186cb38a8204 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:14:19.441096 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e5bdf93a-45c7-43a7-9fc1-186cb38a8204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:19.544852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 645/1327] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:14:19.831385 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf79705-b294-492a-9c78-9b0553dbf3ea None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:14:19.833062 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-cdf79705-b294-492a-9c78-9b0553dbf3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:19.948649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf79705-b294-492a-9c78-9b0553dbf3ea None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:14:20.024629 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1a239-da66-4965-b701-834169759be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:14:20.025243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1a239-da66-4965-b701-834169759be7 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:20.025526 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1a239-da66-4965-b701-834169759be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:20.025800 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1a239-da66-4965-b701-834169759be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:20.027438 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-35e1a239-da66-4965-b701-834169759be7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:20.045240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:20.152762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1a239-da66-4965-b701-834169759be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:14:20.154269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1a239-da66-4965-b701-834169759be7 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:14:20.173402 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 683/1328] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:14:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:14:22.201916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867705eb-fe60-466f-8eb8-7cb0bcff0870 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:22.202495 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867705eb-fe60-466f-8eb8-7cb0bcff0870 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:22.202495 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867705eb-fe60-466f-8eb8-7cb0bcff0870 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:22.203814 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 646/1329] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:14:22.209164 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a941e-7a75-41a5-a226-1940b5ad4245 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:22.209633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a941e-7a75-41a5-a226-1940b5ad4245 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:22.209733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a941e-7a75-41a5-a226-1940b5ad4245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:22.281104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-d09a941e-7a75-41a5-a226-1940b5ad4245 None None] MFA Rules not processed for user `3ce3d1957ee348a49c430d91e7e49b73`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:14:22.282311 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-d09a941e-7a75-41a5-a226-1940b5ad4245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:22.351097 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:22.391538 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 684/1330] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:14:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:14:22.682766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867705eb-fe60-466f-8eb8-7cb0bcff0870 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:14:22.684347 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-867705eb-fe60-466f-8eb8-7cb0bcff0870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:22.815946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867705eb-fe60-466f-8eb8-7cb0bcff0870 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:14:22.839914 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:22.898332 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02292dd2-0b5b-44f9-8671-69e5aa78d0d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:14:22.899473 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02292dd2-0b5b-44f9-8671-69e5aa78d0d0 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:22.899935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02292dd2-0b5b-44f9-8671-69e5aa78d0d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:22.900218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02292dd2-0b5b-44f9-8671-69e5aa78d0d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:22.901860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-02292dd2-0b5b-44f9-8671-69e5aa78d0d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:23.013744 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02292dd2-0b5b-44f9-8671-69e5aa78d0d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:14:23.015233 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02292dd2-0b5b-44f9-8671-69e5aa78d0d0 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:14:23.034137 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 647/1331] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:14:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:14:25.543875 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca63c2e-44c6-4d5f-9979-488ad1c18085 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:25.544405 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca63c2e-44c6-4d5f-9979-488ad1c18085 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:25.544405 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca63c2e-44c6-4d5f-9979-488ad1c18085 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:25.545829 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 685/1332] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:14:25.551418 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d614869-212b-4b67-b733-8cd0a02dce9c None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:25.551854 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d614869-212b-4b67-b733-8cd0a02dce9c None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:25.552252 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d614869-212b-4b67-b733-8cd0a02dce9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:25.616800 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:25.619735 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-3d614869-212b-4b67-b733-8cd0a02dce9c None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:14:25.621004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-3d614869-212b-4b67-b733-8cd0a02dce9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:25.720597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 648/1333] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:14:26.012751 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca63c2e-44c6-4d5f-9979-488ad1c18085 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:14:26.014367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-bca63c2e-44c6-4d5f-9979-488ad1c18085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:26.121885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca63c2e-44c6-4d5f-9979-488ad1c18085 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:14:26.199297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96131806-ded8-4d36-909b-0906ee820e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:14:26.199905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96131806-ded8-4d36-909b-0906ee820e0d service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:26.200203 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96131806-ded8-4d36-909b-0906ee820e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:26.200487 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96131806-ded8-4d36-909b-0906ee820e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:26.202143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-96131806-ded8-4d36-909b-0906ee820e0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:26.231093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:26.314777 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96131806-ded8-4d36-909b-0906ee820e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:14:26.316101 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96131806-ded8-4d36-909b-0906ee820e0d service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:14:26.334141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 686/1334] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:14:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:14:28.315521 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ad479-3ee7-49d0-be3f-bb018c4f343e None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:28.316064 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ad479-3ee7-49d0-be3f-bb018c4f343e None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:28.316064 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ad479-3ee7-49d0-be3f-bb018c4f343e None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:28.317431 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 649/1335] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:14:28.323137 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817e6fd-c4b4-44a5-be71-56312f62f9c5 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:28.323569 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817e6fd-c4b4-44a5-be71-56312f62f9c5 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:28.323709 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817e6fd-c4b4-44a5-be71-56312f62f9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:28.390901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-c817e6fd-c4b4-44a5-be71-56312f62f9c5 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:14:28.392165 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-c817e6fd-c4b4-44a5-be71-56312f62f9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:28.476439 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:28.500679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 687/1336] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:14:28.799417 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ad479-3ee7-49d0-be3f-bb018c4f343e None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:14:28.800959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-fa1ad479-3ee7-49d0-be3f-bb018c4f343e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:28.918727 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ad479-3ee7-49d0-be3f-bb018c4f343e None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:14:28.950157 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:28.997636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc3b22-f556-46ee-b80e-9678f3c301f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:14:28.998276 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc3b22-f556-46ee-b80e-9678f3c301f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:28.998562 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc3b22-f556-46ee-b80e-9678f3c301f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:28.998840 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc3b22-f556-46ee-b80e-9678f3c301f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:29.000460 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-fdcc3b22-f556-46ee-b80e-9678f3c301f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:29.110091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc3b22-f556-46ee-b80e-9678f3c301f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:14:29.111544 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc3b22-f556-46ee-b80e-9678f3c301f9 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:14:29.131749 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 650/1337] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:14:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:14:31.792186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ac750-1902-4bab-babb-46a354f4804f None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:31.792785 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ac750-1902-4bab-babb-46a354f4804f None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:31.792785 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ac750-1902-4bab-babb-46a354f4804f None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:31.794176 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 688/1338] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:14:31.799372 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf3763-6375-44ef-8852-b3a89177cdd8 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:31.799792 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf3763-6375-44ef-8852-b3a89177cdd8 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:31.799905 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf3763-6375-44ef-8852-b3a89177cdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:31.876437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-82cf3763-6375-44ef-8852-b3a89177cdd8 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:14:31.877663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-82cf3763-6375-44ef-8852-b3a89177cdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:31.886901 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:31.978014 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 651/1339] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:14:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:14:32.270447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ac750-1902-4bab-babb-46a354f4804f None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:14:32.272013 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-df5ac750-1902-4bab-babb-46a354f4804f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:32.376687 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ac750-1902-4bab-babb-46a354f4804f None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:14:32.451015 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550743a-06d8-4b66-8278-852b26e99f13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:14:32.451632 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550743a-06d8-4b66-8278-852b26e99f13 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:32.451918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550743a-06d8-4b66-8278-852b26e99f13 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:32.452198 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550743a-06d8-4b66-8278-852b26e99f13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:32.453872 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-a550743a-06d8-4b66-8278-852b26e99f13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:32.490555 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:32.566555 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550743a-06d8-4b66-8278-852b26e99f13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:14:32.567925 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550743a-06d8-4b66-8278-852b26e99f13 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:14:32.587043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 689/1340] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:14:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:14:36.918202 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2456e-4ec6-417c-aa14-53a75351261b None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:36.918760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2456e-4ec6-417c-aa14-53a75351261b None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:36.918760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2456e-4ec6-417c-aa14-53a75351261b None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:36.920078 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 652/1341] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:14:36.925472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aedeba-8aea-4948-a792-34191f8d4c98 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:36.925979 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aedeba-8aea-4948-a792-34191f8d4c98 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:36.926207 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aedeba-8aea-4948-a792-34191f8d4c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:36.997083 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-00aedeba-8aea-4948-a792-34191f8d4c98 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:14:36.998351 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-00aedeba-8aea-4948-a792-34191f8d4c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:37.089728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:37.102741 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 690/1342] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:14:37.401237 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2456e-4ec6-417c-aa14-53a75351261b None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:14:37.402820 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-4de2456e-4ec6-417c-aa14-53a75351261b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:37.511244 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2456e-4ec6-417c-aa14-53a75351261b None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:14:37.549993 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:37.591138 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a3f33-defa-4e20-ae38-f8b297ff027e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:14:37.592010 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a3f33-defa-4e20-ae38-f8b297ff027e service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:37.592529 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a3f33-defa-4e20-ae38-f8b297ff027e service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:37.593095 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a3f33-defa-4e20-ae38-f8b297ff027e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:37.594800 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f70a3f33-defa-4e20-ae38-f8b297ff027e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:37.716594 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a3f33-defa-4e20-ae38-f8b297ff027e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:14:37.718077 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a3f33-defa-4e20-ae38-f8b297ff027e service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:14:37.737825 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 653/1343] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:14:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:14:40.839819 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeacd75-ba0c-41a9-b769-451ef849df28 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:40.840360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeacd75-ba0c-41a9-b769-451ef849df28 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:40.840360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeacd75-ba0c-41a9-b769-451ef849df28 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:40.841617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 691/1344] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:14:40.847116 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a044c-640e-4921-880c-0d4115f2ea71 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:40.847635 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a044c-640e-4921-880c-0d4115f2ea71 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:40.847741 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a044c-640e-4921-880c-0d4115f2ea71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:40.915222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-156a044c-640e-4921-880c-0d4115f2ea71 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:14:40.916440 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-156a044c-640e-4921-880c-0d4115f2ea71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:40.935396 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:41.015517 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 654/1345] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:14:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:14:41.318723 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeacd75-ba0c-41a9-b769-451ef849df28 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:14:41.320826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-adeacd75-ba0c-41a9-b769-451ef849df28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:41.434450 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeacd75-ba0c-41a9-b769-451ef849df28 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:14:41.515351 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05d01f-312c-4c5d-935d-93580b46f2f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:14:41.515882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05d01f-312c-4c5d-935d-93580b46f2f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:41.516167 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05d01f-312c-4c5d-935d-93580b46f2f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:41.516441 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05d01f-312c-4c5d-935d-93580b46f2f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:41.518071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-aa05d01f-312c-4c5d-935d-93580b46f2f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:41.564084 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:41.632104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05d01f-312c-4c5d-935d-93580b46f2f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:14:41.634240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05d01f-312c-4c5d-935d-93580b46f2f9 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:14:41.655049 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 692/1346] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:14:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:14:46.277619 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3257f-c8d3-41d0-8805-0ec7f4185e73 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:46.278185 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3257f-c8d3-41d0-8805-0ec7f4185e73 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:46.278346 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3257f-c8d3-41d0-8805-0ec7f4185e73 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:46.279774 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 655/1347] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:14:46.285431 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd807fa-de34-4f26-a576-f78f9e2f950b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:46.286008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd807fa-de34-4f26-a576-f78f9e2f950b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:46.286008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd807fa-de34-4f26-a576-f78f9e2f950b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:46.360041 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-1bd807fa-de34-4f26-a576-f78f9e2f950b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:14:46.361442 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-1bd807fa-de34-4f26-a576-f78f9e2f950b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:46.467487 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:46.470066 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 693/1348] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:14:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:14:46.760623 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3257f-c8d3-41d0-8805-0ec7f4185e73 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:14:46.762409 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d3e3257f-c8d3-41d0-8805-0ec7f4185e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:46.871861 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3257f-c8d3-41d0-8805-0ec7f4185e73 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:14:46.919443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:46.947210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f7634-552f-4355-bf97-51cca38266ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:14:46.947820 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f7634-552f-4355-bf97-51cca38266ee service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:46.948100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f7634-552f-4355-bf97-51cca38266ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:46.948372 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f7634-552f-4355-bf97-51cca38266ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:46.950006 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-c82f7634-552f-4355-bf97-51cca38266ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:47.059652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f7634-552f-4355-bf97-51cca38266ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:14:47.060999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f7634-552f-4355-bf97-51cca38266ee service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:14:47.080379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 656/1349] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:14:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:14:52.159593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35a692-2f36-4e2d-ae6b-0eb16ab840a2 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:52.160079 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35a692-2f36-4e2d-ae6b-0eb16ab840a2 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:52.160193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35a692-2f36-4e2d-ae6b-0eb16ab840a2 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:52.161636 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 694/1350] 10.222.0.79 () {54 vars in 921 bytes} [Fri Sep 2 21:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:14:52.168147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cbd24-f606-4346-8fbd-f8a68c42aefd None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:52.168618 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cbd24-f606-4346-8fbd-f8a68c42aefd None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:52.168726 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cbd24-f606-4346-8fbd-f8a68c42aefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:52.301730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-a33cbd24-f606-4346-8fbd-f8a68c42aefd None None] MFA Rules not processed for user `aa0f9604ee2e43b4967cbdc779e63e71`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:14:52.306082 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-a33cbd24-f606-4346-8fbd-f8a68c42aefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:52.349386 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:52.513972 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 657/1351] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Sep 2 21:14:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:14:56.803212 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c8fdc-b4b0-429a-b5cb-b24653e6f02e None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:56.804201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c8fdc-b4b0-429a-b5cb-b24653e6f02e None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:56.804635 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c8fdc-b4b0-429a-b5cb-b24653e6f02e None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:56.806410 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 695/1352] 10.222.0.79 () {54 vars in 921 bytes} [Fri Sep 2 21:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:14:56.812696 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc74bc-5798-4270-8730-db43cf316cc6 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:56.813187 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc74bc-5798-4270-8730-db43cf316cc6 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:56.813475 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc74bc-5798-4270-8730-db43cf316cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:56.903268 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-28cc74bc-5798-4270-8730-db43cf316cc6 None None] MFA Rules not processed for user `aa0f9604ee2e43b4967cbdc779e63e71`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:14:56.904473 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-28cc74bc-5798-4270-8730-db43cf316cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:56.982113 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:14:57.023841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 658/1353] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Sep 2 21:14:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:14:58.339384 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8d2c4-8231-4a1c-afbb-1dd558a31d30 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:58.339977 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8d2c4-8231-4a1c-afbb-1dd558a31d30 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:58.339977 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8d2c4-8231-4a1c-afbb-1dd558a31d30 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:58.341559 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 696/1354] 10.222.0.79 () {54 vars in 921 bytes} [Fri Sep 2 21:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:14:58.346883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b9b0b-d3e9-401f-9bf1-46bcd48528fb None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:14:58.347361 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b9b0b-d3e9-401f-9bf1-46bcd48528fb None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:14:58.347571 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b9b0b-d3e9-401f-9bf1-46bcd48528fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:14:58.430570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-829b9b0b-d3e9-401f-9bf1-46bcd48528fb None None] MFA Rules not processed for user `aa0f9604ee2e43b4967cbdc779e63e71`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:14:58.431924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-829b9b0b-d3e9-401f-9bf1-46bcd48528fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:14:58.549583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 659/1355] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Sep 2 21:14:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:15:02.101344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ed1e8-4452-4859-b935-c5405c0b319b None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:02.102103 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ed1e8-4452-4859-b935-c5405c0b319b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:02.102103 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ed1e8-4452-4859-b935-c5405c0b319b None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:02.103917 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 697/1356] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:15:02.109615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6a18c-377e-4551-a755-cac22ae965c4 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:02.121856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6a18c-377e-4551-a755-cac22ae965c4 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:02.121856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6a18c-377e-4551-a755-cac22ae965c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:02.147390 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:02.182703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-9be6a18c-377e-4551-a755-cac22ae965c4 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:02.183928 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-9be6a18c-377e-4551-a755-cac22ae965c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:02.322054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 660/1357] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:15:02.637519 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538173e-472b-4e35-8180-7bcb64e41358 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:02.637828 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538173e-472b-4e35-8180-7bcb64e41358 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:02.638324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538173e-472b-4e35-8180-7bcb64e41358 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:02.639649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 698/1358] 10.222.0.79 () {54 vars in 962 bytes} [Fri Sep 2 21:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:15:02.646362 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a964d-9882-46b5-b12d-e80832ac12be None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:02.657406 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a964d-9882-46b5-b12d-e80832ac12be None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:02.657406 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a964d-9882-46b5-b12d-e80832ac12be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:02.744013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-d80a964d-9882-46b5-b12d-e80832ac12be None None] MFA Rules not processed for user `632071470f7d409ab7b0129d120320c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:02.745421 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d80a964d-9882-46b5-b12d-e80832ac12be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:02.801371 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:02.878114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 661/1359] 10.222.0.79 () {58 vars in 1059 bytes} [Fri Sep 2 21:15:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:15:02.886961 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538173e-472b-4e35-8180-7bcb64e41358 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:15:02.888977 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-d538173e-472b-4e35-8180-7bcb64e41358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:03.055328 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538173e-472b-4e35-8180-7bcb64e41358 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:15:03.140645 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:03.187586 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd367c5-f477-40d7-8b15-48acd8810489 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:15:03.188328 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd367c5-f477-40d7-8b15-48acd8810489 service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:03.188670 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd367c5-f477-40d7-8b15-48acd8810489 service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:03.188944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd367c5-f477-40d7-8b15-48acd8810489 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:03.190581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-9fd367c5-f477-40d7-8b15-48acd8810489 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:03.291718 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd367c5-f477-40d7-8b15-48acd8810489 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:15:03.293708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd367c5-f477-40d7-8b15-48acd8810489 service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:15:03.314425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 699/1360] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:15:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:15:05.500786 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6d4ca-b074-4663-87aa-8621934ce736 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:05.501518 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6d4ca-b074-4663-87aa-8621934ce736 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:05.501518 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6d4ca-b074-4663-87aa-8621934ce736 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:05.503411 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 662/1361] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:15:05.508759 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21d916-2ece-4c56-b1a1-83943792079f None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:05.509207 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21d916-2ece-4c56-b1a1-83943792079f None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:05.509303 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21d916-2ece-4c56-b1a1-83943792079f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:05.582693 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-6c21d916-2ece-4c56-b1a1-83943792079f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:05.583895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-6c21d916-2ece-4c56-b1a1-83943792079f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:05.626027 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:05.700334 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 700/1362] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:15:05.998219 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6d4ca-b074-4663-87aa-8621934ce736 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:15:05.999848 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-61f6d4ca-b074-4663-87aa-8621934ce736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:06.197387 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6d4ca-b074-4663-87aa-8621934ce736 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:15:06.209287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:06.330581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34443c-2cd9-4e80-a322-6ae979a70c45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:15:06.331737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34443c-2cd9-4e80-a322-6ae979a70c45 service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:06.331737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34443c-2cd9-4e80-a322-6ae979a70c45 service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:06.332078 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34443c-2cd9-4e80-a322-6ae979a70c45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:06.333684 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-dd34443c-2cd9-4e80-a322-6ae979a70c45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:06.448455 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34443c-2cd9-4e80-a322-6ae979a70c45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:15:06.450097 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34443c-2cd9-4e80-a322-6ae979a70c45 service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:15:06.470172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 663/1363] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:15:08.882790 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac27a02-48b5-4da9-a106-9b89330c9fb4 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:08.883352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac27a02-48b5-4da9-a106-9b89330c9fb4 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:08.883352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac27a02-48b5-4da9-a106-9b89330c9fb4 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:08.884692 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 701/1364] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:15:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:15:08.890367 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee483ac7-037d-4a6b-96c0-a4f1abaca8f1 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:08.890842 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee483ac7-037d-4a6b-96c0-a4f1abaca8f1 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:08.890947 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee483ac7-037d-4a6b-96c0-a4f1abaca8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:08.907827 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:08.968310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-ee483ac7-037d-4a6b-96c0-a4f1abaca8f1 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:08.969420 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ee483ac7-037d-4a6b-96c0-a4f1abaca8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:09.090290 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 664/1365] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:15:09.418272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927265de-c59f-4f3e-b43d-fe529d0b1c76 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:09.418892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927265de-c59f-4f3e-b43d-fe529d0b1c76 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:09.419376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927265de-c59f-4f3e-b43d-fe529d0b1c76 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:09.421237 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 702/1366] 10.222.0.79 () {54 vars in 962 bytes} [Fri Sep 2 21:15:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:15:09.430178 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff893a-4ca8-4a39-be54-af3f5db744ac None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:09.430768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff893a-4ca8-4a39-be54-af3f5db744ac None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:09.431267 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff893a-4ca8-4a39-be54-af3f5db744ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:09.534104 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-89ff893a-4ca8-4a39-be54-af3f5db744ac None None] MFA Rules not processed for user `632071470f7d409ab7b0129d120320c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:09.535961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-89ff893a-4ca8-4a39-be54-af3f5db744ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:09.584833 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:09.696394 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 665/1367] 10.222.0.79 () {58 vars in 1059 bytes} [Fri Sep 2 21:15:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:15:09.708095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927265de-c59f-4f3e-b43d-fe529d0b1c76 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:15:09.709910 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-927265de-c59f-4f3e-b43d-fe529d0b1c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:09.880365 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927265de-c59f-4f3e-b43d-fe529d0b1c76 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:15:09.902730 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:10.008201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8d17b-0cf5-4e31-a19e-208b6e003308 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:15:10.008985 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8d17b-0cf5-4e31-a19e-208b6e003308 service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:10.009382 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8d17b-0cf5-4e31-a19e-208b6e003308 service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:10.009754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8d17b-0cf5-4e31-a19e-208b6e003308 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:10.011534 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-9be8d17b-0cf5-4e31-a19e-208b6e003308 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:10.108905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8d17b-0cf5-4e31-a19e-208b6e003308 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:15:10.110771 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8d17b-0cf5-4e31-a19e-208b6e003308 service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:15:10.131068 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 703/1368] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:15:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:15:10.630428 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303602d-4eab-4ba2-8acd-f602a5179615 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:10.631159 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303602d-4eab-4ba2-8acd-f602a5179615 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:10.631159 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303602d-4eab-4ba2-8acd-f602a5179615 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:10.632653 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 666/1369] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:15:10.637924 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e541-1438-44d8-8f03-aa618c86d28c None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:10.638282 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e541-1438-44d8-8f03-aa618c86d28c None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:10.638523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e541-1438-44d8-8f03-aa618c86d28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:10.673268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:10.713429 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-6506e541-1438-44d8-8f03-aa618c86d28c None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:10.714680 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-6506e541-1438-44d8-8f03-aa618c86d28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:10.817219 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 704/1370] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:15:11.406971 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e04fdc-840b-4f0c-aa3d-ad5ef8bbe7cf None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:11.406971 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e04fdc-840b-4f0c-aa3d-ad5ef8bbe7cf None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:11.406971 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e04fdc-840b-4f0c-aa3d-ad5ef8bbe7cf None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:11.409266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 667/1371] 10.222.0.79 () {54 vars in 964 bytes} [Fri Sep 2 21:15:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:15:11.414661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6c04f-21ac-4889-a2bb-ae7a690e85a7 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:11.415280 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6c04f-21ac-4889-a2bb-ae7a690e85a7 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:11.415280 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6c04f-21ac-4889-a2bb-ae7a690e85a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:11.512600 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-32c6c04f-21ac-4889-a2bb-ae7a690e85a7 None None] MFA Rules not processed for user `7fc07c138a414936b2bb95dd3ded9ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:11.513718 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-32c6c04f-21ac-4889-a2bb-ae7a690e85a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:11.566456 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:11.598144 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 705/1372] 10.222.0.79 () {58 vars in 1061 bytes} [Fri Sep 2 21:15:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:15:11.611644 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e04fdc-840b-4f0c-aa3d-ad5ef8bbe7cf None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:15:11.613507 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f2e04fdc-840b-4f0c-aa3d-ad5ef8bbe7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:11.752810 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e04fdc-840b-4f0c-aa3d-ad5ef8bbe7cf None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:15:11.798957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:11.836411 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd51214-0a40-4608-b628-e608072f498f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:15:11.837367 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd51214-0a40-4608-b628-e608072f498f service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:11.837651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd51214-0a40-4608-b628-e608072f498f service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:11.838014 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd51214-0a40-4608-b628-e608072f498f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:11.839716 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-5bd51214-0a40-4608-b628-e608072f498f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:11.973086 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd51214-0a40-4608-b628-e608072f498f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:15:11.974601 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd51214-0a40-4608-b628-e608072f498f service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:15:11.998075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 668/1373] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:15:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:15:12.314895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93fd07-6198-4d3b-b4a8-bc358130b721 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:12.315088 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93fd07-6198-4d3b-b4a8-bc358130b721 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:12.315366 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93fd07-6198-4d3b-b4a8-bc358130b721 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:12.316727 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 706/1374] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:15:12.322833 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4dfeb-646f-4e4c-9a04-532b9799e53a None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:12.323122 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4dfeb-646f-4e4c-9a04-532b9799e53a None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:12.323428 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4dfeb-646f-4e4c-9a04-532b9799e53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:12.392690 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-a8b4dfeb-646f-4e4c-9a04-532b9799e53a None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:12.393959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-a8b4dfeb-646f-4e4c-9a04-532b9799e53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:12.416993 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:12.496746 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 669/1375] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:15:12.789162 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93fd07-6198-4d3b-b4a8-bc358130b721 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:15:12.790863 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-3e93fd07-6198-4d3b-b4a8-bc358130b721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:12.943527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93fd07-6198-4d3b-b4a8-bc358130b721 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:15:12.996589 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:13.061232 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304733d-86ec-484c-8705-64a55ebfbffa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:15:13.061865 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304733d-86ec-484c-8705-64a55ebfbffa service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:13.062153 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304733d-86ec-484c-8705-64a55ebfbffa service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:13.062424 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304733d-86ec-484c-8705-64a55ebfbffa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:13.064058 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-0304733d-86ec-484c-8705-64a55ebfbffa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:13.158122 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304733d-86ec-484c-8705-64a55ebfbffa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:15:13.159762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304733d-86ec-484c-8705-64a55ebfbffa service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:15:13.178329 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 707/1376] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:15:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:15:15.350607 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade978d3-5c07-4f56-833e-5a06de38f725 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:15.350607 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade978d3-5c07-4f56-833e-5a06de38f725 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:15.350607 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade978d3-5c07-4f56-833e-5a06de38f725 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:15.350607 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 670/1377] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:15:15.356139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edca51-34ac-4921-8c9b-7871908d7839 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:15.356631 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edca51-34ac-4921-8c9b-7871908d7839 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:15.356745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edca51-34ac-4921-8c9b-7871908d7839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:15.438462 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-d1edca51-34ac-4921-8c9b-7871908d7839 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:15.439709 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-d1edca51-34ac-4921-8c9b-7871908d7839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:15.447504 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:15.538983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 708/1378] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:15:15.856624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade978d3-5c07-4f56-833e-5a06de38f725 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:15:15.858194 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ade978d3-5c07-4f56-833e-5a06de38f725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:16.052826 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade978d3-5c07-4f56-833e-5a06de38f725 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:15:16.057747 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:16.183882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bad5b7-10a5-4401-8e23-24b6c0bb8520 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:15:16.184685 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bad5b7-10a5-4401-8e23-24b6c0bb8520 service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:16.184974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bad5b7-10a5-4401-8e23-24b6c0bb8520 service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:16.185255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bad5b7-10a5-4401-8e23-24b6c0bb8520 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:16.186944 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-05bad5b7-10a5-4401-8e23-24b6c0bb8520 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:16.285769 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bad5b7-10a5-4401-8e23-24b6c0bb8520 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:15:16.287426 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bad5b7-10a5-4401-8e23-24b6c0bb8520 service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:15:16.308993 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 671/1379] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:15:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:15:18.483244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47b8f6-5288-46f5-84b1-47f80764ed30 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:18.483749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47b8f6-5288-46f5-84b1-47f80764ed30 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:18.483749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47b8f6-5288-46f5-84b1-47f80764ed30 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:18.485242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 709/1380] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:15:18.490625 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9025e-c17c-45a3-9fac-6c4e713cf12f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:18.491144 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9025e-c17c-45a3-9fac-6c4e713cf12f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:18.491943 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9025e-c17c-45a3-9fac-6c4e713cf12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:18.504452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:18.571229 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-d3b9025e-c17c-45a3-9fac-6c4e713cf12f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:18.572629 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d3b9025e-c17c-45a3-9fac-6c4e713cf12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:18.686360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 672/1381] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:15:18.982448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47b8f6-5288-46f5-84b1-47f80764ed30 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:15:18.983983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-1c47b8f6-5288-46f5-84b1-47f80764ed30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:19.130988 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:19.142567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47b8f6-5288-46f5-84b1-47f80764ed30 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:15:19.268084 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f36f2-11af-4fa4-a6e6-725d4cc6a118 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:15:19.268792 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f36f2-11af-4fa4-a6e6-725d4cc6a118 service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:19.268993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f36f2-11af-4fa4-a6e6-725d4cc6a118 service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:19.269262 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f36f2-11af-4fa4-a6e6-725d4cc6a118 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:19.271017 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-e32f36f2-11af-4fa4-a6e6-725d4cc6a118 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:19.373428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f36f2-11af-4fa4-a6e6-725d4cc6a118 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:15:19.375191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f36f2-11af-4fa4-a6e6-725d4cc6a118 service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:15:19.387670 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:19.396920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 710/1382] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:15:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:15:21.562772 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e70769-c1f9-4df4-ad02-ddcdcc2cdf2c None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:21.563546 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e70769-c1f9-4df4-ad02-ddcdcc2cdf2c None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:21.563546 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e70769-c1f9-4df4-ad02-ddcdcc2cdf2c None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:21.564755 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 673/1383] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:15:21.571206 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f6d08-23c8-4213-9652-5621ec99adf9 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:21.571797 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f6d08-23c8-4213-9652-5621ec99adf9 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:21.571797 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f6d08-23c8-4213-9652-5621ec99adf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:21.644520 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-0e5f6d08-23c8-4213-9652-5621ec99adf9 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:21.646201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-0e5f6d08-23c8-4213-9652-5621ec99adf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:21.779028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 711/1384] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:15:22.081541 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e70769-c1f9-4df4-ad02-ddcdcc2cdf2c None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:15:22.083145 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f3e70769-c1f9-4df4-ad02-ddcdcc2cdf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:22.182761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:22.250782 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e70769-c1f9-4df4-ad02-ddcdcc2cdf2c None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:15:22.388704 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ad25-ffba-40f0-ba25-773a6ef3155e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:15:22.389206 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ad25-ffba-40f0-ba25-773a6ef3155e service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:22.389490 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ad25-ffba-40f0-ba25-773a6ef3155e service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:22.389796 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ad25-ffba-40f0-ba25-773a6ef3155e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:22.391475 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-eb14ad25-ffba-40f0-ba25-773a6ef3155e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:22.452177 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:22.503942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14ad25-ffba-40f0-ba25-773a6ef3155e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:15:22.505558 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14ad25-ffba-40f0-ba25-773a6ef3155e service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:15:22.526402 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 674/1385] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:15:24.544877 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cf891-695a-4a23-b89b-8b9b891392a2 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:24.545427 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cf891-695a-4a23-b89b-8b9b891392a2 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:24.545608 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cf891-695a-4a23-b89b-8b9b891392a2 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:24.547451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 712/1386] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:15:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:15:24.554047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec566075-49bf-4e68-8102-584a9a075eeb None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:24.555152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec566075-49bf-4e68-8102-584a9a075eeb None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:24.555152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec566075-49bf-4e68-8102-584a9a075eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:24.632563 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-ec566075-49bf-4e68-8102-584a9a075eeb None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:24.633800 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ec566075-49bf-4e68-8102-584a9a075eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:24.755022 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 675/1387] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:15:25.056514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cf891-695a-4a23-b89b-8b9b891392a2 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:15:25.058196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-850cf891-695a-4a23-b89b-8b9b891392a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:25.160163 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:25.234536 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cf891-695a-4a23-b89b-8b9b891392a2 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:15:25.401198 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbe035-daf3-4087-b53d-3b1a503b1216 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:15:25.402754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbe035-daf3-4087-b53d-3b1a503b1216 service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:25.403349 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbe035-daf3-4087-b53d-3b1a503b1216 service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:25.403805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbe035-daf3-4087-b53d-3b1a503b1216 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:25.407125 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-e8fbe035-daf3-4087-b53d-3b1a503b1216 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:25.468625 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:25.525697 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbe035-daf3-4087-b53d-3b1a503b1216 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:15:25.527334 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbe035-daf3-4087-b53d-3b1a503b1216 service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:15:25.547791 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 713/1388] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:15:27.590470 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207660de-c2aa-414e-b3b7-64643e165683 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:27.591212 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207660de-c2aa-414e-b3b7-64643e165683 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:27.591212 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207660de-c2aa-414e-b3b7-64643e165683 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:27.592416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 676/1389] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:15:27.598594 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77c559-310a-40bf-bc17-09bb231501b3 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:27.599269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77c559-310a-40bf-bc17-09bb231501b3 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:27.599625 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77c559-310a-40bf-bc17-09bb231501b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:27.671811 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-7c77c559-310a-40bf-bc17-09bb231501b3 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:27.673777 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-7c77c559-310a-40bf-bc17-09bb231501b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:27.759568 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82efc84-3932-43e5-8250-70d5a88ef1a9 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:27.759847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82efc84-3932-43e5-8250-70d5a88ef1a9 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:27.760123 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82efc84-3932-43e5-8250-70d5a88ef1a9 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:27.761549 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 677/1390] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:15:27.766992 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9cab2-4fd8-406f-8598-4627f36b5edb None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:27.767352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9cab2-4fd8-406f-8598-4627f36b5edb None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:27.767568 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9cab2-4fd8-406f-8598-4627f36b5edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:27.778348 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 714/1391] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:15:27.806035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:27.841871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-cfc9cab2-4fd8-406f-8598-4627f36b5edb None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:27.844104 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-cfc9cab2-4fd8-406f-8598-4627f36b5edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:27.957110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 678/1392] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:15:28.096969 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bddd9a-b6f8-4215-a648-ed4c19993e6d None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:28.097212 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bddd9a-b6f8-4215-a648-ed4c19993e6d None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:28.097492 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bddd9a-b6f8-4215-a648-ed4c19993e6d None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:28.098988 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 715/1393] 10.222.0.79 () {54 vars in 961 bytes} [Fri Sep 2 21:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:15:28.104352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cfbe3-b607-446f-9ce9-be3f842ff872 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:28.104649 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cfbe3-b607-446f-9ce9-be3f842ff872 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:28.104924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cfbe3-b607-446f-9ce9-be3f842ff872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:28.192489 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-af8cfbe3-b607-446f-9ce9-be3f842ff872 None None] MFA Rules not processed for user `72840602ec264a74855b601c8d1ddf89`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:28.195868 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-af8cfbe3-b607-446f-9ce9-be3f842ff872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:28.250854 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:28.254927 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bddd9a-b6f8-4215-a648-ed4c19993e6d None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:15:28.256632 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b0bddd9a-b6f8-4215-a648-ed4c19993e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:28.271225 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:28.281292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 679/1394] 10.222.0.79 () {58 vars in 1058 bytes} [Fri Sep 2 21:15:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:15:28.289597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cfbe3-b607-446f-9ce9-be3f842ff872 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:15:28.297191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cfbe3-b607-446f-9ce9-be3f842ff872 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:15:28.375308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c3602-d731-4196-a3de-6f2e992f3442 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72840602ec264a74855b601c8d1ddf89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:15:28.375840 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c3602-d731-4196-a3de-6f2e992f3442 service glance] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:28.376126 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c3602-d731-4196-a3de-6f2e992f3442 service glance] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:28.376406 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c3602-d731-4196-a3de-6f2e992f3442 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:28.378154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-fe9c3602-d731-4196-a3de-6f2e992f3442 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:28.414108 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bddd9a-b6f8-4215-a648-ed4c19993e6d None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:15:28.496929 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c3602-d731-4196-a3de-6f2e992f3442 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:15:28.498416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c3602-d731-4196-a3de-6f2e992f3442 service glance] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:15:28.512245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:28.513288 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:28.517959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 680/1395] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:15:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:15:28.540635 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff550558-0bf8-4514-bd55-636fa1fc1358 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:15:28.541246 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff550558-0bf8-4514-bd55-636fa1fc1358 service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:28.541531 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff550558-0bf8-4514-bd55-636fa1fc1358 service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:28.541832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff550558-0bf8-4514-bd55-636fa1fc1358 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:28.543484 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ff550558-0bf8-4514-bd55-636fa1fc1358 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:28.639855 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff550558-0bf8-4514-bd55-636fa1fc1358 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:15:28.641437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff550558-0bf8-4514-bd55-636fa1fc1358 service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:15:28.665172 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 716/1396] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:15:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:15:29.612958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662de68-3a51-46ec-b320-5711670c774f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:29.613456 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662de68-3a51-46ec-b320-5711670c774f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:29.613649 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662de68-3a51-46ec-b320-5711670c774f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:29.685535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-2662de68-3a51-46ec-b320-5711670c774f None None] MFA Rules not processed for user `f45f65dd3a844cb583e42d837d2a58d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:29.686810 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-2662de68-3a51-46ec-b320-5711670c774f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:29.782183 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 681/1397] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Sep 2 21:15:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:15:29.839176 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535776f3-0171-41eb-9fd8-a4b21597433e None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:29.839734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535776f3-0171-41eb-9fd8-a4b21597433e None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:29.839896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535776f3-0171-41eb-9fd8-a4b21597433e None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:29.841358 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 717/1398] 10.222.0.79 () {54 vars in 943 bytes} [Fri Sep 2 21:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:15:29.852368 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85c66e-8e67-40fc-a873-4c60bc3ec4be None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:29.852368 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85c66e-8e67-40fc-a873-4c60bc3ec4be None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:29.852368 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85c66e-8e67-40fc-a873-4c60bc3ec4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:29.930337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-da85c66e-8e67-40fc-a873-4c60bc3ec4be None None] MFA Rules not processed for user `3da2b1dc9dae413a8ee63ad67e840f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:29.931566 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-da85c66e-8e67-40fc-a873-4c60bc3ec4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:29.962575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:30.046477 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 682/1399] 10.222.0.79 () {58 vars in 1040 bytes} [Fri Sep 2 21:15:29 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:15:30.056830 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535776f3-0171-41eb-9fd8-a4b21597433e None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:15:30.058501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-535776f3-0171-41eb-9fd8-a4b21597433e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:30.159466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:30.203601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535776f3-0171-41eb-9fd8-a4b21597433e None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:15:30.325729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61851788-0b39-4e26-a07b-830075eb49b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da2b1dc9dae413a8ee63ad67e840f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:15:30.326271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61851788-0b39-4e26-a07b-830075eb49b3 service swift] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:30.326589 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61851788-0b39-4e26-a07b-830075eb49b3 service swift] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:30.326855 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61851788-0b39-4e26-a07b-830075eb49b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:30.328483 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-61851788-0b39-4e26-a07b-830075eb49b3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:30.414534 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61851788-0b39-4e26-a07b-830075eb49b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:15:30.416141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61851788-0b39-4e26-a07b-830075eb49b3 service swift] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:15:30.419686 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:30.425131 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 718/1400] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Sep 2 21:15:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:15:31.100867 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0ecee-9513-46f0-8e72-250dd444bc73 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:31.101507 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0ecee-9513-46f0-8e72-250dd444bc73 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:31.101507 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0ecee-9513-46f0-8e72-250dd444bc73 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:31.102804 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 683/1401] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:15:31.108405 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff9634-477f-4ef7-b814-40d15046b655 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:31.108845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff9634-477f-4ef7-b814-40d15046b655 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:31.109005 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff9634-477f-4ef7-b814-40d15046b655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:31.188123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-5aff9634-477f-4ef7-b814-40d15046b655 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:31.189342 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-5aff9634-477f-4ef7-b814-40d15046b655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:31.311789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 719/1402] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:15:31.617250 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0ecee-9513-46f0-8e72-250dd444bc73 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:15:31.618805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8ca0ecee-9513-46f0-8e72-250dd444bc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:31.803887 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0ecee-9513-46f0-8e72-250dd444bc73 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:15:31.807465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:31.963096 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69afd7a-11c8-4d06-886c-026936b0e1a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:15:31.963096 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69afd7a-11c8-4d06-886c-026936b0e1a9 service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:31.963592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69afd7a-11c8-4d06-886c-026936b0e1a9 service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:31.963851 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69afd7a-11c8-4d06-886c-026936b0e1a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:31.965483 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e69afd7a-11c8-4d06-886c-026936b0e1a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:32.087476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69afd7a-11c8-4d06-886c-026936b0e1a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:15:32.089086 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69afd7a-11c8-4d06-886c-026936b0e1a9 service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:15:32.109645 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 684/1403] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:15:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:15:34.425418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982a22e-d9bc-4b2e-a05d-4a40468ce1ea None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:34.425993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982a22e-d9bc-4b2e-a05d-4a40468ce1ea None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:34.430697 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982a22e-d9bc-4b2e-a05d-4a40468ce1ea None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:34.430697 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 720/1404] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:15:34.434165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bca199-5ca7-4f53-89ea-4167f66a7357 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:34.434628 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bca199-5ca7-4f53-89ea-4167f66a7357 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:34.434721 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bca199-5ca7-4f53-89ea-4167f66a7357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:34.445248 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:34.511847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-e0bca199-5ca7-4f53-89ea-4167f66a7357 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:34.513275 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e0bca199-5ca7-4f53-89ea-4167f66a7357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:34.626939 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 685/1405] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:15:34.928769 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982a22e-d9bc-4b2e-a05d-4a40468ce1ea None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:15:34.930330 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-4982a22e-d9bc-4b2e-a05d-4a40468ce1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:35.019845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:35.094974 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982a22e-d9bc-4b2e-a05d-4a40468ce1ea None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:15:35.229642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c61ea-0e71-4101-88b6-3cae3c683a40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:15:35.230593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c61ea-0e71-4101-88b6-3cae3c683a40 service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:35.230882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c61ea-0e71-4101-88b6-3cae3c683a40 service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:35.231148 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c61ea-0e71-4101-88b6-3cae3c683a40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:35.232767 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-899c61ea-0e71-4101-88b6-3cae3c683a40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:35.281038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:35.343165 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c61ea-0e71-4101-88b6-3cae3c683a40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:15:35.344810 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c61ea-0e71-4101-88b6-3cae3c683a40 service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:15:35.369253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 721/1406] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:15:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:15:37.501664 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b2159-7143-4927-bed2-43081bb163eb None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:37.502257 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b2159-7143-4927-bed2-43081bb163eb None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:37.502400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b2159-7143-4927-bed2-43081bb163eb None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:37.503776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 686/1407] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:15:37.510077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cfbea-5992-47ce-b73c-a93c3cac4c49 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:37.510632 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cfbea-5992-47ce-b73c-a93c3cac4c49 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:37.510632 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cfbea-5992-47ce-b73c-a93c3cac4c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:37.588232 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-0c7cfbea-5992-47ce-b73c-a93c3cac4c49 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:37.589376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-0c7cfbea-5992-47ce-b73c-a93c3cac4c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:37.715171 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 722/1408] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:15:38.015010 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b2159-7143-4927-bed2-43081bb163eb None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:15:38.016667 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-662b2159-7143-4927-bed2-43081bb163eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:38.144897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:38.222668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b2159-7143-4927-bed2-43081bb163eb None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:15:38.358638 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277824c-33b4-44e2-97ad-eb27b0259b0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:15:38.359184 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277824c-33b4-44e2-97ad-eb27b0259b0f service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:38.359516 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277824c-33b4-44e2-97ad-eb27b0259b0f service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:38.359855 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277824c-33b4-44e2-97ad-eb27b0259b0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:38.361498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-5277824c-33b4-44e2-97ad-eb27b0259b0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:38.419462 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:38.469205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277824c-33b4-44e2-97ad-eb27b0259b0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:15:38.471041 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277824c-33b4-44e2-97ad-eb27b0259b0f service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:15:38.491295 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 687/1409] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:15:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:15:47.713252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=93 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:48.488126 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=24 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:54.880151 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d12de-854c-4884-a74a-8c9e996b74dc None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:54.880810 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d12de-854c-4884-a74a-8c9e996b74dc None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:54.880810 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d12de-854c-4884-a74a-8c9e996b74dc None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:54.882137 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 723/1410] 10.222.0.79 () {54 vars in 918 bytes} [Fri Sep 2 21:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:15:54.887243 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d0aa9-bcbf-4a14-8c9e-c55028a9e5dd None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:54.887724 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d0aa9-bcbf-4a14-8c9e-c55028a9e5dd None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:54.887833 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d0aa9-bcbf-4a14-8c9e-c55028a9e5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:54.964429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-317d0aa9-bcbf-4a14-8c9e-c55028a9e5dd None None] MFA Rules not processed for user `aa0f9604ee2e43b4967cbdc779e63e71`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:54.965583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-317d0aa9-bcbf-4a14-8c9e-c55028a9e5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:55.074186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 688/1411] 10.222.0.79 () {58 vars in 1015 bytes} [Fri Sep 2 21:15:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:15:55.088678 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce40186-8159-4132-af60-adaea3d09e14 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:55.088994 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce40186-8159-4132-af60-adaea3d09e14 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:55.089273 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce40186-8159-4132-af60-adaea3d09e14 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:55.090685 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 724/1412] 10.222.0.79 () {54 vars in 918 bytes} [Fri Sep 2 21:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:15:55.095481 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5b002-64f4-4eff-9f6c-5bedfcc220ae None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:55.095772 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5b002-64f4-4eff-9f6c-5bedfcc220ae None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:55.096052 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5b002-64f4-4eff-9f6c-5bedfcc220ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:55.170469 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:55.173136 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-dde5b002-64f4-4eff-9f6c-5bedfcc220ae None None] MFA Rules not processed for user `632071470f7d409ab7b0129d120320c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:55.174385 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-dde5b002-64f4-4eff-9f6c-5bedfcc220ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:55.290885 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 689/1413] 10.222.0.79 () {58 vars in 1015 bytes} [Fri Sep 2 21:15:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:15:57.698960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baa292-1b91-438c-80f0-b7fbfa8c9395 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:57.699430 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baa292-1b91-438c-80f0-b7fbfa8c9395 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:57.699592 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baa292-1b91-438c-80f0-b7fbfa8c9395 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:57.700860 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 725/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:15:57.706280 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324c157-ce0f-4112-ad02-e47ea60f6988 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:57.706763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324c157-ce0f-4112-ad02-e47ea60f6988 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:57.706883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324c157-ce0f-4112-ad02-e47ea60f6988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:57.775228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-d324c157-ce0f-4112-ad02-e47ea60f6988 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:57.776446 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d324c157-ce0f-4112-ad02-e47ea60f6988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:57.835006 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:57.878647 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 690/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:15:58.172141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baa292-1b91-438c-80f0-b7fbfa8c9395 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:15:58.173742 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-32baa292-1b91-438c-80f0-b7fbfa8c9395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:58.331706 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baa292-1b91-438c-80f0-b7fbfa8c9395 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:15:58.414010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:58.455974 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736a4df-aab8-4bdb-9112-16a2bb511417 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:15:58.456625 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736a4df-aab8-4bdb-9112-16a2bb511417 service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:58.456910 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736a4df-aab8-4bdb-9112-16a2bb511417 service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:58.457186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736a4df-aab8-4bdb-9112-16a2bb511417 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:58.459792 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-c736a4df-aab8-4bdb-9112-16a2bb511417 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:58.554867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736a4df-aab8-4bdb-9112-16a2bb511417 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:15:58.556513 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736a4df-aab8-4bdb-9112-16a2bb511417 service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:15:58.575208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 726/1416] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:15:59.479447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581d4ca-a968-4ba2-a710-2f3cfe6ce15e None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:59.480070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581d4ca-a968-4ba2-a710-2f3cfe6ce15e None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:59.480070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581d4ca-a968-4ba2-a710-2f3cfe6ce15e None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:59.481346 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 691/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:15:59.486222 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae235da-7963-4974-b8d1-7fe295b7f32b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:15:59.486669 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae235da-7963-4974-b8d1-7fe295b7f32b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:15:59.486904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae235da-7963-4974-b8d1-7fe295b7f32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:15:59.565186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-3ae235da-7963-4974-b8d1-7fe295b7f32b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:15:59.566344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-3ae235da-7963-4974-b8d1-7fe295b7f32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:59.594450 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:59.667679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 727/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:15:59.818168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581d4ca-a968-4ba2-a710-2f3cfe6ce15e None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:15:59.819650 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f581d4ca-a968-4ba2-a710-2f3cfe6ce15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:15:59.976583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581d4ca-a968-4ba2-a710-2f3cfe6ce15e None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:16:00.017558 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:00.092785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2104b1-8a11-4310-be9b-4730fbb7458d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:16:00.097370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2104b1-8a11-4310-be9b-4730fbb7458d service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:00.097657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2104b1-8a11-4310-be9b-4730fbb7458d service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:00.097961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2104b1-8a11-4310-be9b-4730fbb7458d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:00.099867 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-cb2104b1-8a11-4310-be9b-4730fbb7458d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:00.194817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2104b1-8a11-4310-be9b-4730fbb7458d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:16:00.196443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2104b1-8a11-4310-be9b-4730fbb7458d service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:16:00.216421 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 692/1419] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:15:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:01.263639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd41ed-b678-448c-8c86-7ef05c9c0428 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:01.264226 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd41ed-b678-448c-8c86-7ef05c9c0428 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:01.264226 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd41ed-b678-448c-8c86-7ef05c9c0428 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:01.265619 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 728/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:16:01.271318 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f31753-1fb1-4f48-a508-e4e0b9cb098f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:01.272044 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f31753-1fb1-4f48-a508-e4e0b9cb098f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:01.276607 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f31753-1fb1-4f48-a508-e4e0b9cb098f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:01.330487 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:01.353115 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-15f31753-1fb1-4f48-a508-e4e0b9cb098f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:01.354500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-15f31753-1fb1-4f48-a508-e4e0b9cb098f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:01.453317 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 693/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:16:01.606904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd41ed-b678-448c-8c86-7ef05c9c0428 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:16:01.608424 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-2efd41ed-b678-448c-8c86-7ef05c9c0428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:01.767112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd41ed-b678-448c-8c86-7ef05c9c0428 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:16:01.780328 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:01.882507 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce727573-a98f-477c-a7a7-0ed2917c81cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:16:01.883030 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce727573-a98f-477c-a7a7-0ed2917c81cd service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:01.883345 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce727573-a98f-477c-a7a7-0ed2917c81cd service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:01.883619 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce727573-a98f-477c-a7a7-0ed2917c81cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:01.885251 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ce727573-a98f-477c-a7a7-0ed2917c81cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:01.980709 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce727573-a98f-477c-a7a7-0ed2917c81cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:16:01.982389 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce727573-a98f-477c-a7a7-0ed2917c81cd service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:16:02.001159 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 729/1422] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:16:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:02.899613 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077b14c-34b1-4ef9-9c16-4733e9d2febe None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:02.900154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077b14c-34b1-4ef9-9c16-4733e9d2febe None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:02.900154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077b14c-34b1-4ef9-9c16-4733e9d2febe None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:02.901555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 694/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:16:02.906736 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea40df-58d3-40e7-9626-4cf1301c5e4f None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:02.907151 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea40df-58d3-40e7-9626-4cf1301c5e4f None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:02.907302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea40df-58d3-40e7-9626-4cf1301c5e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:02.928866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:02.986139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-8dea40df-58d3-40e7-9626-4cf1301c5e4f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:02.987280 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-8dea40df-58d3-40e7-9626-4cf1301c5e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:03.084331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 730/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:16:03.235444 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077b14c-34b1-4ef9-9c16-4733e9d2febe None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:16:03.237023 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-4077b14c-34b1-4ef9-9c16-4733e9d2febe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:03.350437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:03.388892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077b14c-34b1-4ef9-9c16-4733e9d2febe None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:16:03.508586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ed768-4393-468a-8939-fd3bd2fc5d80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:16:03.509122 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ed768-4393-468a-8939-fd3bd2fc5d80 service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:03.509408 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ed768-4393-468a-8939-fd3bd2fc5d80 service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:03.509690 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ed768-4393-468a-8939-fd3bd2fc5d80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:03.511379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-651ed768-4393-468a-8939-fd3bd2fc5d80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:03.593878 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:03.608396 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ed768-4393-468a-8939-fd3bd2fc5d80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:16:03.610073 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ed768-4393-468a-8939-fd3bd2fc5d80 service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:16:03.628074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 695/1425] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:16:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:04.514936 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652382a-fefe-4ccc-8ca8-9e1fd2991bb4 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:04.515489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652382a-fefe-4ccc-8ca8-9e1fd2991bb4 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:04.515489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652382a-fefe-4ccc-8ca8-9e1fd2991bb4 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:04.516824 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 731/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:16:04.522208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b6ea9-4401-4727-b875-f485a57045a8 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:04.522677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b6ea9-4401-4727-b875-f485a57045a8 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:04.522778 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b6ea9-4401-4727-b875-f485a57045a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:04.601853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-da3b6ea9-4401-4727-b875-f485a57045a8 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:04.603078 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-da3b6ea9-4401-4727-b875-f485a57045a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:04.700687 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 696/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:16:04.857895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652382a-fefe-4ccc-8ca8-9e1fd2991bb4 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:16:04.859400 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f652382a-fefe-4ccc-8ca8-9e1fd2991bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:04.946729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:05.007837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652382a-fefe-4ccc-8ca8-9e1fd2991bb4 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:16:05.120840 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33350052-0cae-4299-ac30-095ebec11d2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:16:05.121360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33350052-0cae-4299-ac30-095ebec11d2f service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:05.121646 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33350052-0cae-4299-ac30-095ebec11d2f service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:05.121954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33350052-0cae-4299-ac30-095ebec11d2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:05.123586 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-33350052-0cae-4299-ac30-095ebec11d2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:05.176119 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:05.221272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33350052-0cae-4299-ac30-095ebec11d2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:16:05.223636 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33350052-0cae-4299-ac30-095ebec11d2f service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:16:05.242488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 732/1428] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:16:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:06.141447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13f8cf-f84f-4d70-a843-ef330fb58964 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:06.142017 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13f8cf-f84f-4d70-a843-ef330fb58964 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:06.142017 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13f8cf-f84f-4d70-a843-ef330fb58964 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:06.143460 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 697/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:16:06.148582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc52e5-27f6-415f-b9fe-428b8fbfcdce None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:06.149050 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc52e5-27f6-415f-b9fe-428b8fbfcdce None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:06.149230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc52e5-27f6-415f-b9fe-428b8fbfcdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:06.226436 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-a0fc52e5-27f6-415f-b9fe-428b8fbfcdce None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:06.227659 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-a0fc52e5-27f6-415f-b9fe-428b8fbfcdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:06.326835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 733/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:16:06.479226 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13f8cf-f84f-4d70-a843-ef330fb58964 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:16:06.480760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-2e13f8cf-f84f-4d70-a843-ef330fb58964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:06.530555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:06.632545 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13f8cf-f84f-4d70-a843-ef330fb58964 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:16:06.755948 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c15ec-7cbe-4975-ba2d-50c763243079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:16:06.756762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c15ec-7cbe-4975-ba2d-50c763243079 service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:06.757050 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c15ec-7cbe-4975-ba2d-50c763243079 service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:06.757327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c15ec-7cbe-4975-ba2d-50c763243079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:06.758983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-891c15ec-7cbe-4975-ba2d-50c763243079 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:06.766101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:06.853711 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c15ec-7cbe-4975-ba2d-50c763243079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:16:06.855339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c15ec-7cbe-4975-ba2d-50c763243079 service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:16:06.873944 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 698/1431] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:16:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:07.759444 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd9b04-1172-4e6f-bb55-e763c8654e78 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:07.760022 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd9b04-1172-4e6f-bb55-e763c8654e78 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:07.760022 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd9b04-1172-4e6f-bb55-e763c8654e78 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:07.761389 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 734/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:16:07.766308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6db2a-86f2-4338-a03c-e81c6c599b95 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:07.766733 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6db2a-86f2-4338-a03c-e81c6c599b95 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:07.766863 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6db2a-86f2-4338-a03c-e81c6c599b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:07.843921 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-bfd6db2a-86f2-4338-a03c-e81c6c599b95 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:07.845159 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-bfd6db2a-86f2-4338-a03c-e81c6c599b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:07.913828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:07.943919 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 699/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:16:08.097223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd9b04-1172-4e6f-bb55-e763c8654e78 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:16:08.098914 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-cffd9b04-1172-4e6f-bb55-e763c8654e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:08.117588 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:08.251002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd9b04-1172-4e6f-bb55-e763c8654e78 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:16:08.340434 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:08.367155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad337430-7471-4f7c-89e9-8c708a0fbc2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:16:08.367944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad337430-7471-4f7c-89e9-8c708a0fbc2a service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:08.368376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad337430-7471-4f7c-89e9-8c708a0fbc2a service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:08.368857 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad337430-7471-4f7c-89e9-8c708a0fbc2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:08.370603 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ad337430-7471-4f7c-89e9-8c708a0fbc2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:08.463095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad337430-7471-4f7c-89e9-8c708a0fbc2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:16:08.464723 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad337430-7471-4f7c-89e9-8c708a0fbc2a service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:16:08.482808 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 735/1434] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:16:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:09.366983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba519c8b-0a71-40d6-9803-a494130b772b None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:09.367559 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba519c8b-0a71-40d6-9803-a494130b772b None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:09.367688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba519c8b-0a71-40d6-9803-a494130b772b None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:09.369338 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 700/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:16:09.374991 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a664e-1036-46ed-b622-109e028b6170 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:09.375522 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a664e-1036-46ed-b622-109e028b6170 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:09.375522 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a664e-1036-46ed-b622-109e028b6170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:09.454170 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-e84a664e-1036-46ed-b622-109e028b6170 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:09.455382 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-e84a664e-1036-46ed-b622-109e028b6170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:09.498218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:09.557288 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 736/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:16:09.709708 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba519c8b-0a71-40d6-9803-a494130b772b None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:16:09.711276 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ba519c8b-0a71-40d6-9803-a494130b772b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:09.868960 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba519c8b-0a71-40d6-9803-a494130b772b None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:16:09.927183 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:09.986863 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c2c44-31bb-49b8-9c31-0a36400370f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:16:09.987471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c2c44-31bb-49b8-9c31-0a36400370f5 service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:09.987756 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c2c44-31bb-49b8-9c31-0a36400370f5 service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:09.988034 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c2c44-31bb-49b8-9c31-0a36400370f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:09.990268 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d19c2c44-31bb-49b8-9c31-0a36400370f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:10.083947 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c2c44-31bb-49b8-9c31-0a36400370f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:16:10.085565 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c2c44-31bb-49b8-9c31-0a36400370f5 service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:16:10.104679 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 701/1437] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:16:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:10.999181 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d851667-b078-4f6c-911f-e05be5e03932 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:10.999731 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d851667-b078-4f6c-911f-e05be5e03932 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:10.999731 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d851667-b078-4f6c-911f-e05be5e03932 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:11.000974 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 737/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:16:11.006801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81191d1-4842-46cc-acf3-f2b5b705f699 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:11.007270 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81191d1-4842-46cc-acf3-f2b5b705f699 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:11.007388 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81191d1-4842-46cc-acf3-f2b5b705f699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:11.085675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-d81191d1-4842-46cc-acf3-f2b5b705f699 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:11.086986 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d81191d1-4842-46cc-acf3-f2b5b705f699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:11.089092 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:11.186087 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 702/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:16:11.336027 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d851667-b078-4f6c-911f-e05be5e03932 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:16:11.337588 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-0d851667-b078-4f6c-911f-e05be5e03932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:11.484996 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d851667-b078-4f6c-911f-e05be5e03932 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:16:11.512171 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:11.599829 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd70619-eb6e-450a-a988-63eed042942c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:16:11.600332 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd70619-eb6e-450a-a988-63eed042942c service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:11.600617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd70619-eb6e-450a-a988-63eed042942c service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:11.600892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd70619-eb6e-450a-a988-63eed042942c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:11.602568 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-4dd70619-eb6e-450a-a988-63eed042942c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:11.693285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd70619-eb6e-450a-a988-63eed042942c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:16:11.694948 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd70619-eb6e-450a-a988-63eed042942c service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:16:11.715158 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 738/1440] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:16:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:13.624637 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21a4c8-c275-44cb-93d9-3d028cd168ab None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:13.625185 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21a4c8-c275-44cb-93d9-3d028cd168ab None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:13.625185 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21a4c8-c275-44cb-93d9-3d028cd168ab None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:13.626607 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 703/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:16:13.634747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e69473-e8af-487b-9b0b-10d2fa723eeb None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:13.635275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e69473-e8af-487b-9b0b-10d2fa723eeb None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:13.635275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e69473-e8af-487b-9b0b-10d2fa723eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:13.682561 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:13.711783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-b4e69473-e8af-487b-9b0b-10d2fa723eeb None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:13.713021 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b4e69473-e8af-487b-9b0b-10d2fa723eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:13.812218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 739/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:16:14.119665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21a4c8-c275-44cb-93d9-3d028cd168ab None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:16:14.121234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ec21a4c8-c275-44cb-93d9-3d028cd168ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:14.240329 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21a4c8-c275-44cb-93d9-3d028cd168ab None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:16:14.276503 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:14.319638 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade7bb1-c36d-4500-99e5-09e35d28c596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:16:14.320251 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade7bb1-c36d-4500-99e5-09e35d28c596 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:14.320532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade7bb1-c36d-4500-99e5-09e35d28c596 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:14.320809 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade7bb1-c36d-4500-99e5-09e35d28c596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:14.322453 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-0ade7bb1-c36d-4500-99e5-09e35d28c596 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:14.436123 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade7bb1-c36d-4500-99e5-09e35d28c596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:16:14.437551 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade7bb1-c36d-4500-99e5-09e35d28c596 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:16:14.456978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 704/1443] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:16:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:16.659095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb0e67-9b8b-495a-8223-076f99a52cd2 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:16.659677 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb0e67-9b8b-495a-8223-076f99a52cd2 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:16.659677 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb0e67-9b8b-495a-8223-076f99a52cd2 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:16.661539 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 740/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:16:16.667612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be86de-d7ea-4a9f-bd40-23fd85b1fd02 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:16.668138 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be86de-d7ea-4a9f-bd40-23fd85b1fd02 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:16.668138 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be86de-d7ea-4a9f-bd40-23fd85b1fd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:16.856116 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-13be86de-d7ea-4a9f-bd40-23fd85b1fd02 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:16.857333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-13be86de-d7ea-4a9f-bd40-23fd85b1fd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:16.870205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:16.955186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 705/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:16:17.241302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb0e67-9b8b-495a-8223-076f99a52cd2 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:16:17.243454 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-5cfb0e67-9b8b-495a-8223-076f99a52cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:17.356547 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb0e67-9b8b-495a-8223-076f99a52cd2 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:16:17.369754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:17.437046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d11e3-fae7-4d08-9803-70b3c40dcc6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:16:17.437650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d11e3-fae7-4d08-9803-70b3c40dcc6e service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:17.437973 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d11e3-fae7-4d08-9803-70b3c40dcc6e service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:17.438249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d11e3-fae7-4d08-9803-70b3c40dcc6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:17.439865 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-8a9d11e3-fae7-4d08-9803-70b3c40dcc6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:17.565380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d11e3-fae7-4d08-9803-70b3c40dcc6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:16:17.566780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d11e3-fae7-4d08-9803-70b3c40dcc6e service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:16:17.586830 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 741/1446] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:16:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:16:19.942208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470e83d-ce68-41ad-936e-a41bbe488784 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:19.943282 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470e83d-ce68-41ad-936e-a41bbe488784 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:19.943378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470e83d-ce68-41ad-936e-a41bbe488784 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:19.944846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 706/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:16:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:16:19.950350 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbaceb-32cc-445f-b5d7-e86e80b7c687 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:19.950768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbaceb-32cc-445f-b5d7-e86e80b7c687 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:19.950912 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbaceb-32cc-445f-b5d7-e86e80b7c687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:19.999860 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:20.018386 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-2afbaceb-32cc-445f-b5d7-e86e80b7c687 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:20.019606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-2afbaceb-32cc-445f-b5d7-e86e80b7c687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:20.120222 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 742/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:16:20.407703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470e83d-ce68-41ad-936e-a41bbe488784 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:16:20.409270 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d470e83d-ce68-41ad-936e-a41bbe488784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:20.515106 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470e83d-ce68-41ad-936e-a41bbe488784 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:16:20.554757 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:20.588577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c69d5-b1c1-4896-9b8e-88e8b9cff24a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:16:20.589194 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c69d5-b1c1-4896-9b8e-88e8b9cff24a service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:20.589472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c69d5-b1c1-4896-9b8e-88e8b9cff24a service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:20.589745 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c69d5-b1c1-4896-9b8e-88e8b9cff24a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:20.591377 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-cf2c69d5-b1c1-4896-9b8e-88e8b9cff24a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:20.703331 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c69d5-b1c1-4896-9b8e-88e8b9cff24a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:16:20.704778 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c69d5-b1c1-4896-9b8e-88e8b9cff24a service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:16:20.730619 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 707/1449] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:16:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:22.788502 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e0aa6-c901-49af-a2b1-14ab3036f991 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:22.789059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e0aa6-c901-49af-a2b1-14ab3036f991 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:22.789059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e0aa6-c901-49af-a2b1-14ab3036f991 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:22.790441 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 743/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:16:22.795983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908c75b-a331-49a3-a96f-43303cf75def None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:22.796388 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908c75b-a331-49a3-a96f-43303cf75def None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:22.796548 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908c75b-a331-49a3-a96f-43303cf75def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:22.864112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-7908c75b-a331-49a3-a96f-43303cf75def None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:22.865394 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-7908c75b-a331-49a3-a96f-43303cf75def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:22.886111 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:22.963397 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 708/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:16:23.249487 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e0aa6-c901-49af-a2b1-14ab3036f991 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:16:23.251101 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-650e0aa6-c901-49af-a2b1-14ab3036f991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:23.359465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e0aa6-c901-49af-a2b1-14ab3036f991 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:16:23.380981 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:23.449618 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51225265-7df9-44ef-b03f-ceef81ac0f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:16:23.450388 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51225265-7df9-44ef-b03f-ceef81ac0f6f service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:23.450669 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51225265-7df9-44ef-b03f-ceef81ac0f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:23.450943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51225265-7df9-44ef-b03f-ceef81ac0f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:23.452631 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-51225265-7df9-44ef-b03f-ceef81ac0f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:23.564547 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51225265-7df9-44ef-b03f-ceef81ac0f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:16:23.565938 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51225265-7df9-44ef-b03f-ceef81ac0f6f service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:16:23.584099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 744/1452] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:16:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:25.708923 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fba5fd-6e80-4ec4-a3f2-5486a4038a5d None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:25.709537 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fba5fd-6e80-4ec4-a3f2-5486a4038a5d None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:25.709537 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fba5fd-6e80-4ec4-a3f2-5486a4038a5d None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:25.710843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 709/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:16:25.716126 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3c98a-2834-49f1-9195-d5a1d8e122d9 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:25.716532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3c98a-2834-49f1-9195-d5a1d8e122d9 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:25.716690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3c98a-2834-49f1-9195-d5a1d8e122d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:25.784248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:25.787718 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-79c3c98a-2834-49f1-9195-d5a1d8e122d9 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:25.788942 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-79c3c98a-2834-49f1-9195-d5a1d8e122d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:25.888801 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 745/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:16:26.175907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fba5fd-6e80-4ec4-a3f2-5486a4038a5d None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:16:26.177612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-49fba5fd-6e80-4ec4-a3f2-5486a4038a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:26.282094 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fba5fd-6e80-4ec4-a3f2-5486a4038a5d None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:16:26.331799 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:26.357158 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18de25-680c-41f8-833e-bc66eecbc0ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:16:26.357764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18de25-680c-41f8-833e-bc66eecbc0ed service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:26.358080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18de25-680c-41f8-833e-bc66eecbc0ed service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:26.358356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18de25-680c-41f8-833e-bc66eecbc0ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:26.359971 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-be18de25-680c-41f8-833e-bc66eecbc0ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:26.471758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18de25-680c-41f8-833e-bc66eecbc0ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:16:26.473118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18de25-680c-41f8-833e-bc66eecbc0ed service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:16:26.492085 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 710/1455] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:16:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:28.474648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db56e9-f054-4bdf-b6b0-4023388bf3b9 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:28.475240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db56e9-f054-4bdf-b6b0-4023388bf3b9 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:28.475240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db56e9-f054-4bdf-b6b0-4023388bf3b9 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:28.476561 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 746/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:16:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:16:28.482065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaa897-7077-4ef0-bbb1-54ad97100013 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:28.482509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaa897-7077-4ef0-bbb1-54ad97100013 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:28.482618 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaa897-7077-4ef0-bbb1-54ad97100013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:28.548698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-13aaa897-7077-4ef0-bbb1-54ad97100013 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:28.550197 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-13aaa897-7077-4ef0-bbb1-54ad97100013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:28.579566 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:28.646809 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 711/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:16:28.932438 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db56e9-f054-4bdf-b6b0-4023388bf3b9 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:16:28.934059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-25db56e9-f054-4bdf-b6b0-4023388bf3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:29.039097 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db56e9-f054-4bdf-b6b0-4023388bf3b9 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:16:29.068396 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:29.115235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d609a-aa7d-44d6-a513-5d5807ec919d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:16:29.115855 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d609a-aa7d-44d6-a513-5d5807ec919d service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:29.116141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d609a-aa7d-44d6-a513-5d5807ec919d service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:29.116411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d609a-aa7d-44d6-a513-5d5807ec919d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:29.118108 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-6e8d609a-aa7d-44d6-a513-5d5807ec919d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:29.228758 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d609a-aa7d-44d6-a513-5d5807ec919d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:16:29.230163 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d609a-aa7d-44d6-a513-5d5807ec919d service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:16:29.249897 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 747/1458] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:16:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:31.260975 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c87e67-3eb7-4a3d-87aa-e6a4d167b5f0 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:31.261584 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c87e67-3eb7-4a3d-87aa-e6a4d167b5f0 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:31.261584 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c87e67-3eb7-4a3d-87aa-e6a4d167b5f0 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:31.262972 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 712/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:16:31.268587 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c843a-b962-42c1-88ca-5af12783e07b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:31.269096 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c843a-b962-42c1-88ca-5af12783e07b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:31.269202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c843a-b962-42c1-88ca-5af12783e07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:31.454753 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-303c843a-b962-42c1-88ca-5af12783e07b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:31.456016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-303c843a-b962-42c1-88ca-5af12783e07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:31.465203 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:31.558847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 748/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:16:31.850720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c87e67-3eb7-4a3d-87aa-e6a4d167b5f0 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:16:31.852284 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-16c87e67-3eb7-4a3d-87aa-e6a4d167b5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:31.958583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c87e67-3eb7-4a3d-87aa-e6a4d167b5f0 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:16:32.014752 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:32.033436 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c72047-11ca-4b7e-b4bb-1ce430360b80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:16:32.034072 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c72047-11ca-4b7e-b4bb-1ce430360b80 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:32.035263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c72047-11ca-4b7e-b4bb-1ce430360b80 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:32.035263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c72047-11ca-4b7e-b4bb-1ce430360b80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:32.036385 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f0c72047-11ca-4b7e-b4bb-1ce430360b80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:32.150057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c72047-11ca-4b7e-b4bb-1ce430360b80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:16:32.151506 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c72047-11ca-4b7e-b4bb-1ce430360b80 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:16:32.171667 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 713/1461] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:16:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:34.185381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e685c-a3f7-462e-9aaa-01ad0a06b60d None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:34.185996 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e685c-a3f7-462e-9aaa-01ad0a06b60d None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:34.185996 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e685c-a3f7-462e-9aaa-01ad0a06b60d None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:34.187324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 749/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:16:34.192935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03ff0b-1c98-44e7-9e72-87574f890c5e None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:34.193529 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03ff0b-1c98-44e7-9e72-87574f890c5e None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:34.193529 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03ff0b-1c98-44e7-9e72-87574f890c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:34.261270 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-8d03ff0b-1c98-44e7-9e72-87574f890c5e None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:34.262542 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8d03ff0b-1c98-44e7-9e72-87574f890c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:34.303475 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:34.361912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 714/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:16:34.648089 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e685c-a3f7-462e-9aaa-01ad0a06b60d None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:16:34.649694 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-da3e685c-a3f7-462e-9aaa-01ad0a06b60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:34.756218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e685c-a3f7-462e-9aaa-01ad0a06b60d None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:16:34.793313 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:34.829926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d25f70-fba6-443a-88a9-e2c9c6f4ea33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:16:34.830527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d25f70-fba6-443a-88a9-e2c9c6f4ea33 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:34.830804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d25f70-fba6-443a-88a9-e2c9c6f4ea33 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:34.831070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d25f70-fba6-443a-88a9-e2c9c6f4ea33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:34.832790 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-31d25f70-fba6-443a-88a9-e2c9c6f4ea33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:34.957777 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d25f70-fba6-443a-88a9-e2c9c6f4ea33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:16:34.959299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d25f70-fba6-443a-88a9-e2c9c6f4ea33 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:16:34.977282 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 750/1464] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:16:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:36.973295 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d81bc-09ed-48bc-98d4-c27ed926ce50 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:36.973861 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d81bc-09ed-48bc-98d4-c27ed926ce50 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:36.973861 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d81bc-09ed-48bc-98d4-c27ed926ce50 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:36.975145 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 715/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:16:36.980809 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d88f5-4301-448f-b92b-b1daa10ebb99 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:36.981291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d88f5-4301-448f-b92b-b1daa10ebb99 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:36.981397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d88f5-4301-448f-b92b-b1daa10ebb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:37.047624 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-f26d88f5-4301-448f-b92b-b1daa10ebb99 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:37.048873 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f26d88f5-4301-448f-b92b-b1daa10ebb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:37.068242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:37.148829 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 751/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:16:37.442550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d81bc-09ed-48bc-98d4-c27ed926ce50 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:16:37.444123 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-162d81bc-09ed-48bc-98d4-c27ed926ce50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:37.549190 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d81bc-09ed-48bc-98d4-c27ed926ce50 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:16:37.632745 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:37.639980 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f2a13-2fff-4a36-9dce-39c5510efb4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:16:37.646199 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f2a13-2fff-4a36-9dce-39c5510efb4d service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:37.646199 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f2a13-2fff-4a36-9dce-39c5510efb4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:37.646199 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f2a13-2fff-4a36-9dce-39c5510efb4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:37.646199 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-6f6f2a13-2fff-4a36-9dce-39c5510efb4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:37.760689 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f2a13-2fff-4a36-9dce-39c5510efb4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:16:37.762173 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f2a13-2fff-4a36-9dce-39c5510efb4d service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:16:37.780388 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 716/1467] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:16:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:39.725161 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c6960-6de7-4a64-8fe1-7efad7fa185b None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:39.725725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c6960-6de7-4a64-8fe1-7efad7fa185b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:39.725725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c6960-6de7-4a64-8fe1-7efad7fa185b None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:39.727068 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 752/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:16:39.732414 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d60db-e6e2-4a5f-89d8-f13dff6284c0 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:39.732871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d60db-e6e2-4a5f-89d8-f13dff6284c0 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:39.733005 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d60db-e6e2-4a5f-89d8-f13dff6284c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:39.801476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-057d60db-e6e2-4a5f-89d8-f13dff6284c0 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:16:39.802826 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-057d60db-e6e2-4a5f-89d8-f13dff6284c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:39.853102 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:39.901478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 717/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:16:40.192986 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c6960-6de7-4a64-8fe1-7efad7fa185b None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:16:40.194590 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-947c6960-6de7-4a64-8fe1-7efad7fa185b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:40.301612 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c6960-6de7-4a64-8fe1-7efad7fa185b None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:16:40.350484 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:40.377384 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151dad0-8ee3-4c59-ba80-2364b198ecde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:16:40.378202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151dad0-8ee3-4c59-ba80-2364b198ecde service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:16:40.378717 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151dad0-8ee3-4c59-ba80-2364b198ecde service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:16:40.379816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151dad0-8ee3-4c59-ba80-2364b198ecde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:16:40.381495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b151dad0-8ee3-4c59-ba80-2364b198ecde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:16:40.490480 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151dad0-8ee3-4c59-ba80-2364b198ecde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:16:40.491874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151dad0-8ee3-4c59-ba80-2364b198ecde service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:16:40.510739 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 753/1470] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:16:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:49.899652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=22 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:50.508405 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=66 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:00.461153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cee14-0aa1-45e0-871e-ef6907abc95b None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:00.461750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cee14-0aa1-45e0-871e-ef6907abc95b None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:00.461750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cee14-0aa1-45e0-871e-ef6907abc95b None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:00.463222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 718/1471] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:17:00.470681 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b254dd-0e36-4149-9c52-dbc1fe758658 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:00.471185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b254dd-0e36-4149-9c52-dbc1fe758658 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:00.471185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b254dd-0e36-4149-9c52-dbc1fe758658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:00.555240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-f8b254dd-0e36-4149-9c52-dbc1fe758658 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:00.556689 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f8b254dd-0e36-4149-9c52-dbc1fe758658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:00.693887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 754/1472] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:17:01.022170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313c598-2d1b-4144-8f96-e55fe65abb38 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:01.022465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313c598-2d1b-4144-8f96-e55fe65abb38 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:01.022743 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313c598-2d1b-4144-8f96-e55fe65abb38 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:01.024083 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 719/1473] 10.222.0.79 () {54 vars in 961 bytes} [Fri Sep 2 21:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:17:01.029293 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ec5ba-984d-4856-a5b6-719bceb92e15 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:01.029587 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ec5ba-984d-4856-a5b6-719bceb92e15 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:01.029902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ec5ba-984d-4856-a5b6-719bceb92e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:01.106775 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-dd7ec5ba-984d-4856-a5b6-719bceb92e15 None None] MFA Rules not processed for user `72840602ec264a74855b601c8d1ddf89`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:01.108001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-dd7ec5ba-984d-4856-a5b6-719bceb92e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:01.131490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:01.189338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 755/1474] 10.222.0.79 () {58 vars in 1058 bytes} [Fri Sep 2 21:17:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:17:01.197382 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313c598-2d1b-4144-8f96-e55fe65abb38 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:17:01.198932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-4313c598-2d1b-4144-8f96-e55fe65abb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:01.321433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313c598-2d1b-4144-8f96-e55fe65abb38 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:17:01.409725 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001eb660-bfb9-4258-ab71-7d6b8eec849b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72840602ec264a74855b601c8d1ddf89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:17:01.410366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001eb660-bfb9-4258-ab71-7d6b8eec849b service glance] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:01.410645 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001eb660-bfb9-4258-ab71-7d6b8eec849b service glance] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:01.410919 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001eb660-bfb9-4258-ab71-7d6b8eec849b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:01.412522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-001eb660-bfb9-4258-ab71-7d6b8eec849b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:01.466994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:01.522698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001eb660-bfb9-4258-ab71-7d6b8eec849b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:17:01.524145 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001eb660-bfb9-4258-ab71-7d6b8eec849b service glance] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:17:01.543116 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 720/1475] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:17:03.604594 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb6d28-09ad-4df5-8f6b-72ffd2fdc42b None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:03.605190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb6d28-09ad-4df5-8f6b-72ffd2fdc42b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:03.605190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb6d28-09ad-4df5-8f6b-72ffd2fdc42b None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:03.606481 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 756/1476] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:17:03.612000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc9093-00b1-468b-9932-906ed003a3ea None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:03.613266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc9093-00b1-468b-9932-906ed003a3ea None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:03.613266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc9093-00b1-468b-9932-906ed003a3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:03.680598 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-11cc9093-00b1-468b-9932-906ed003a3ea None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:03.682004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-11cc9093-00b1-468b-9932-906ed003a3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:03.780897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 721/1477] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:17:04.059041 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb6d28-09ad-4df5-8f6b-72ffd2fdc42b None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:17:04.060590 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-9fbb6d28-09ad-4df5-8f6b-72ffd2fdc42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:04.190825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb6d28-09ad-4df5-8f6b-72ffd2fdc42b None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:17:04.240983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:04.287718 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb56781-8000-4d9e-aab9-80e834bde44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:17:04.288325 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb56781-8000-4d9e-aab9-80e834bde44a admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:04.288606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb56781-8000-4d9e-aab9-80e834bde44a admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:04.288883 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb56781-8000-4d9e-aab9-80e834bde44a admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:04.289524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb56781-8000-4d9e-aab9-80e834bde44a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:17:04.291320 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: WARNING py.warnings [None req-ecb56781-8000-4d9e-aab9-80e834bde44a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:17:04.291320 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: warnings.warn(msg) Sep 02 21:17:04.291320 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: Sep 02 21:17:04.292511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb56781-8000-4d9e-aab9-80e834bde44a admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:17:04.312457 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 757/1478] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Sep 2 21:17:04 2022] GET /identity/v3/projects => generated 2553 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:17:06.314404 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80886d-60bb-4c39-a9c7-c5c6163dad58 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:06.314985 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80886d-60bb-4c39-a9c7-c5c6163dad58 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:06.314985 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80886d-60bb-4c39-a9c7-c5c6163dad58 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:06.316430 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 722/1479] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:17:06.321829 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3a66e-a852-4cda-a3be-488a59dbb82f None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:06.322297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3a66e-a852-4cda-a3be-488a59dbb82f None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:06.322402 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3a66e-a852-4cda-a3be-488a59dbb82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:06.391205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-d1e3a66e-a852-4cda-a3be-488a59dbb82f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:06.392442 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-d1e3a66e-a852-4cda-a3be-488a59dbb82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:06.496293 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 758/1480] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:17:06.792458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80886d-60bb-4c39-a9c7-c5c6163dad58 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:17:06.794027 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-9e80886d-60bb-4c39-a9c7-c5c6163dad58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:06.804471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:06.945871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80886d-60bb-4c39-a9c7-c5c6163dad58 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:17:07.027050 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:07.060003 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5d2c4-0b47-43c3-a669-701240a72171 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:17:07.060606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5d2c4-0b47-43c3-a669-701240a72171 service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:07.060882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5d2c4-0b47-43c3-a669-701240a72171 service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:07.061152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5d2c4-0b47-43c3-a669-701240a72171 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:07.062773 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-6af5d2c4-0b47-43c3-a669-701240a72171 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:07.156231 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5d2c4-0b47-43c3-a669-701240a72171 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:17:07.157859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5d2c4-0b47-43c3-a669-701240a72171 service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:17:07.187991 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 723/1481] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:17:09.337912 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bb145-0c59-441e-816a-413ca4b7a639 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:09.338434 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bb145-0c59-441e-816a-413ca4b7a639 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:09.338548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bb145-0c59-441e-816a-413ca4b7a639 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:09.339838 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 759/1482] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:17:09.345443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f02cf-ef9f-4d10-b342-5db7a788ed84 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:09.345892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f02cf-ef9f-4d10-b342-5db7a788ed84 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:09.346166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f02cf-ef9f-4d10-b342-5db7a788ed84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:09.415492 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-407f02cf-ef9f-4d10-b342-5db7a788ed84 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:09.416710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-407f02cf-ef9f-4d10-b342-5db7a788ed84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:09.464505 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:09.515829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 724/1483] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:17:09.803730 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bb145-0c59-441e-816a-413ca4b7a639 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:17:09.805287 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-a29bb145-0c59-441e-816a-413ca4b7a639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:09.829754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:09.911996 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bb145-0c59-441e-816a-413ca4b7a639 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:17:09.991323 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7fad7-6973-49a2-983a-a24d8167f8b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:17:09.991956 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7fad7-6973-49a2-983a-a24d8167f8b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:09.992305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7fad7-6973-49a2-983a-a24d8167f8b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:09.992644 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7fad7-6973-49a2-983a-a24d8167f8b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:09.994958 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-7cd7fad7-6973-49a2-983a-a24d8167f8b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:10.075634 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:10.116834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7fad7-6973-49a2-983a-a24d8167f8b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:17:10.118471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7fad7-6973-49a2-983a-a24d8167f8b5 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:17:10.138171 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 760/1484] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:17:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:17:12.144832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2b1d2-fc86-406d-98fe-f45a709e28ea None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:12.145353 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2b1d2-fc86-406d-98fe-f45a709e28ea None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:12.145353 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2b1d2-fc86-406d-98fe-f45a709e28ea None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:12.146633 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 725/1485] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:17:12.152103 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ab422-6941-41a0-99b1-7fcb3cb79ec3 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:12.152552 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ab422-6941-41a0-99b1-7fcb3cb79ec3 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:12.152657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ab422-6941-41a0-99b1-7fcb3cb79ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:12.220412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-097ab422-6941-41a0-99b1-7fcb3cb79ec3 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:12.222147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-097ab422-6941-41a0-99b1-7fcb3cb79ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:12.320794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 761/1486] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:17:12.614188 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2b1d2-fc86-406d-98fe-f45a709e28ea None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:17:12.615762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-63b2b1d2-fc86-406d-98fe-f45a709e28ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:12.726324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2b1d2-fc86-406d-98fe-f45a709e28ea None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:17:12.803488 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:12.805146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73d685-459c-4567-a566-ab6083edba97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:17:12.805833 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73d685-459c-4567-a566-ab6083edba97 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:12.806123 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73d685-459c-4567-a566-ab6083edba97 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:12.806400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73d685-459c-4567-a566-ab6083edba97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:12.808124 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-0a73d685-459c-4567-a566-ab6083edba97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:12.920298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73d685-459c-4567-a566-ab6083edba97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:17:12.921731 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73d685-459c-4567-a566-ab6083edba97 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:17:12.941250 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 726/1487] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:17:15.113183 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc83bd1-bcae-4fdd-ba45-c308110ed345 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:15.113699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc83bd1-bcae-4fdd-ba45-c308110ed345 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:15.113699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc83bd1-bcae-4fdd-ba45-c308110ed345 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:15.115059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 762/1488] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:17:15.120749 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f74ea-52d7-403e-b1d0-33faa2b4b756 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:15.121158 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f74ea-52d7-403e-b1d0-33faa2b4b756 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:15.121346 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f74ea-52d7-403e-b1d0-33faa2b4b756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:15.189163 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-547f74ea-52d7-403e-b1d0-33faa2b4b756 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:15.190471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-547f74ea-52d7-403e-b1d0-33faa2b4b756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:15.249628 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:15.298382 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 727/1489] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:17:15.595451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc83bd1-bcae-4fdd-ba45-c308110ed345 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:17:15.597636 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-7dc83bd1-bcae-4fdd-ba45-c308110ed345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:15.636826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:15.711408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc83bd1-bcae-4fdd-ba45-c308110ed345 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:17:15.787556 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ddd44-870d-455f-92f1-b700f6dad91b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:17:15.788225 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ddd44-870d-455f-92f1-b700f6dad91b service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:15.788511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ddd44-870d-455f-92f1-b700f6dad91b service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:15.788789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ddd44-870d-455f-92f1-b700f6dad91b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:15.790469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-0b2ddd44-870d-455f-92f1-b700f6dad91b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:15.873172 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:15.903299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ddd44-870d-455f-92f1-b700f6dad91b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:17:15.904767 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ddd44-870d-455f-92f1-b700f6dad91b service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:17:15.927680 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 763/1490] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:17:18.481296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794995e-f8e5-440e-b053-ff990ed4ceab None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:18.481894 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794995e-f8e5-440e-b053-ff990ed4ceab None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:18.481894 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794995e-f8e5-440e-b053-ff990ed4ceab None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:18.483263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 728/1491] 10.222.0.79 () {54 vars in 927 bytes} [Fri Sep 2 21:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:17:18.489549 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe6007-2a06-485a-8c82-3653c6e7aa58 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:18.490045 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe6007-2a06-485a-8c82-3653c6e7aa58 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:18.490140 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe6007-2a06-485a-8c82-3653c6e7aa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:18.559552 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-58fe6007-2a06-485a-8c82-3653c6e7aa58 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:17:18.560723 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-58fe6007-2a06-485a-8c82-3653c6e7aa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:18.664971 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 764/1492] 10.222.0.79 () {58 vars in 1024 bytes} [Fri Sep 2 21:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:17:18.958120 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794995e-f8e5-440e-b053-ff990ed4ceab None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:17:18.959682 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-b794995e-f8e5-440e-b053-ff990ed4ceab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:19.077183 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794995e-f8e5-440e-b053-ff990ed4ceab None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:17:19.151875 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710768e-9d3b-4f19-aeae-b76911edc7b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:17:19.152501 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710768e-9d3b-4f19-aeae-b76911edc7b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:17:19.152788 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710768e-9d3b-4f19-aeae-b76911edc7b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:17:19.153071 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710768e-9d3b-4f19-aeae-b76911edc7b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:17:19.154797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-3710768e-9d3b-4f19-aeae-b76911edc7b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:17:19.164902 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:19.265451 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710768e-9d3b-4f19-aeae-b76911edc7b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:17:19.266816 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710768e-9d3b-4f19-aeae-b76911edc7b3 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:17:19.285862 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 729/1493] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:17:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:17:28.663099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=82 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:29.282638 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=50 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:48.039233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772741e-af75-47e5-bf54-8c35c3a03431 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:48.039832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772741e-af75-47e5-bf54-8c35c3a03431 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:48.039832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772741e-af75-47e5-bf54-8c35c3a03431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:48.118841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-8772741e-af75-47e5-bf54-8c35c3a03431 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:48.120077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-8772741e-af75-47e5-bf54-8c35c3a03431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:48.221514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 765/1494] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:18:48.229659 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191e06f-6a09-485b-99fc-f24473993ae5 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:48.230204 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191e06f-6a09-485b-99fc-f24473993ae5 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:48.230335 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191e06f-6a09-485b-99fc-f24473993ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:48.308598 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-8191e06f-6a09-485b-99fc-f24473993ae5 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:48.310223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8191e06f-6a09-485b-99fc-f24473993ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:48.415259 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 730/1495] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:18:48.420238 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772741e-af75-47e5-bf54-8c35c3a03431 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:48.421445 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-8772741e-af75-47e5-bf54-8c35c3a03431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:48.433233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772741e-af75-47e5-bf54-8c35c3a03431 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:48.495771 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:48.531607 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09067816-70b1-4375-9eb6-e14c3b2454c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:48.532219 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09067816-70b1-4375-9eb6-e14c3b2454c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:48.532502 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09067816-70b1-4375-9eb6-e14c3b2454c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:48.532774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09067816-70b1-4375-9eb6-e14c3b2454c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:48.533413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09067816-70b1-4375-9eb6-e14c3b2454c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:18:48.533730 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09067816-70b1-4375-9eb6-e14c3b2454c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:48.534802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: WARNING py.warnings [None req-09067816-70b1-4375-9eb6-e14c3b2454c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:18:48.534802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: warnings.warn(msg) Sep 02 21:18:48.534802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: Sep 02 21:18:48.535696 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09067816-70b1-4375-9eb6-e14c3b2454c0 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:48.547734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 766/1496] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:18:48.556435 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191e06f-6a09-485b-99fc-f24473993ae5 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:48.566510 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191e06f-6a09-485b-99fc-f24473993ae5 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:48.628556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:48.663647 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a0071-0cdd-4a97-8144-d55dea385eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:48.664276 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a0071-0cdd-4a97-8144-d55dea385eac admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:48.664558 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a0071-0cdd-4a97-8144-d55dea385eac admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:48.664836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a0071-0cdd-4a97-8144-d55dea385eac admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:48.665506 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a0071-0cdd-4a97-8144-d55dea385eac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:48.667365 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: WARNING py.warnings [None req-b77a0071-0cdd-4a97-8144-d55dea385eac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:18:48.667365 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: warnings.warn(msg) Sep 02 21:18:48.667365 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: Sep 02 21:18:48.668600 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a0071-0cdd-4a97-8144-d55dea385eac admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:48.818500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 731/1497] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:18:48 2022] POST /identity/v3/projects => generated 377 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:18:48.822674 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09067816-70b1-4375-9eb6-e14c3b2454c0 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:48.824227 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-09067816-70b1-4375-9eb6-e14c3b2454c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:48.862544 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09067816-70b1-4375-9eb6-e14c3b2454c0 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:48.969920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c112bcd-7341-4bea-b83b-eab6825a90a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:48.970553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c112bcd-7341-4bea-b83b-eab6825a90a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:48.970835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c112bcd-7341-4bea-b83b-eab6825a90a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:48.971108 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c112bcd-7341-4bea-b83b-eab6825a90a3 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:48.971751 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c112bcd-7341-4bea-b83b-eab6825a90a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:48.972816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: WARNING py.warnings [None req-9c112bcd-7341-4bea-b83b-eab6825a90a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:18:48.972816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: warnings.warn(msg) Sep 02 21:18:48.972816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: Sep 02 21:18:48.974090 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c112bcd-7341-4bea-b83b-eab6825a90a3 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:49.116658 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 767/1498] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:18:48 2022] POST /identity/v3/users => generated 289 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:18:49.119948 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a0071-0cdd-4a97-8144-d55dea385eac admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:49.121510 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-b77a0071-0cdd-4a97-8144-d55dea385eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:49.202155 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a0071-0cdd-4a97-8144-d55dea385eac admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:49.299857 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:49.311903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd25740-1848-472d-991d-2bc799180fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:49.313746 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd25740-1848-472d-991d-2bc799180fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:49.313746 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd25740-1848-472d-991d-2bc799180fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:49.313746 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd25740-1848-472d-991d-2bc799180fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:49.313746 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd25740-1848-472d-991d-2bc799180fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:49.314741 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: WARNING py.warnings [None req-bfd25740-1848-472d-991d-2bc799180fb3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:18:49.314741 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: warnings.warn(msg) Sep 02 21:18:49.314741 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: Sep 02 21:18:49.315642 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd25740-1848-472d-991d-2bc799180fb3 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:49.334127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 732/1499] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:18:49.339041 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c112bcd-7341-4bea-b83b-eab6825a90a3 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:49.341601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-9c112bcd-7341-4bea-b83b-eab6825a90a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:49.359937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c112bcd-7341-4bea-b83b-eab6825a90a3 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:49.392369 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:49.476737 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f316a6b-3715-42fb-880c-b84018341de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:49.477340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f316a6b-3715-42fb-880c-b84018341de8 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:49.477645 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f316a6b-3715-42fb-880c-b84018341de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:49.477948 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f316a6b-3715-42fb-880c-b84018341de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:49.478623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f316a6b-3715-42fb-880c-b84018341de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:49.479721 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: WARNING py.warnings [None req-9f316a6b-3715-42fb-880c-b84018341de8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:18:49.479721 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: warnings.warn(msg) Sep 02 21:18:49.479721 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: Sep 02 21:18:49.480649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f316a6b-3715-42fb-880c-b84018341de8 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:49.494889 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 768/1500] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:18:49.499275 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd25740-1848-472d-991d-2bc799180fb3 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:49.500880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-bfd25740-1848-472d-991d-2bc799180fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:49.537749 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd25740-1848-472d-991d-2bc799180fb3 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:49.642643 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194a22e-c254-4905-9085-c2634f91cf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:49.643181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194a22e-c254-4905-9085-c2634f91cf81 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:49.643459 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194a22e-c254-4905-9085-c2634f91cf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:49.643743 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194a22e-c254-4905-9085-c2634f91cf81 admin admin] PATH_INFO: `/v3/projects/bad2cc8aeaaf4ccfabb87519f73b65a6/users/fbfc84c033ef4e59882d14232d06275c/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:49.668607 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194a22e-c254-4905-9085-c2634f91cf81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bad2cc8aeaaf4ccfabb87519f73b65a6, user_id=fbfc84c033ef4e59882d14232d06275c, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:49.669997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: WARNING py.warnings [None req-a194a22e-c254-4905-9085-c2634f91cf81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:18:49.669997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: warnings.warn(msg) Sep 02 21:18:49.669997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: Sep 02 21:18:49.671966 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194a22e-c254-4905-9085-c2634f91cf81 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:49.778195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 733/1501] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:18:49 2022] PUT /identity/v3/projects/bad2cc8aeaaf4ccfabb87519f73b65a6/users/fbfc84c033ef4e59882d14232d06275c/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:18:49.790736 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a578c-f084-49aa-b267-550294bf1ad2 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:49.791023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a578c-f084-49aa-b267-550294bf1ad2 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:49.791304 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a578c-f084-49aa-b267-550294bf1ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:49.867505 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-524a578c-f084-49aa-b267-550294bf1ad2 None None] MFA Rules not processed for user `fbfc84c033ef4e59882d14232d06275c`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:49.868854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-524a578c-f084-49aa-b267-550294bf1ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:49.988354 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 769/1502] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:18:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:18:50.003144 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbe95f-9b89-4474-8d9d-2abf172b52c3 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:50.003433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbe95f-9b89-4474-8d9d-2abf172b52c3 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:50.003720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbe95f-9b89-4474-8d9d-2abf172b52c3 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:50.005111 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 734/1503] 10.222.0.79 () {54 vars in 964 bytes} [Fri Sep 2 21:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:18:50.010526 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc0f3e-fae0-4d76-818b-93a3ab6b9f0a None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:50.010812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc0f3e-fae0-4d76-818b-93a3ab6b9f0a None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:50.011122 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc0f3e-fae0-4d76-818b-93a3ab6b9f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:50.044132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:50.091449 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-53bc0f3e-fae0-4d76-818b-93a3ab6b9f0a None None] MFA Rules not processed for user `7fc07c138a414936b2bb95dd3ded9ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:50.092638 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-53bc0f3e-fae0-4d76-818b-93a3ab6b9f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:50.173319 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 770/1504] 10.222.0.79 () {58 vars in 1061 bytes} [Fri Sep 2 21:18:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:18:50.181426 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbe95f-9b89-4474-8d9d-2abf172b52c3 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:50.183062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-36fbe95f-9b89-4474-8d9d-2abf172b52c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:50.238852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:50.297743 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbe95f-9b89-4474-8d9d-2abf172b52c3 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:50.382372 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab915bd5-b651-4fa4-a766-0df106dbf011 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:50.383643 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab915bd5-b651-4fa4-a766-0df106dbf011 service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:50.383643 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab915bd5-b651-4fa4-a766-0df106dbf011 service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:50.383643 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab915bd5-b651-4fa4-a766-0df106dbf011 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:50.385120 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ab915bd5-b651-4fa4-a766-0df106dbf011 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:50.497405 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab915bd5-b651-4fa4-a766-0df106dbf011 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:50.499203 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab915bd5-b651-4fa4-a766-0df106dbf011 service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:50.503005 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:50.521452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 735/1505] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:18:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:18:50.570888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dbcb2-4a68-4e33-92f8-3974911a53a0 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:50.571178 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dbcb2-4a68-4e33-92f8-3974911a53a0 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:50.571444 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dbcb2-4a68-4e33-92f8-3974911a53a0 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:50.572920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 771/1506] 10.222.0.79 () {52 vars in 830 bytes} [Fri Sep 2 21:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:18:50.577850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab915bd5-b651-4fa4-a766-0df106dbf011 service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:50.579098 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ab915bd5-b651-4fa4-a766-0df106dbf011 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:50.704764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab915bd5-b651-4fa4-a766-0df106dbf011 service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:50.811119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103da426-87aa-4d74-baee-33cdb8d4ced4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:50.811672 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103da426-87aa-4d74-baee-33cdb8d4ced4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:50.811959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103da426-87aa-4d74-baee-33cdb8d4ced4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:50.812239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103da426-87aa-4d74-baee-33cdb8d4ced4 admin admin] PATH_INFO: `/v3/users/fbfc84c033ef4e59882d14232d06275c` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:50.825280 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103da426-87aa-4d74-baee-33cdb8d4ced4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbfc84c033ef4e59882d14232d06275c)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:50.826382 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: WARNING py.warnings [None req-103da426-87aa-4d74-baee-33cdb8d4ced4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:18:50.826382 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: warnings.warn(msg) Sep 02 21:18:50.826382 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: Sep 02 21:18:50.827610 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103da426-87aa-4d74-baee-33cdb8d4ced4 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:50.838319 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:51.084715 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-103da426-87aa-4d74-baee-33cdb8d4ced4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbfc84c033ef4e59882d14232d06275c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:18:51.085227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-103da426-87aa-4d74-baee-33cdb8d4ced4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbfc84c033ef4e59882d14232d06275c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:18:51.103372 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-103da426-87aa-4d74-baee-33cdb8d4ced4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbfc84c033ef4e59882d14232d06275c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:18:51.132743 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-103da426-87aa-4d74-baee-33cdb8d4ced4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbfc84c033ef4e59882d14232d06275c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:18:51.133370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-103da426-87aa-4d74-baee-33cdb8d4ced4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbfc84c033ef4e59882d14232d06275c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:18:51.239551 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 736/1507] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:18:50 2022] DELETE /identity/v3/users/fbfc84c033ef4e59882d14232d06275c => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:18:51.244611 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66468d0a-de81-4bb0-91c7-ebd00b31e9d8 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:51.245205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66468d0a-de81-4bb0-91c7-ebd00b31e9d8 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:51.245205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66468d0a-de81-4bb0-91c7-ebd00b31e9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:51.317550 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-66468d0a-de81-4bb0-91c7-ebd00b31e9d8 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:18:51.318850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-66468d0a-de81-4bb0-91c7-ebd00b31e9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:51.410252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:51.425226 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 772/1508] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:18:51.436740 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103da426-87aa-4d74-baee-33cdb8d4ced4 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:51.438019 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-103da426-87aa-4d74-baee-33cdb8d4ced4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:51.549986 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103da426-87aa-4d74-baee-33cdb8d4ced4 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:51.607607 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:18:51.626574 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873137d7-9221-4053-9448-e7b0c0d676c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:51.627194 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873137d7-9221-4053-9448-e7b0c0d676c3 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:51.627477 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873137d7-9221-4053-9448-e7b0c0d676c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:51.627752 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873137d7-9221-4053-9448-e7b0c0d676c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:51.629366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-873137d7-9221-4053-9448-e7b0c0d676c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:51.742709 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873137d7-9221-4053-9448-e7b0c0d676c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:51.744146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873137d7-9221-4053-9448-e7b0c0d676c3 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:51.763225 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 737/1509] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:18:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:18:52.291780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66468d0a-de81-4bb0-91c7-ebd00b31e9d8 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:18:52.293012 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-66468d0a-de81-4bb0-91c7-ebd00b31e9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:18:52.305088 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66468d0a-de81-4bb0-91c7-ebd00b31e9d8 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:18:52.428290 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65138870-8b12-4b29-8ebb-78e9cf66c87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:18:52.428947 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65138870-8b12-4b29-8ebb-78e9cf66c87d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:18:52.429232 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65138870-8b12-4b29-8ebb-78e9cf66c87d admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:18:52.429509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65138870-8b12-4b29-8ebb-78e9cf66c87d admin admin] PATH_INFO: `/v3/projects/bad2cc8aeaaf4ccfabb87519f73b65a6` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:18:52.442270 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65138870-8b12-4b29-8ebb-78e9cf66c87d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bad2cc8aeaaf4ccfabb87519f73b65a6)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:18:52.443325 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: WARNING py.warnings [None req-65138870-8b12-4b29-8ebb-78e9cf66c87d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:18:52.443325 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: warnings.warn(msg) Sep 02 21:18:52.443325 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: Sep 02 21:18:52.444539 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65138870-8b12-4b29-8ebb-78e9cf66c87d admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:18:52.594221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-65138870-8b12-4b29-8ebb-78e9cf66c87d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bad2cc8aeaaf4ccfabb87519f73b65a6', 'request_id': 'req-65138870-8b12-4b29-8ebb-78e9cf66c87d'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:18:52.609193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-65138870-8b12-4b29-8ebb-78e9cf66c87d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bad2cc8aeaaf4ccfabb87519f73b65a6', 'request_id': 'req-65138870-8b12-4b29-8ebb-78e9cf66c87d'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:18:52.616038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-65138870-8b12-4b29-8ebb-78e9cf66c87d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bad2cc8aeaaf4ccfabb87519f73b65a6', 'request_id': 'req-65138870-8b12-4b29-8ebb-78e9cf66c87d'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:18:52.736893 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-65138870-8b12-4b29-8ebb-78e9cf66c87d admin admin] The token cache is being invalidate because project bad2cc8aeaaf4ccfabb87519f73b65a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:18:52.737186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-65138870-8b12-4b29-8ebb-78e9cf66c87d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:18:52.737716 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-65138870-8b12-4b29-8ebb-78e9cf66c87d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:18:52.739080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 773/1510] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:18:52 2022] DELETE /identity/v3/projects/bad2cc8aeaaf4ccfabb87519f73b65a6 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:19:01.760461 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=62 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:19:02.734868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:26.797187 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617785d-ce30-46eb-89ff-bb4cc41d810b None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:26.798294 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617785d-ce30-46eb-89ff-bb4cc41d810b None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:26.798294 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617785d-ce30-46eb-89ff-bb4cc41d810b None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:26.800035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 738/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:20:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:20:26.806624 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dea1ef-86dd-465e-bb90-d98e4fa162bf None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:26.807526 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dea1ef-86dd-465e-bb90-d98e4fa162bf None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:26.807526 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dea1ef-86dd-465e-bb90-d98e4fa162bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:26.907638 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-66dea1ef-86dd-465e-bb90-d98e4fa162bf None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:20:26.908879 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-66dea1ef-86dd-465e-bb90-d98e4fa162bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:27.027904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 774/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:20:27.187622 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617785d-ce30-46eb-89ff-bb4cc41d810b None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:20:27.190299 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f617785d-ce30-46eb-89ff-bb4cc41d810b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:27.342708 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617785d-ce30-46eb-89ff-bb4cc41d810b None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:20:27.348334 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe971ed-2d47-4744-9535-4a02063a80ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:20:27.349736 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe971ed-2d47-4744-9535-4a02063a80ad service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:27.350212 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe971ed-2d47-4744-9535-4a02063a80ad service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:27.350575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe971ed-2d47-4744-9535-4a02063a80ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:27.359767 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe971ed-2d47-4744-9535-4a02063a80ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:20:27.361400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe971ed-2d47-4744-9535-4a02063a80ad service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:20:27.372874 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 739/1513] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:20:28.330973 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c6126-f0bd-4cfb-a844-0544ba4709b4 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:28.331570 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c6126-f0bd-4cfb-a844-0544ba4709b4 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:28.331570 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c6126-f0bd-4cfb-a844-0544ba4709b4 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:28.333531 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 775/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:20:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:20:28.339677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac6383-9ba5-440b-bf8f-d74265f68f13 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:28.340237 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac6383-9ba5-440b-bf8f-d74265f68f13 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:28.340352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac6383-9ba5-440b-bf8f-d74265f68f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:28.361541 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-51ac6383-9ba5-440b-bf8f-d74265f68f13 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:20:28.362905 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-51ac6383-9ba5-440b-bf8f-d74265f68f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:28.371608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 740/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:20:28.531589 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c6126-f0bd-4cfb-a844-0544ba4709b4 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:20:28.548007 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c6126-f0bd-4cfb-a844-0544ba4709b4 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:20:28.554617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b1f91-ae35-4108-92b0-95838dc0c802 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:20:28.555250 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b1f91-ae35-4108-92b0-95838dc0c802 service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:28.555533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b1f91-ae35-4108-92b0-95838dc0c802 service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:28.555813 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b1f91-ae35-4108-92b0-95838dc0c802 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:28.565094 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b1f91-ae35-4108-92b0-95838dc0c802 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:20:28.566757 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b1f91-ae35-4108-92b0-95838dc0c802 service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:20:28.577960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 776/1516] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:20:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:20:29.258983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac3ef1-0a7e-4e08-8690-5bf29e696e4a None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:29.259218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac3ef1-0a7e-4e08-8690-5bf29e696e4a None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:29.259422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac3ef1-0a7e-4e08-8690-5bf29e696e4a None None] PATH_INFO: `/v3` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:29.260721 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 741/1517] 10.222.0.98 () {54 vars in 925 bytes} [Fri Sep 2 21:20:29 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:20:29.269103 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6965b-e3b1-4d15-bcd1-593a0149f1ee None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:29.269419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6965b-e3b1-4d15-bcd1-593a0149f1ee None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:29.269754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6965b-e3b1-4d15-bcd1-593a0149f1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:29.340884 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-e8a6965b-e3b1-4d15-bcd1-593a0149f1ee None None] MFA Rules not processed for user `aa0f9604ee2e43b4967cbdc779e63e71`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:20:29.342188 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-e8a6965b-e3b1-4d15-bcd1-593a0149f1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:29.361680 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:29.436918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 777/1518] 10.222.0.98 () {58 vars in 1015 bytes} [Fri Sep 2 21:20:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:20:38.356040 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=56 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:39.433672 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=23 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:39.873538 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5034d-e806-4c7c-912a-e0ac2840e1fd None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:39.874147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5034d-e806-4c7c-912a-e0ac2840e1fd None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:39.874147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5034d-e806-4c7c-912a-e0ac2840e1fd None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:39.875392 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 742/1519] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:20:39.881741 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d4ad5-1004-45de-ad87-3ac3171838ee None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:39.882085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d4ad5-1004-45de-ad87-3ac3171838ee None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:39.882404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d4ad5-1004-45de-ad87-3ac3171838ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:39.904845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-b94d4ad5-1004-45de-ad87-3ac3171838ee None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:20:39.906108 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b94d4ad5-1004-45de-ad87-3ac3171838ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:39.914805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 778/1520] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:20:40.078995 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5034d-e806-4c7c-912a-e0ac2840e1fd None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:20:40.095373 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5034d-e806-4c7c-912a-e0ac2840e1fd None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:20:40.098844 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9b52a-52d2-43a5-b098-5f565ff7f1e7 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:40.111292 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9b52a-52d2-43a5-b098-5f565ff7f1e7 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:40.111292 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9b52a-52d2-43a5-b098-5f565ff7f1e7 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:40.111292 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 779/1521] 10.222.0.79 () {54 vars in 961 bytes} [Fri Sep 2 21:20:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:20:40.111828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d53ffc-eb1b-4149-809e-f254e1d561e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:20:40.111828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d53ffc-eb1b-4149-809e-f254e1d561e2 service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:40.111828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d53ffc-eb1b-4149-809e-f254e1d561e2 service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:40.111828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d53ffc-eb1b-4149-809e-f254e1d561e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:40.112360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b7ef2-bfac-417e-a1c9-e4b50c0afa2e None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:40.112360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b7ef2-bfac-417e-a1c9-e4b50c0afa2e None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:40.112360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b7ef2-bfac-417e-a1c9-e4b50c0afa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:40.116722 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d53ffc-eb1b-4149-809e-f254e1d561e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:20:40.119661 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d53ffc-eb1b-4149-809e-f254e1d561e2 service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:20:40.137802 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 743/1522] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:20:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:20:40.144024 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-dc5b7ef2-bfac-417e-a1c9-e4b50c0afa2e None None] MFA Rules not processed for user `aa0f9604ee2e43b4967cbdc779e63e71`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:20:40.146573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-dc5b7ef2-bfac-417e-a1c9-e4b50c0afa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:40.160633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 780/1523] 10.222.0.79 () {58 vars in 1058 bytes} [Fri Sep 2 21:20:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:20:40.168551 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d53ffc-eb1b-4149-809e-f254e1d561e2 service nova] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:20:40.182231 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d53ffc-eb1b-4149-809e-f254e1d561e2 service nova] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:20:40.187744 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644651b6-d5df-4e7e-8217-78efecd4813f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0f9604ee2e43b4967cbdc779e63e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:20:40.188608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644651b6-d5df-4e7e-8217-78efecd4813f service placement] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:40.188889 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644651b6-d5df-4e7e-8217-78efecd4813f service placement] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:40.189170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644651b6-d5df-4e7e-8217-78efecd4813f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:40.200562 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644651b6-d5df-4e7e-8217-78efecd4813f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:20:40.202824 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644651b6-d5df-4e7e-8217-78efecd4813f service placement] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:20:40.215040 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 744/1524] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:20:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:20:41.022218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4b5aa-352c-4b74-8d75-a25b084154ba None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:41.022814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4b5aa-352c-4b74-8d75-a25b084154ba None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:41.022814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4b5aa-352c-4b74-8d75-a25b084154ba None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:41.024168 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 781/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 2 21:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:20:41.032934 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4770be3-856b-4d96-8931-b51e92a3c891 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:41.033527 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4770be3-856b-4d96-8931-b51e92a3c891 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:41.033871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4770be3-856b-4d96-8931-b51e92a3c891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:41.061106 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-f4770be3-856b-4d96-8931-b51e92a3c891 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:20:41.063098 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f4770be3-856b-4d96-8931-b51e92a3c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:41.075408 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 745/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 2 21:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:20:41.237831 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4b5aa-352c-4b74-8d75-a25b084154ba None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:20:41.253474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4b5aa-352c-4b74-8d75-a25b084154ba None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:20:41.260649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3fc56-3d0e-4f69-8f72-bb369b468928 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:20:41.261293 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3fc56-3d0e-4f69-8f72-bb369b468928 service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:41.261591 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3fc56-3d0e-4f69-8f72-bb369b468928 service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:41.261902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3fc56-3d0e-4f69-8f72-bb369b468928 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:41.271610 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3fc56-3d0e-4f69-8f72-bb369b468928 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:20:41.273201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3fc56-3d0e-4f69-8f72-bb369b468928 service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:20:41.283301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 782/1527] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:20:45.049262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886ecaf-c3d2-431f-8b5e-621659d55534 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:45.049789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886ecaf-c3d2-431f-8b5e-621659d55534 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:45.049789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886ecaf-c3d2-431f-8b5e-621659d55534 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:45.051330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 746/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:20:45.056700 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ba7a8-486e-4555-88e2-55f3555d851f None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:45.057175 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ba7a8-486e-4555-88e2-55f3555d851f None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:45.057272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ba7a8-486e-4555-88e2-55f3555d851f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:45.077514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-500ba7a8-486e-4555-88e2-55f3555d851f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:20:45.078791 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-500ba7a8-486e-4555-88e2-55f3555d851f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:45.088090 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 783/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:20:45.383020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886ecaf-c3d2-431f-8b5e-621659d55534 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:20:45.384812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-c886ecaf-c3d2-431f-8b5e-621659d55534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:45.468495 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886ecaf-c3d2-431f-8b5e-621659d55534 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:20:45.472321 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e8176-e078-4989-83d4-3821255ad415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:20:45.473868 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e8176-e078-4989-83d4-3821255ad415 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:45.474167 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e8176-e078-4989-83d4-3821255ad415 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:45.474470 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e8176-e078-4989-83d4-3821255ad415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:45.489049 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e8176-e078-4989-83d4-3821255ad415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:20:45.490764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e8176-e078-4989-83d4-3821255ad415 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:20:45.501535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 747/1530] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:20:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:20:47.526350 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295b9dd-de81-419c-bcf1-1c1e2901f234 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:47.526929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295b9dd-de81-419c-bcf1-1c1e2901f234 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:47.527062 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295b9dd-de81-419c-bcf1-1c1e2901f234 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:47.528460 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 784/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:20:47.534358 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f6b40-757e-4b6e-bd38-f2688e2d0f48 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:47.534923 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f6b40-757e-4b6e-bd38-f2688e2d0f48 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:47.535031 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f6b40-757e-4b6e-bd38-f2688e2d0f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:47.558677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-442f6b40-757e-4b6e-bd38-f2688e2d0f48 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:20:47.560659 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-442f6b40-757e-4b6e-bd38-f2688e2d0f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:47.569940 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 748/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:20:47.868178 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295b9dd-de81-419c-bcf1-1c1e2901f234 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:20:47.880157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295b9dd-de81-419c-bcf1-1c1e2901f234 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:20:47.883982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b16ef-a523-4893-9818-23ff79a21b34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:20:47.886178 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b16ef-a523-4893-9818-23ff79a21b34 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:47.886178 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b16ef-a523-4893-9818-23ff79a21b34 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:47.886178 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b16ef-a523-4893-9818-23ff79a21b34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:47.896601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b16ef-a523-4893-9818-23ff79a21b34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:20:47.898100 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b16ef-a523-4893-9818-23ff79a21b34 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:20:47.908338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 785/1533] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:20:51.610649 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4739d5-320c-47ce-b130-d9dbbaf9c4c8 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:51.611272 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4739d5-320c-47ce-b130-d9dbbaf9c4c8 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:51.611272 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4739d5-320c-47ce-b130-d9dbbaf9c4c8 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:51.613173 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 749/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:20:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:20:51.619222 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533ea1c-1e50-4976-9ac2-ddda93d79458 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:51.622047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533ea1c-1e50-4976-9ac2-ddda93d79458 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:51.622047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533ea1c-1e50-4976-9ac2-ddda93d79458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:51.642758 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-e533ea1c-1e50-4976-9ac2-ddda93d79458 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:20:51.644604 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-e533ea1c-1e50-4976-9ac2-ddda93d79458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:51.653382 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 786/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:20:52.243559 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4739d5-320c-47ce-b130-d9dbbaf9c4c8 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:20:52.246289 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-bb4739d5-320c-47ce-b130-d9dbbaf9c4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:52.345575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4739d5-320c-47ce-b130-d9dbbaf9c4c8 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:20:52.350206 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b6ff1-000f-4cfc-8bd8-0423acecb858 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:20:52.350839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b6ff1-000f-4cfc-8bd8-0423acecb858 service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:52.351165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b6ff1-000f-4cfc-8bd8-0423acecb858 service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:52.351499 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b6ff1-000f-4cfc-8bd8-0423acecb858 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:52.362384 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b6ff1-000f-4cfc-8bd8-0423acecb858 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:20:52.364089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b6ff1-000f-4cfc-8bd8-0423acecb858 service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:20:52.376893 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 750/1536] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:20:54.421210 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4169e-7d7d-404b-be42-89548975739c None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:54.421787 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4169e-7d7d-404b-be42-89548975739c None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:54.421787 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4169e-7d7d-404b-be42-89548975739c None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:54.423139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 787/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 2 21:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:20:54.429312 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3dec0-dcc7-48dd-b349-93382d75ae66 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:54.429799 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3dec0-dcc7-48dd-b349-93382d75ae66 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:54.429936 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3dec0-dcc7-48dd-b349-93382d75ae66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:54.450603 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-aee3dec0-dcc7-48dd-b349-93382d75ae66 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:20:54.451874 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-aee3dec0-dcc7-48dd-b349-93382d75ae66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:54.460937 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 751/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 2 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:20:55.042470 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4169e-7d7d-404b-be42-89548975739c None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:20:55.044178 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f6a4169e-7d7d-404b-be42-89548975739c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:20:55.057775 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4169e-7d7d-404b-be42-89548975739c None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:20:55.061354 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04d4fe-3756-4402-94a9-9368669b6453 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:20:55.062005 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04d4fe-3756-4402-94a9-9368669b6453 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:20:55.062312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04d4fe-3756-4402-94a9-9368669b6453 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:20:55.062658 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04d4fe-3756-4402-94a9-9368669b6453 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:20:55.073293 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04d4fe-3756-4402-94a9-9368669b6453 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:20:55.074843 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04d4fe-3756-4402-94a9-9368669b6453 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:20:55.086014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 788/1539] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:20:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:21:04.444925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=91 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:21:05.080930 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=30 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:29.605015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835689dd-228a-4756-8c4a-d9ef57972c73 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:29.605673 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835689dd-228a-4756-8c4a-d9ef57972c73 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:29.605673 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835689dd-228a-4756-8c4a-d9ef57972c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:29.630692 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-835689dd-228a-4756-8c4a-d9ef57972c73 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:29.632510 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-835689dd-228a-4756-8c4a-d9ef57972c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:29.647126 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 752/1540] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:29.657252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9a5a1-ce05-48e4-87bc-5f6f4b59d889 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:29.658713 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9a5a1-ce05-48e4-87bc-5f6f4b59d889 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:29.659006 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9a5a1-ce05-48e4-87bc-5f6f4b59d889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:29.690989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-4fd9a5a1-ce05-48e4-87bc-5f6f4b59d889 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:29.692727 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-4fd9a5a1-ce05-48e4-87bc-5f6f4b59d889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:29.708180 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 789/1541] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:29.713162 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835689dd-228a-4756-8c4a-d9ef57972c73 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:29.727412 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835689dd-228a-4756-8c4a-d9ef57972c73 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:29.731932 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632aae7-e90c-4126-b969-d22db95645eb None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:29.732392 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632aae7-e90c-4126-b969-d22db95645eb None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:29.732723 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632aae7-e90c-4126-b969-d22db95645eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:29.742188 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa4206-2e90-43c5-a66e-38430b4a06c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:29.742843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa4206-2e90-43c5-a66e-38430b4a06c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:29.743138 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa4206-2e90-43c5-a66e-38430b4a06c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:29.745686 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa4206-2e90-43c5-a66e-38430b4a06c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:29.746456 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa4206-2e90-43c5-a66e-38430b4a06c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:22:29.748777 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa4206-2e90-43c5-a66e-38430b4a06c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:29.750361 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: WARNING py.warnings [None req-20fa4206-2e90-43c5-a66e-38430b4a06c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:22:29.750361 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: warnings.warn(msg) Sep 02 21:22:29.750361 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: Sep 02 21:22:29.751237 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa4206-2e90-43c5-a66e-38430b4a06c9 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:29.789884 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-6632aae7-e90c-4126-b969-d22db95645eb None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:29.789884 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-6632aae7-e90c-4126-b969-d22db95645eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:29.790906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 753/1542] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:22:29.804761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa4206-2e90-43c5-a66e-38430b4a06c9 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:29.812083 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 790/1543] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 02 21:22:29.817462 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa4206-2e90-43c5-a66e-38430b4a06c9 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:29.822937 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae7120-bbd7-4fce-9e02-961d405e1d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:29.823934 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae7120-bbd7-4fce-9e02-961d405e1d7b admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:29.824219 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae7120-bbd7-4fce-9e02-961d405e1d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:29.824499 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae7120-bbd7-4fce-9e02-961d405e1d7b admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:29.824915 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b014a-e04f-4505-be05-df8ccc9da17b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:29.825198 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae7120-bbd7-4fce-9e02-961d405e1d7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:29.825361 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b014a-e04f-4505-be05-df8ccc9da17b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:29.825608 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b014a-e04f-4505-be05-df8ccc9da17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:29.827423 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae7120-bbd7-4fce-9e02-961d405e1d7b admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:29.865568 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-5d7b014a-e04f-4505-be05-df8ccc9da17b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:29.866879 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-5d7b014a-e04f-4505-be05-df8ccc9da17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:29.877314 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 791/1544] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:22:29.880243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00eb6a2-500e-4ec9-8683-92493aace74b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:29.880243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00eb6a2-500e-4ec9-8683-92493aace74b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:29.880243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00eb6a2-500e-4ec9-8683-92493aace74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:29.902915 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-f00eb6a2-500e-4ec9-8683-92493aace74b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:29.905265 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f00eb6a2-500e-4ec9-8683-92493aace74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:29.913931 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 792/1545] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:29.915237 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078171d3-80d8-4438-8edd-a68556117920 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:29.915816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078171d3-80d8-4438-8edd-a68556117920 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:29.916146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078171d3-80d8-4438-8edd-a68556117920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:29.938344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-078171d3-80d8-4438-8edd-a68556117920 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:29.939551 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-078171d3-80d8-4438-8edd-a68556117920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:29.947685 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 793/1546] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:29.948869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d64a5-8cfc-4446-8eca-b9d3ceed78fb None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:29.949040 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d64a5-8cfc-4446-8eca-b9d3ceed78fb None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:29.949312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d64a5-8cfc-4446-8eca-b9d3ceed78fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:29.964390 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 754/1547] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:22:29 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:22:29.968981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11270d-2a3b-4c7c-9923-3978876fa7d8 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:29.969565 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11270d-2a3b-4c7c-9923-3978876fa7d8 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:29.970059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11270d-2a3b-4c7c-9923-3978876fa7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:29.980066 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-de7d64a5-8cfc-4446-8eca-b9d3ceed78fb None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:29.982168 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-de7d64a5-8cfc-4446-8eca-b9d3ceed78fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:30.003858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-2a11270d-2a3b-4c7c-9923-3978876fa7d8 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:30.007183 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-2a11270d-2a3b-4c7c-9923-3978876fa7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:30.069992 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 794/1548] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:30.071623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ceeed-243d-4938-b1fc-c30f2dd90518 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:30.071918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ceeed-243d-4938-b1fc-c30f2dd90518 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:30.072197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ceeed-243d-4938-b1fc-c30f2dd90518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:30.090228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 755/1549] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:30.091476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11270d-2a3b-4c7c-9923-3978876fa7d8 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:30.093890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-a83ceeed-243d-4938-b1fc-c30f2dd90518 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:30.095113 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-a83ceeed-243d-4938-b1fc-c30f2dd90518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:30.101569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11270d-2a3b-4c7c-9923-3978876fa7d8 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:30.103425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 795/1550] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:30.104748 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eddf3-4dc5-4690-8b7c-f5e1f3c3e984 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:30.105047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eddf3-4dc5-4690-8b7c-f5e1f3c3e984 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:30.105326 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eddf3-4dc5-4690-8b7c-f5e1f3c3e984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:30.109493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d42a1a-83d5-4ddc-89a8-8a1d2c55fd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:30.110292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d42a1a-83d5-4ddc-89a8-8a1d2c55fd65 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:30.110642 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d42a1a-83d5-4ddc-89a8-8a1d2c55fd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:30.110939 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d42a1a-83d5-4ddc-89a8-8a1d2c55fd65 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:30.111624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d42a1a-83d5-4ddc-89a8-8a1d2c55fd65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:22:30.111934 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d42a1a-83d5-4ddc-89a8-8a1d2c55fd65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:30.113755 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d42a1a-83d5-4ddc-89a8-8a1d2c55fd65 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:30.127174 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 756/1551] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:22:30.127571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-f60eddf3-4dc5-4690-8b7c-f5e1f3c3e984 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:30.128035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d42a1a-83d5-4ddc-89a8-8a1d2c55fd65 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:30.129017 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f60eddf3-4dc5-4690-8b7c-f5e1f3c3e984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:30.137626 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 796/1552] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:30.138307 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d42a1a-83d5-4ddc-89a8-8a1d2c55fd65 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:30.139229 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefc068-13db-4755-955b-bcc0c00a2893 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:30.139577 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefc068-13db-4755-955b-bcc0c00a2893 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:30.139922 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefc068-13db-4755-955b-bcc0c00a2893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:30.143164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e93cf-bf54-4917-9db8-0312dcab7766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:30.143775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e93cf-bf54-4917-9db8-0312dcab7766 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:30.144052 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e93cf-bf54-4917-9db8-0312dcab7766 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:30.144327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e93cf-bf54-4917-9db8-0312dcab7766 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:30.144967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e93cf-bf54-4917-9db8-0312dcab7766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:30.146009 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: WARNING py.warnings [None req-2a3e93cf-bf54-4917-9db8-0312dcab7766 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:22:30.146009 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: warnings.warn(msg) Sep 02 21:22:30.146009 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: Sep 02 21:22:30.147218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e93cf-bf54-4917-9db8-0312dcab7766 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:30.161465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-5aefc068-13db-4755-955b-bcc0c00a2893 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:30.162729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-5aefc068-13db-4755-955b-bcc0c00a2893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:30.171810 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 797/1553] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:30.173182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56385027-d2ed-4ab7-b027-a112e09ad178 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:30.178183 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56385027-d2ed-4ab7-b027-a112e09ad178 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:30.178183 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56385027-d2ed-4ab7-b027-a112e09ad178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:30.194410 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-56385027-d2ed-4ab7-b027-a112e09ad178 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:30.195636 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-56385027-d2ed-4ab7-b027-a112e09ad178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:30.204230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 798/1554] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:30.205607 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadbec2-96f8-49d6-8b53-c63c996a9fee None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:30.205926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadbec2-96f8-49d6-8b53-c63c996a9fee None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:30.206208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadbec2-96f8-49d6-8b53-c63c996a9fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:30.227430 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-8aadbec2-96f8-49d6-8b53-c63c996a9fee None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:30.228665 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-8aadbec2-96f8-49d6-8b53-c63c996a9fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:30.237236 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 799/1555] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:30.238842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9142f-ed95-473b-8cdf-ab13782d2be3 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:30.238842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9142f-ed95-473b-8cdf-ab13782d2be3 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:30.239165 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9142f-ed95-473b-8cdf-ab13782d2be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:30.259626 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-35a9142f-ed95-473b-8cdf-ab13782d2be3 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:30.260850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-35a9142f-ed95-473b-8cdf-ab13782d2be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:30.269694 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 800/1556] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:30.271323 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9142f-ed95-473b-8cdf-ab13782d2be3 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:30.282900 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9142f-ed95-473b-8cdf-ab13782d2be3 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:30.287712 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bf6bf-ce75-40dd-ba65-fa73422b99d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:30.288325 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bf6bf-ce75-40dd-ba65-fa73422b99d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:30.288615 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bf6bf-ce75-40dd-ba65-fa73422b99d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:30.288891 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bf6bf-ce75-40dd-ba65-fa73422b99d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:30.289579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04bf6bf-ce75-40dd-ba65-fa73422b99d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:22:30.289920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04bf6bf-ce75-40dd-ba65-fa73422b99d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:30.291633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04bf6bf-ce75-40dd-ba65-fa73422b99d8 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:30.311660 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 801/1557] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:22:30.311660 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bf6bf-ce75-40dd-ba65-fa73422b99d8 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:30.311996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 757/1558] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:22:30 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:30.311996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e93cf-bf54-4917-9db8-0312dcab7766 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:30.318683 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e93cf-bf54-4917-9db8-0312dcab7766 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:30.319112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bf6bf-ce75-40dd-ba65-fa73422b99d8 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:30.323782 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872a13c-ac25-4120-82df-678376da1efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:30.324099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d0628-ec96-48b3-962f-4a01392d67d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:30.324247 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872a13c-ac25-4120-82df-678376da1efc admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:30.324351 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872a13c-ac25-4120-82df-678376da1efc admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:30.324514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d0628-ec96-48b3-962f-4a01392d67d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:30.324633 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872a13c-ac25-4120-82df-678376da1efc admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:30.324781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d0628-ec96-48b3-962f-4a01392d67d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:30.325586 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d0628-ec96-48b3-962f-4a01392d67d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:30.325830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872a13c-ac25-4120-82df-678376da1efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:22:30.330536 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872a13c-ac25-4120-82df-678376da1efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:30.330804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d0628-ec96-48b3-962f-4a01392d67d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:30.330804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: WARNING py.warnings [None req-856d0628-ec96-48b3-962f-4a01392d67d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:22:30.330804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: warnings.warn(msg) Sep 02 21:22:30.330804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: Sep 02 21:22:30.331211 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872a13c-ac25-4120-82df-678376da1efc admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:30.331315 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d0628-ec96-48b3-962f-4a01392d67d4 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:30.348520 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 758/1559] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:22:30.348520 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633be97a-0324-4f85-8e99-83085198a7d2 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:30.348520 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633be97a-0324-4f85-8e99-83085198a7d2 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:30.348520 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633be97a-0324-4f85-8e99-83085198a7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:30.364000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-633be97a-0324-4f85-8e99-83085198a7d2 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:30.365214 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-633be97a-0324-4f85-8e99-83085198a7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:30.373700 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 759/1560] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:30.375018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e000a-0915-4367-a4dd-2d26aae8b83b None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:30.375296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e000a-0915-4367-a4dd-2d26aae8b83b None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:30.375568 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e000a-0915-4367-a4dd-2d26aae8b83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:30.397032 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-a77e000a-0915-4367-a4dd-2d26aae8b83b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:30.398267 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-a77e000a-0915-4367-a4dd-2d26aae8b83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:30.407899 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 760/1561] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:30.408535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e000a-0915-4367-a4dd-2d26aae8b83b None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:30.418173 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e000a-0915-4367-a4dd-2d26aae8b83b None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:30.421986 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 802/1562] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:22:30 2022] POST /identity/v3/projects => generated 393 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:30.421986 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d0628-ec96-48b3-962f-4a01392d67d4 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:30.475807 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:30.485574 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:30.490269 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740c09f-192f-4969-9324-ffedcecf49d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:30.491607 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740c09f-192f-4969-9324-ffedcecf49d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:30.492116 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740c09f-192f-4969-9324-ffedcecf49d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:30.492463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740c09f-192f-4969-9324-ffedcecf49d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:30.493219 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740c09f-192f-4969-9324-ffedcecf49d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:22:30.493602 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740c09f-192f-4969-9324-ffedcecf49d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:30.495599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740c09f-192f-4969-9324-ffedcecf49d5 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:30.495747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d0628-ec96-48b3-962f-4a01392d67d4 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:30.501503 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1085a-27a7-478b-9e89-fdebeb201f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:30.502223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1085a-27a7-478b-9e89-fdebeb201f38 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:30.502542 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1085a-27a7-478b-9e89-fdebeb201f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:30.502818 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1085a-27a7-478b-9e89-fdebeb201f38 admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:30.503485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1085a-27a7-478b-9e89-fdebeb201f38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:22:30.503789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1085a-27a7-478b-9e89-fdebeb201f38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:30.505605 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1085a-27a7-478b-9e89-fdebeb201f38 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:30.512271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 761/1563] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:22:30.514267 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740c09f-192f-4969-9324-ffedcecf49d5 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:30.519309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 803/1564] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:22:30.519309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1085a-27a7-478b-9e89-fdebeb201f38 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:30.526599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740c09f-192f-4969-9324-ffedcecf49d5 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:30.532210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c4901-d90f-4e46-9128-2212c722510b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:30.533352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c4901-d90f-4e46-9128-2212c722510b admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:30.533352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c4901-d90f-4e46-9128-2212c722510b admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:30.533563 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c4901-d90f-4e46-9128-2212c722510b admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:30.534214 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c4901-d90f-4e46-9128-2212c722510b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:30.535823 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c4901-d90f-4e46-9128-2212c722510b admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:30.536887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1085a-27a7-478b-9e89-fdebeb201f38 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:30.541959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e989ba9-7cad-4606-aede-d06519f3fc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:30.542641 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e989ba9-7cad-4606-aede-d06519f3fc1c admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:30.542927 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e989ba9-7cad-4606-aede-d06519f3fc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:30.543205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e989ba9-7cad-4606-aede-d06519f3fc1c admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:30.544055 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e989ba9-7cad-4606-aede-d06519f3fc1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:30.546043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e989ba9-7cad-4606-aede-d06519f3fc1c admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:30.547329 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 762/1565] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:30.550999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c4901-d90f-4e46-9128-2212c722510b admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:30.562771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c4901-d90f-4e46-9128-2212c722510b admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:30.568388 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365333bc-4d2f-4fbc-bf17-6aa51b4dedb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:30.569128 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365333bc-4d2f-4fbc-bf17-6aa51b4dedb5 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:30.569481 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365333bc-4d2f-4fbc-bf17-6aa51b4dedb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:30.569953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365333bc-4d2f-4fbc-bf17-6aa51b4dedb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:30.570685 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365333bc-4d2f-4fbc-bf17-6aa51b4dedb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:30.572699 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365333bc-4d2f-4fbc-bf17-6aa51b4dedb5 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:30.747519 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 804/1566] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:22:30 2022] POST /identity/v3/projects => generated 383 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:30.748458 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e989ba9-7cad-4606-aede-d06519f3fc1c admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:30.755618 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 763/1567] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:22:30 2022] POST /identity/v3/projects => generated 405 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:30.755618 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365333bc-4d2f-4fbc-bf17-6aa51b4dedb5 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:30.827198 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365333bc-4d2f-4fbc-bf17-6aa51b4dedb5 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:30.830766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e989ba9-7cad-4606-aede-d06519f3fc1c admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:30.832838 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577997a-c0fa-41ee-8f6a-89abe1350afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:30.833877 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577997a-c0fa-41ee-8f6a-89abe1350afc admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:30.834414 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577997a-c0fa-41ee-8f6a-89abe1350afc admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:30.834695 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577997a-c0fa-41ee-8f6a-89abe1350afc admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:30.835383 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577997a-c0fa-41ee-8f6a-89abe1350afc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:22:30.835687 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577997a-c0fa-41ee-8f6a-89abe1350afc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:30.836068 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310174d9-15a1-42d6-8db8-34d698c211fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:30.836686 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310174d9-15a1-42d6-8db8-34d698c211fa admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:30.836972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310174d9-15a1-42d6-8db8-34d698c211fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:30.837250 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310174d9-15a1-42d6-8db8-34d698c211fa admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:30.837356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577997a-c0fa-41ee-8f6a-89abe1350afc admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:30.837947 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310174d9-15a1-42d6-8db8-34d698c211fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:22:30.838259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310174d9-15a1-42d6-8db8-34d698c211fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:30.839935 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310174d9-15a1-42d6-8db8-34d698c211fa admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:31.030585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 764/1568] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:22:31.031144 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 805/1569] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:22:31.031718 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577997a-c0fa-41ee-8f6a-89abe1350afc admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:31.032300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310174d9-15a1-42d6-8db8-34d698c211fa admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:31.043977 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310174d9-15a1-42d6-8db8-34d698c211fa admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:31.047906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577997a-c0fa-41ee-8f6a-89abe1350afc admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:31.050738 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fe7f4-d65e-4e20-b3fb-fa25f16b32e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:31.051518 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fe7f4-d65e-4e20-b3fb-fa25f16b32e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:31.051679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fe7f4-d65e-4e20-b3fb-fa25f16b32e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:31.051961 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fe7f4-d65e-4e20-b3fb-fa25f16b32e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:31.052601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fe7f4-d65e-4e20-b3fb-fa25f16b32e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:31.054473 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c9a53-98be-411c-b7c9-3692beeb7c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:31.054621 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fe7f4-d65e-4e20-b3fb-fa25f16b32e7 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:31.055109 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c9a53-98be-411c-b7c9-3692beeb7c3e admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:31.055427 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c9a53-98be-411c-b7c9-3692beeb7c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:31.055740 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c9a53-98be-411c-b7c9-3692beeb7c3e admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:31.056381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c9a53-98be-411c-b7c9-3692beeb7c3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:31.058467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c9a53-98be-411c-b7c9-3692beeb7c3e admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:31.214705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 806/1570] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:22:31 2022] POST /identity/v3/projects => generated 383 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:31.215452 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fe7f4-d65e-4e20-b3fb-fa25f16b32e7 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:31.388592 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fe7f4-d65e-4e20-b3fb-fa25f16b32e7 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:31.393955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95277edd-3c62-4cc4-9f7e-d4059aeb1fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:31.394663 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95277edd-3c62-4cc4-9f7e-d4059aeb1fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:31.395035 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95277edd-3c62-4cc4-9f7e-d4059aeb1fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:31.395246 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95277edd-3c62-4cc4-9f7e-d4059aeb1fc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:31.395867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95277edd-3c62-4cc4-9f7e-d4059aeb1fc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:31.398328 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95277edd-3c62-4cc4-9f7e-d4059aeb1fc3 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:31.482749 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 765/1571] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:22:31 2022] POST /identity/v3/users => generated 297 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:31.483515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c9a53-98be-411c-b7c9-3692beeb7c3e admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:31.494850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c9a53-98be-411c-b7c9-3692beeb7c3e admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:31.500022 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55541a7-bc5c-47f8-ae40-66ddb9725473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:31.500650 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55541a7-bc5c-47f8-ae40-66ddb9725473 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:31.500931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55541a7-bc5c-47f8-ae40-66ddb9725473 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:31.501205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55541a7-bc5c-47f8-ae40-66ddb9725473 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:31.501957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55541a7-bc5c-47f8-ae40-66ddb9725473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:31.505636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55541a7-bc5c-47f8-ae40-66ddb9725473 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:31.521150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 766/1572] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:31.521902 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55541a7-bc5c-47f8-ae40-66ddb9725473 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:31.529330 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 807/1573] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:22:31 2022] POST /identity/v3/projects => generated 403 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:31.529330 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95277edd-3c62-4cc4-9f7e-d4059aeb1fc3 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:31.536506 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55541a7-bc5c-47f8-ae40-66ddb9725473 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:31.580841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:31.623082 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc3652-fbe8-4a47-a533-5db7fb0011e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:31.623552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc3652-fbe8-4a47-a533-5db7fb0011e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:31.623908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc3652-fbe8-4a47-a533-5db7fb0011e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:31.624186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc3652-fbe8-4a47-a533-5db7fb0011e0 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:31.624851 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc3652-fbe8-4a47-a533-5db7fb0011e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:31.626904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc3652-fbe8-4a47-a533-5db7fb0011e0 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:31.627949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95277edd-3c62-4cc4-9f7e-d4059aeb1fc3 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:31.634691 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c520f-ecd2-44e4-a533-b1f6540f68cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:31.635683 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c520f-ecd2-44e4-a533-b1f6540f68cf admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:31.636116 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c520f-ecd2-44e4-a533-b1f6540f68cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:31.637032 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c520f-ecd2-44e4-a533-b1f6540f68cf admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:31.637788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c520f-ecd2-44e4-a533-b1f6540f68cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:31.640497 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c520f-ecd2-44e4-a533-b1f6540f68cf admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:31.835130 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 767/1574] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:22:31 2022] POST /identity/v3/users => generated 292 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:31.835130 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc3652-fbe8-4a47-a533-5db7fb0011e0 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:31.839431 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc3652-fbe8-4a47-a533-5db7fb0011e0 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:31.845212 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce74f8-33b8-472b-9f57-b64e7254302a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:31.845832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce74f8-33b8-472b-9f57-b64e7254302a admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:31.846127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce74f8-33b8-472b-9f57-b64e7254302a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:31.846478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce74f8-33b8-472b-9f57-b64e7254302a admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:31.847113 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce74f8-33b8-472b-9f57-b64e7254302a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:31.848998 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce74f8-33b8-472b-9f57-b64e7254302a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:31.854614 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:31.865233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 808/1575] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:22:31 2022] POST /identity/v3/users => generated 303 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:31.867202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c520f-ecd2-44e4-a533-b1f6540f68cf admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:31.880868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c520f-ecd2-44e4-a533-b1f6540f68cf admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:31.885795 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a30d7-eb3b-4d7a-9e1d-7b59ae2b032a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:31.886449 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a30d7-eb3b-4d7a-9e1d-7b59ae2b032a admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:31.886770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a30d7-eb3b-4d7a-9e1d-7b59ae2b032a admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:31.887015 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a30d7-eb3b-4d7a-9e1d-7b59ae2b032a admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:31.887663 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a30d7-eb3b-4d7a-9e1d-7b59ae2b032a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:31.890385 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a30d7-eb3b-4d7a-9e1d-7b59ae2b032a admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:31.998250 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 768/1576] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:22:31 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:32.010288 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce74f8-33b8-472b-9f57-b64e7254302a admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:32.068457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce74f8-33b8-472b-9f57-b64e7254302a admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:32.073300 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0042995-f987-4fb7-9d4f-723d2c72839c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:32.074013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0042995-f987-4fb7-9d4f-723d2c72839c admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:32.074299 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0042995-f987-4fb7-9d4f-723d2c72839c admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:32.074576 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0042995-f987-4fb7-9d4f-723d2c72839c admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:32.075221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0042995-f987-4fb7-9d4f-723d2c72839c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:32.077953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0042995-f987-4fb7-9d4f-723d2c72839c admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:32.140238 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 809/1577] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:22:31 2022] POST /identity/v3/projects => generated 375 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:32.140238 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a30d7-eb3b-4d7a-9e1d-7b59ae2b032a admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:32.215824 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a30d7-eb3b-4d7a-9e1d-7b59ae2b032a admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:32.221310 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92cbf7-b88b-45bc-ab77-006812a1aa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:32.221962 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92cbf7-b88b-45bc-ab77-006812a1aa3c admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:32.222244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92cbf7-b88b-45bc-ab77-006812a1aa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:32.222615 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92cbf7-b88b-45bc-ab77-006812a1aa3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:32.224733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92cbf7-b88b-45bc-ab77-006812a1aa3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:32.224992 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92cbf7-b88b-45bc-ab77-006812a1aa3c admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:32.237577 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 810/1578] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:32.238692 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92cbf7-b88b-45bc-ab77-006812a1aa3c admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:32.252346 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92cbf7-b88b-45bc-ab77-006812a1aa3c admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:32.259957 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bde89-4b4b-4e25-a457-192645dfae19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:32.259957 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bde89-4b4b-4e25-a457-192645dfae19 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:32.259957 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bde89-4b4b-4e25-a457-192645dfae19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:32.259957 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bde89-4b4b-4e25-a457-192645dfae19 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:32.260467 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bde89-4b4b-4e25-a457-192645dfae19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:32.261467 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bde89-4b4b-4e25-a457-192645dfae19 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:32.306472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 769/1579] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:22:31 2022] POST /identity/v3/users => generated 292 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:32.306472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0042995-f987-4fb7-9d4f-723d2c72839c admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:32.316010 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0042995-f987-4fb7-9d4f-723d2c72839c admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:32.321403 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ae5b9-de35-41c8-a633-2875b3892b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:32.322144 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ae5b9-de35-41c8-a633-2875b3892b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:32.322431 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ae5b9-de35-41c8-a633-2875b3892b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:32.322713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ae5b9-de35-41c8-a633-2875b3892b46 admin admin] PATH_INFO: `/v3/projects/90aa668555c54d508063d931dba2d751/users/02bf6738503a44b0908ecd38116842d2/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:32.340824 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ae5b9-de35-41c8-a633-2875b3892b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90aa668555c54d508063d931dba2d751, user_id=02bf6738503a44b0908ecd38116842d2, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:32.344766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ae5b9-de35-41c8-a633-2875b3892b46 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:32.447850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 811/1580] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:22:32 2022] POST /identity/v3/users => generated 302 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:32.448525 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bde89-4b4b-4e25-a457-192645dfae19 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:32.460810 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bde89-4b4b-4e25-a457-192645dfae19 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:32.467331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497957e7-d80c-4cc5-92ff-6fa1d810b8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:32.468098 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497957e7-d80c-4cc5-92ff-6fa1d810b8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:32.468325 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497957e7-d80c-4cc5-92ff-6fa1d810b8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:32.468600 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497957e7-d80c-4cc5-92ff-6fa1d810b8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:32.469248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497957e7-d80c-4cc5-92ff-6fa1d810b8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:32.470901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497957e7-d80c-4cc5-92ff-6fa1d810b8e8 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:32.482581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 812/1581] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:32.483501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497957e7-d80c-4cc5-92ff-6fa1d810b8e8 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:32.488638 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 770/1582] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:22:32 2022] PUT /identity/v3/projects/90aa668555c54d508063d931dba2d751/users/02bf6738503a44b0908ecd38116842d2/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:22:32.495441 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ae5b9-de35-41c8-a633-2875b3892b46 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:32.495590 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497957e7-d80c-4cc5-92ff-6fa1d810b8e8 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:32.550919 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:32.558895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a9410-4a8b-4d1e-8a7a-00b86a27d698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:32.559564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a9410-4a8b-4d1e-8a7a-00b86a27d698 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:32.559714 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ae5b9-de35-41c8-a633-2875b3892b46 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:32.559851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a9410-4a8b-4d1e-8a7a-00b86a27d698 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:32.560239 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a9410-4a8b-4d1e-8a7a-00b86a27d698 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:32.560839 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a9410-4a8b-4d1e-8a7a-00b86a27d698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:32.562523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a9410-4a8b-4d1e-8a7a-00b86a27d698 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:32.565229 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9859b81-835b-414e-bd83-a08f13bf99e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:32.565882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9859b81-835b-414e-bd83-a08f13bf99e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:32.566174 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9859b81-835b-414e-bd83-a08f13bf99e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:32.566451 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9859b81-835b-414e-bd83-a08f13bf99e9 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:32.567101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9859b81-835b-414e-bd83-a08f13bf99e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:32.569105 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9859b81-835b-414e-bd83-a08f13bf99e9 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:32.573023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 813/1583] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:32.573987 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a9410-4a8b-4d1e-8a7a-00b86a27d698 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:32.598111 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a9410-4a8b-4d1e-8a7a-00b86a27d698 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:32.603340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16385c6-61a6-4415-93d6-e5dc4503e9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:32.603961 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16385c6-61a6-4415-93d6-e5dc4503e9a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:32.604246 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16385c6-61a6-4415-93d6-e5dc4503e9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:32.604527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16385c6-61a6-4415-93d6-e5dc4503e9a5 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:32.605175 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16385c6-61a6-4415-93d6-e5dc4503e9a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:32.607289 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16385c6-61a6-4415-93d6-e5dc4503e9a5 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:32.733701 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 771/1584] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:22:32 2022] POST /identity/v3/users => generated 294 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:32.734819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9859b81-835b-414e-bd83-a08f13bf99e9 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:32.749702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9859b81-835b-414e-bd83-a08f13bf99e9 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:32.757209 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe21484-d8c4-4e14-ab7a-dcf94981f39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:32.757961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe21484-d8c4-4e14-ab7a-dcf94981f39a admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:32.758330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe21484-d8c4-4e14-ab7a-dcf94981f39a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:32.758562 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe21484-d8c4-4e14-ab7a-dcf94981f39a admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:32.759251 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe21484-d8c4-4e14-ab7a-dcf94981f39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:32.761039 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe21484-d8c4-4e14-ab7a-dcf94981f39a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:32.774005 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 772/1585] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:32.774872 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe21484-d8c4-4e14-ab7a-dcf94981f39a admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:32.788911 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe21484-d8c4-4e14-ab7a-dcf94981f39a admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:32.794207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06a76a-def6-40cb-ae7f-be63172e527d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:32.794473 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06a76a-def6-40cb-ae7f-be63172e527d admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:32.794789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06a76a-def6-40cb-ae7f-be63172e527d admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:32.795091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06a76a-def6-40cb-ae7f-be63172e527d admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:32.795988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06a76a-def6-40cb-ae7f-be63172e527d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:32.797495 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06a76a-def6-40cb-ae7f-be63172e527d admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:32.812049 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 773/1586] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:32.812905 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06a76a-def6-40cb-ae7f-be63172e527d admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:32.823015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06a76a-def6-40cb-ae7f-be63172e527d admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:32.829201 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dc6af-e8ec-4717-9c41-3485c1b547c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:32.829879 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dc6af-e8ec-4717-9c41-3485c1b547c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:32.830132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dc6af-e8ec-4717-9c41-3485c1b547c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:32.830414 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dc6af-e8ec-4717-9c41-3485c1b547c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:32.831279 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61dc6af-e8ec-4717-9c41-3485c1b547c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:32.832889 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61dc6af-e8ec-4717-9c41-3485c1b547c1 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:32.838502 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 814/1587] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:22:32 2022] POST /identity/v3/users => generated 288 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:32.849220 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16385c6-61a6-4415-93d6-e5dc4503e9a5 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:32.849357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 774/1588] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:32.849357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd540ff6-843a-42f3-9104-2d1031b89d7d None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:32.849357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd540ff6-843a-42f3-9104-2d1031b89d7d None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:32.849357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd540ff6-843a-42f3-9104-2d1031b89d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:32.854978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16385c6-61a6-4415-93d6-e5dc4503e9a5 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:32.860552 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2e51e-d7c9-44b6-b76f-49023aeab6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:32.861202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2e51e-d7c9-44b6-b76f-49023aeab6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:32.861522 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2e51e-d7c9-44b6-b76f-49023aeab6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:32.861876 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2e51e-d7c9-44b6-b76f-49023aeab6c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:32.862648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2e51e-d7c9-44b6-b76f-49023aeab6c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:32.864524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2e51e-d7c9-44b6-b76f-49023aeab6c5 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:32.867562 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-cd540ff6-843a-42f3-9104-2d1031b89d7d None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:32.868856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-cd540ff6-843a-42f3-9104-2d1031b89d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:32.877504 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 775/1589] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:32.878491 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd540ff6-843a-42f3-9104-2d1031b89d7d None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:32.881029 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 815/1590] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:32.881963 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2e51e-d7c9-44b6-b76f-49023aeab6c5 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:32.883837 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:32.890953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd540ff6-843a-42f3-9104-2d1031b89d7d None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:32.893168 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2e51e-d7c9-44b6-b76f-49023aeab6c5 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:32.895859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdd856-4bdd-4072-8b67-096ceae277ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:32.896474 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdd856-4bdd-4072-8b67-096ceae277ec admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:32.896761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdd856-4bdd-4072-8b67-096ceae277ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:32.897038 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdd856-4bdd-4072-8b67-096ceae277ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:32.897698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdd856-4bdd-4072-8b67-096ceae277ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:32.898021 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8aaac3-1e79-45cd-a8dd-769f93232ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:32.898624 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8aaac3-1e79-45cd-a8dd-769f93232ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:32.898973 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8aaac3-1e79-45cd-a8dd-769f93232ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:32.899362 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8aaac3-1e79-45cd-a8dd-769f93232ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:32.899529 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdd856-4bdd-4072-8b67-096ceae277ec admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:32.900002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8aaac3-1e79-45cd-a8dd-769f93232ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:32.901631 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8aaac3-1e79-45cd-a8dd-769f93232ef4 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:32.910806 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 776/1591] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:32.911635 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdd856-4bdd-4072-8b67-096ceae277ec admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:32.915471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 816/1592] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:32.915471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8aaac3-1e79-45cd-a8dd-769f93232ef4 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:32.922760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdd856-4bdd-4072-8b67-096ceae277ec admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:32.923555 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8aaac3-1e79-45cd-a8dd-769f93232ef4 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:32.928177 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b53736-c1da-4a60-8bcb-3df4f1134b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:32.928427 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49fbfc-6b1d-46de-aed8-2a56a58d801a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:32.928845 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b53736-c1da-4a60-8bcb-3df4f1134b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:32.929017 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49fbfc-6b1d-46de-aed8-2a56a58d801a admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:32.929117 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b53736-c1da-4a60-8bcb-3df4f1134b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:32.929298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49fbfc-6b1d-46de-aed8-2a56a58d801a admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:32.929403 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b53736-c1da-4a60-8bcb-3df4f1134b9b admin admin] PATH_INFO: `/v3/projects/347df6259a3e48fcbdcbb3f895d38bd4/users/c81bafbe3e444e84a7da18ac9d782479/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:32.929579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49fbfc-6b1d-46de-aed8-2a56a58d801a admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:32.930253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49fbfc-6b1d-46de-aed8-2a56a58d801a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:32.931853 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49fbfc-6b1d-46de-aed8-2a56a58d801a admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:32.942590 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 817/1593] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:32.943341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49fbfc-6b1d-46de-aed8-2a56a58d801a admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:32.949796 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b53736-c1da-4a60-8bcb-3df4f1134b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=347df6259a3e48fcbdcbb3f895d38bd4, user_id=c81bafbe3e444e84a7da18ac9d782479, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:32.953384 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b53736-c1da-4a60-8bcb-3df4f1134b9b admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:32.953831 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49fbfc-6b1d-46de-aed8-2a56a58d801a admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:32.958659 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb7b9b-4876-4f93-81f7-47a054f3675c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:32.959268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb7b9b-4876-4f93-81f7-47a054f3675c admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:32.959572 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb7b9b-4876-4f93-81f7-47a054f3675c admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:32.959836 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb7b9b-4876-4f93-81f7-47a054f3675c admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:32.960480 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb7b9b-4876-4f93-81f7-47a054f3675c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:32.962121 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb7b9b-4876-4f93-81f7-47a054f3675c admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:32.974007 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 818/1594] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:32.974987 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb7b9b-4876-4f93-81f7-47a054f3675c admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:32.984716 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb7b9b-4876-4f93-81f7-47a054f3675c admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:32.991199 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a76bf-ea38-4909-af30-34f5bab4a5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:32.992004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a76bf-ea38-4909-af30-34f5bab4a5ae admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:32.992289 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a76bf-ea38-4909-af30-34f5bab4a5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:32.992545 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a76bf-ea38-4909-af30-34f5bab4a5ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:32.993198 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a76bf-ea38-4909-af30-34f5bab4a5ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:32.994834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a76bf-ea38-4909-af30-34f5bab4a5ae admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:33.006345 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 819/1595] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:33.016713 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a76bf-ea38-4909-af30-34f5bab4a5ae admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:33.018207 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a76bf-ea38-4909-af30-34f5bab4a5ae admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:33.023104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95263e-300f-4776-b0eb-666fd989e422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:33.023758 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95263e-300f-4776-b0eb-666fd989e422 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:33.024040 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95263e-300f-4776-b0eb-666fd989e422 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:33.024457 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95263e-300f-4776-b0eb-666fd989e422 admin admin] PATH_INFO: `/v3/projects/38f7612716054ce88a6791878374e3ef/users/66d4ab66a7ea49358832911cf6beb240/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:33.040141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95263e-300f-4776-b0eb-666fd989e422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f7612716054ce88a6791878374e3ef, user_id=66d4ab66a7ea49358832911cf6beb240, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:33.041196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: WARNING py.warnings [None req-ee95263e-300f-4776-b0eb-666fd989e422 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:22:33.041196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: warnings.warn(msg) Sep 02 21:22:33.041196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: Sep 02 21:22:33.043189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95263e-300f-4776-b0eb-666fd989e422 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:33.162721 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 777/1596] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:22:32 2022] PUT /identity/v3/projects/347df6259a3e48fcbdcbb3f895d38bd4/users/c81bafbe3e444e84a7da18ac9d782479/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:22:33.163617 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b53736-c1da-4a60-8bcb-3df4f1134b9b admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:33.220887 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b53736-c1da-4a60-8bcb-3df4f1134b9b admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:33.225842 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bd5e7-42fe-442c-8d85-2f1e3ab8e94c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:33.226604 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bd5e7-42fe-442c-8d85-2f1e3ab8e94c service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:33.226916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bd5e7-42fe-442c-8d85-2f1e3ab8e94c service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:33.227219 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bd5e7-42fe-442c-8d85-2f1e3ab8e94c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:33.251384 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 820/1597] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:22:33 2022] PUT /identity/v3/projects/38f7612716054ce88a6791878374e3ef/users/66d4ab66a7ea49358832911cf6beb240/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:22:33.252661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95263e-300f-4776-b0eb-666fd989e422 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:33.309431 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bd5e7-42fe-442c-8d85-2f1e3ab8e94c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:33.311579 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bd5e7-42fe-442c-8d85-2f1e3ab8e94c service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:33.322653 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 778/1598] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:22:33.323717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bd5e7-42fe-442c-8d85-2f1e3ab8e94c service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:33.329578 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95263e-300f-4776-b0eb-666fd989e422 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:33.334310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bd5e7-42fe-442c-8d85-2f1e3ab8e94c service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:33.335102 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba39110-7773-48f3-806d-aa3da4b35129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:33.335752 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba39110-7773-48f3-806d-aa3da4b35129 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:33.335951 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba39110-7773-48f3-806d-aa3da4b35129 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:33.336205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba39110-7773-48f3-806d-aa3da4b35129 admin admin] PATH_INFO: `/v3/projects/f149d8b33b6f4dd2886c27d8c5642e31/users/93ceb9bf88924968a3355302ca66a3c0/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:33.343689 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7455f0-583b-4a66-af2c-36b5893eac13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:33.344779 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7455f0-583b-4a66-af2c-36b5893eac13 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:33.345544 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7455f0-583b-4a66-af2c-36b5893eac13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:33.346000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7455f0-583b-4a66-af2c-36b5893eac13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:33.346973 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7455f0-583b-4a66-af2c-36b5893eac13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:33.348804 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7455f0-583b-4a66-af2c-36b5893eac13 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:33.354652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba39110-7773-48f3-806d-aa3da4b35129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f149d8b33b6f4dd2886c27d8c5642e31, user_id=93ceb9bf88924968a3355302ca66a3c0, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:33.360712 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba39110-7773-48f3-806d-aa3da4b35129 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:33.362218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 779/1599] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:33.363085 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7455f0-583b-4a66-af2c-36b5893eac13 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:33.375382 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7455f0-583b-4a66-af2c-36b5893eac13 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:33.380309 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa10978-ad45-4309-adfb-3da16e0dd716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:33.380906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa10978-ad45-4309-adfb-3da16e0dd716 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:33.381186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa10978-ad45-4309-adfb-3da16e0dd716 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:33.381460 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa10978-ad45-4309-adfb-3da16e0dd716 admin admin] PATH_INFO: `/v3/projects/ca6e4f9f3af64916a1aae6ccb1b492a2/users/7622cffd25e740bea34fdc1c80e4560f/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:33.398817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa10978-ad45-4309-adfb-3da16e0dd716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca6e4f9f3af64916a1aae6ccb1b492a2, user_id=7622cffd25e740bea34fdc1c80e4560f, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:33.401527 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa10978-ad45-4309-adfb-3da16e0dd716 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:33.492522 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 821/1600] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:22:33 2022] PUT /identity/v3/projects/f149d8b33b6f4dd2886c27d8c5642e31/users/93ceb9bf88924968a3355302ca66a3c0/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:22:33.494060 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba39110-7773-48f3-806d-aa3da4b35129 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:33.549354 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 780/1601] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:22:33 2022] PUT /identity/v3/projects/ca6e4f9f3af64916a1aae6ccb1b492a2/users/7622cffd25e740bea34fdc1c80e4560f/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:22:33.554655 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:33.559353 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa10978-ad45-4309-adfb-3da16e0dd716 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:33.577039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba39110-7773-48f3-806d-aa3da4b35129 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:33.630554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:33.655101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa10978-ad45-4309-adfb-3da16e0dd716 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:33.658268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c94ba8-f53b-4c5c-a5ca-8d49aab0c60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:33.659029 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c94ba8-f53b-4c5c-a5ca-8d49aab0c60c admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:33.659318 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c94ba8-f53b-4c5c-a5ca-8d49aab0c60c admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:33.659851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c94ba8-f53b-4c5c-a5ca-8d49aab0c60c admin admin] PATH_INFO: `/v3/projects/8647a378fc0e46eb9a96d8ff503c6ef4/users/2a852dc0243d48648fb11b621537f3d6/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:33.663586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd2c49-e2ea-40aa-ba41-969590c13754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:33.664364 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd2c49-e2ea-40aa-ba41-969590c13754 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:33.664726 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd2c49-e2ea-40aa-ba41-969590c13754 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:33.665075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd2c49-e2ea-40aa-ba41-969590c13754 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:33.665835 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd2c49-e2ea-40aa-ba41-969590c13754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:33.668242 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd2c49-e2ea-40aa-ba41-969590c13754 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:33.679480 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c94ba8-f53b-4c5c-a5ca-8d49aab0c60c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8647a378fc0e46eb9a96d8ff503c6ef4, user_id=2a852dc0243d48648fb11b621537f3d6, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:33.684668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 781/1602] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:33.685001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c94ba8-f53b-4c5c-a5ca-8d49aab0c60c admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:33.685131 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a4d1d-d051-4089-8553-d73e23b4eb6f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:33.685131 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a4d1d-d051-4089-8553-d73e23b4eb6f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:33.685131 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a4d1d-d051-4089-8553-d73e23b4eb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:33.713973 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-f46a4d1d-d051-4089-8553-d73e23b4eb6f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:33.715438 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f46a4d1d-d051-4089-8553-d73e23b4eb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:33.725346 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 782/1603] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:33.726610 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860c4fc-a564-424c-9483-882d9024a82f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:33.726935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860c4fc-a564-424c-9483-882d9024a82f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:33.727403 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860c4fc-a564-424c-9483-882d9024a82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:33.769342 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-c860c4fc-a564-424c-9483-882d9024a82f None None] MFA Rules not processed for user `66d4ab66a7ea49358832911cf6beb240`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:33.770752 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-c860c4fc-a564-424c-9483-882d9024a82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:33.846599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 783/1604] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:33.847438 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860c4fc-a564-424c-9483-882d9024a82f None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:33.856157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 822/1605] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:22:33 2022] PUT /identity/v3/projects/8647a378fc0e46eb9a96d8ff503c6ef4/users/2a852dc0243d48648fb11b621537f3d6/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:22:33.858981 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a15522-aaba-47d2-838d-7da888a54b0f None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:33.858981 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a15522-aaba-47d2-838d-7da888a54b0f None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:33.858981 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a15522-aaba-47d2-838d-7da888a54b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:33.859722 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860c4fc-a564-424c-9483-882d9024a82f None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:33.896339 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-f7a15522-aaba-47d2-838d-7da888a54b0f None None] MFA Rules not processed for user `93ceb9bf88924968a3355302ca66a3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:33.897705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f7a15522-aaba-47d2-838d-7da888a54b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:33.934899 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed71043-4929-4c74-802a-94988eb43cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:33.934899 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed71043-4929-4c74-802a-94988eb43cff admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:33.934899 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed71043-4929-4c74-802a-94988eb43cff admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:33.935886 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed71043-4929-4c74-802a-94988eb43cff admin admin] PATH_INFO: `/v3/projects/6dbbc6a603794466b64e5822ea9a19f3/users/aa84378418324708b40f0791e2217ccc/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:33.958009 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed71043-4929-4c74-802a-94988eb43cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dbbc6a603794466b64e5822ea9a19f3, user_id=aa84378418324708b40f0791e2217ccc, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:33.963217 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed71043-4929-4c74-802a-94988eb43cff admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:33.983903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 823/1606] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:33 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:33.985306 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf545272-3ffb-4521-94e6-316767566d5c None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:33.985606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf545272-3ffb-4521-94e6-316767566d5c None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:33.985919 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf545272-3ffb-4521-94e6-316767566d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:34.024505 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-cf545272-3ffb-4521-94e6-316767566d5c None None] MFA Rules not processed for user `7622cffd25e740bea34fdc1c80e4560f`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:34.025663 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-cf545272-3ffb-4521-94e6-316767566d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:34.091333 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:34.110295 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 784/1607] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:22:33 2022] PUT /identity/v3/projects/6dbbc6a603794466b64e5822ea9a19f3/users/aa84378418324708b40f0791e2217ccc/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:22:34.111460 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed71043-4929-4c74-802a-94988eb43cff admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:34.112965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 824/1608] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:34.114044 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf545272-3ffb-4521-94e6-316767566d5c None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:34.115817 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-cf545272-3ffb-4521-94e6-316767566d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:34.178640 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:34.192472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf545272-3ffb-4521-94e6-316767566d5c None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:34.202301 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed71043-4929-4c74-802a-94988eb43cff admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:34.206979 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce81cd9-834c-4d87-8b81-284e64d6683f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:34.207654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce81cd9-834c-4d87-8b81-284e64d6683f admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:34.207996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce81cd9-834c-4d87-8b81-284e64d6683f admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:34.208281 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce81cd9-834c-4d87-8b81-284e64d6683f admin admin] PATH_INFO: `/v3/projects/a7b20efaf7e440f9bbf2a1a0df19c556/users/cceaf0c4877a4316af9d15c642c9dfc4/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:34.224713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce81cd9-834c-4d87-8b81-284e64d6683f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b20efaf7e440f9bbf2a1a0df19c556, user_id=cceaf0c4877a4316af9d15c642c9dfc4, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:34.227452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce81cd9-834c-4d87-8b81-284e64d6683f admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:34.243670 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48414c-ee7c-44b8-b47a-39b78336d969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:34.246990 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48414c-ee7c-44b8-b47a-39b78336d969 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:34.246990 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48414c-ee7c-44b8-b47a-39b78336d969 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:34.246990 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48414c-ee7c-44b8-b47a-39b78336d969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:34.254645 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48414c-ee7c-44b8-b47a-39b78336d969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:34.256096 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48414c-ee7c-44b8-b47a-39b78336d969 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:34.266566 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 825/1609] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:22:34.267363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48414c-ee7c-44b8-b47a-39b78336d969 service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:34.281681 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48414c-ee7c-44b8-b47a-39b78336d969 service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:34.283321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bed324-24b3-4b8d-b04b-c9195558d0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:34.283938 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bed324-24b3-4b8d-b04b-c9195558d0fc admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:34.284251 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bed324-24b3-4b8d-b04b-c9195558d0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:34.284524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bed324-24b3-4b8d-b04b-c9195558d0fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:34.285161 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bed324-24b3-4b8d-b04b-c9195558d0fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:34.287356 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bed324-24b3-4b8d-b04b-c9195558d0fc admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:34.364900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 785/1610] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:22:34 2022] PUT /identity/v3/projects/a7b20efaf7e440f9bbf2a1a0df19c556/users/cceaf0c4877a4316af9d15c642c9dfc4/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:22:34.366473 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0a8c9-11c2-4362-85da-2892b1e3ff7e None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:34.367119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0a8c9-11c2-4362-85da-2892b1e3ff7e None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:34.367407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0a8c9-11c2-4362-85da-2892b1e3ff7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:34.388799 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-c8e0a8c9-11c2-4362-85da-2892b1e3ff7e None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:34.390111 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-c8e0a8c9-11c2-4362-85da-2892b1e3ff7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:34.429770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 826/1611] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:22:34 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:34.431278 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bed324-24b3-4b8d-b04b-c9195558d0fc admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:34.464882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 786/1612] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:34.466556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb1f03-816b-4d33-babb-e14a76e8794f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:34.467042 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb1f03-816b-4d33-babb-e14a76e8794f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:34.467454 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb1f03-816b-4d33-babb-e14a76e8794f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:34.489745 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-88bb1f03-816b-4d33-babb-e14a76e8794f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:34.491348 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-88bb1f03-816b-4d33-babb-e14a76e8794f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:34.515265 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bed324-24b3-4b8d-b04b-c9195558d0fc admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:34.520820 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b16db-dfd6-45ef-93da-a2e52433b262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:34.521923 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b16db-dfd6-45ef-93da-a2e52433b262 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:34.522281 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b16db-dfd6-45ef-93da-a2e52433b262 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:34.522790 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b16db-dfd6-45ef-93da-a2e52433b262 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:34.523494 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b16db-dfd6-45ef-93da-a2e52433b262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:34.525582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b16db-dfd6-45ef-93da-a2e52433b262 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:34.566843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 787/1613] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:34.568225 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873dd01-2997-4bbb-b51f-87b03950f0b8 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:34.568589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873dd01-2997-4bbb-b51f-87b03950f0b8 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:34.568940 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873dd01-2997-4bbb-b51f-87b03950f0b8 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:34.570378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 788/1614] 10.222.0.79 () {54 vars in 962 bytes} [Fri Sep 2 21:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:22:34.571560 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749de51f-20a1-4a96-91a7-b2cff58066d3 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:34.571842 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749de51f-20a1-4a96-91a7-b2cff58066d3 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:34.572116 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749de51f-20a1-4a96-91a7-b2cff58066d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:34.600626 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-749de51f-20a1-4a96-91a7-b2cff58066d3 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:34.602290 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-749de51f-20a1-4a96-91a7-b2cff58066d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:34.610510 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 789/1615] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:34.611293 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749de51f-20a1-4a96-91a7-b2cff58066d3 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:34.624765 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749de51f-20a1-4a96-91a7-b2cff58066d3 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:34.629761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ebcd0-9e64-4ef2-b363-296efd7f220d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:34.630692 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ebcd0-9e64-4ef2-b363-296efd7f220d admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:34.631017 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ebcd0-9e64-4ef2-b363-296efd7f220d admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:34.631369 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ebcd0-9e64-4ef2-b363-296efd7f220d admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:34.632013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ebcd0-9e64-4ef2-b363-296efd7f220d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:34.634168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ebcd0-9e64-4ef2-b363-296efd7f220d admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:34.759412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 827/1616] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:22:34 2022] POST /identity/v3/projects => generated 405 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:34.760297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b16db-dfd6-45ef-93da-a2e52433b262 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:34.804937 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 790/1617] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:22:34 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:34.804937 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242f080-37fd-4f60-8383-81c0d6dad66b None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:34.804937 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242f080-37fd-4f60-8383-81c0d6dad66b None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:34.804937 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242f080-37fd-4f60-8383-81c0d6dad66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:34.835511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b16db-dfd6-45ef-93da-a2e52433b262 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:34.841094 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a4aa9-297e-4ea8-8501-af020e311d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:34.842456 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a4aa9-297e-4ea8-8501-af020e311d96 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:34.842934 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a4aa9-297e-4ea8-8501-af020e311d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:34.843223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a4aa9-297e-4ea8-8501-af020e311d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:34.848900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-9242f080-37fd-4f60-8383-81c0d6dad66b None None] MFA Rules not processed for user `632071470f7d409ab7b0129d120320c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:34.850191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-9242f080-37fd-4f60-8383-81c0d6dad66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:34.914588 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a4aa9-297e-4ea8-8501-af020e311d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:34.916168 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a4aa9-297e-4ea8-8501-af020e311d96 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:34.926668 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 828/1618] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:22:34.927083 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 791/1619] 10.222.0.79 () {58 vars in 1059 bytes} [Fri Sep 2 21:22:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:34.927775 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a4aa9-297e-4ea8-8501-af020e311d96 service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:34.927965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242f080-37fd-4f60-8383-81c0d6dad66b None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:34.936509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a4aa9-297e-4ea8-8501-af020e311d96 service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:34.937763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242f080-37fd-4f60-8383-81c0d6dad66b None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:34.940886 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab01bc5-a63e-4d94-a1da-ba13651694f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:34.941575 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab01bc5-a63e-4d94-a1da-ba13651694f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:34.942000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab01bc5-a63e-4d94-a1da-ba13651694f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:34.942409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab01bc5-a63e-4d94-a1da-ba13651694f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:34.942668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45507f-96be-4ff7-a0f8-64f3b5483834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:34.943461 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45507f-96be-4ff7-a0f8-64f3b5483834 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:34.943900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45507f-96be-4ff7-a0f8-64f3b5483834 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:34.944329 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45507f-96be-4ff7-a0f8-64f3b5483834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:34.955120 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab01bc5-a63e-4d94-a1da-ba13651694f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:34.956436 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45507f-96be-4ff7-a0f8-64f3b5483834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:34.956805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab01bc5-a63e-4d94-a1da-ba13651694f9 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:34.957939 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45507f-96be-4ff7-a0f8-64f3b5483834 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:34.967738 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 829/1620] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:22:34.968665 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab01bc5-a63e-4d94-a1da-ba13651694f9 service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:34.971056 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 792/1621] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:22:34.974816 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45507f-96be-4ff7-a0f8-64f3b5483834 service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:34.978931 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab01bc5-a63e-4d94-a1da-ba13651694f9 service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:34.986745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5939ad-ad3f-473e-9d80-d246dd01f2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:34.987500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45507f-96be-4ff7-a0f8-64f3b5483834 service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:34.987631 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5939ad-ad3f-473e-9d80-d246dd01f2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:34.987960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5939ad-ad3f-473e-9d80-d246dd01f2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:34.988330 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5939ad-ad3f-473e-9d80-d246dd01f2b9 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:34.989344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5939ad-ad3f-473e-9d80-d246dd01f2b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:34.991342 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5939ad-ad3f-473e-9d80-d246dd01f2b9 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:34.996791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fd7c0-b93c-4466-9a12-66d2c60459b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:34.998670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fd7c0-b93c-4466-9a12-66d2c60459b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:35.002026 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fd7c0-b93c-4466-9a12-66d2c60459b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:35.002704 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fd7c0-b93c-4466-9a12-66d2c60459b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:35.003620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fd7c0-b93c-4466-9a12-66d2c60459b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:35.005473 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fd7c0-b93c-4466-9a12-66d2c60459b4 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:35.020730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 793/1622] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:35.020730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fd7c0-b93c-4466-9a12-66d2c60459b4 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:35.035137 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fd7c0-b93c-4466-9a12-66d2c60459b4 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:35.042527 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06f07c-f516-4205-a8c0-d8945c533e03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:35.043324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06f07c-f516-4205-a8c0-d8945c533e03 service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:35.043705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06f07c-f516-4205-a8c0-d8945c533e03 service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:35.044125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06f07c-f516-4205-a8c0-d8945c533e03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:35.128044 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06f07c-f516-4205-a8c0-d8945c533e03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:35.129621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06f07c-f516-4205-a8c0-d8945c533e03 service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:35.142631 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:35.154420 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 794/1623] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:22:35.156496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06f07c-f516-4205-a8c0-d8945c533e03 service nova] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:35.170788 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06f07c-f516-4205-a8c0-d8945c533e03 service nova] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:35.177616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4a9c8-ca6b-495d-9d5a-c67560c2e027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:35.178331 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4a9c8-ca6b-495d-9d5a-c67560c2e027 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:35.178619 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4a9c8-ca6b-495d-9d5a-c67560c2e027 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:35.178901 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4a9c8-ca6b-495d-9d5a-c67560c2e027 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:35.179581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4a9c8-ca6b-495d-9d5a-c67560c2e027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:35.181154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4a9c8-ca6b-495d-9d5a-c67560c2e027 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:35.207442 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 830/1624] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:22:34 2022] POST /identity/v3/users => generated 309 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:35.208530 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5939ad-ad3f-473e-9d80-d246dd01f2b9 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:35.209405 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 795/1625] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:35.216744 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4a9c8-ca6b-495d-9d5a-c67560c2e027 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:35.233284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5939ad-ad3f-473e-9d80-d246dd01f2b9 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:35.242748 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bb34d-c2a7-495a-ab5c-011d99452f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:35.243704 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4a9c8-ca6b-495d-9d5a-c67560c2e027 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:35.244146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bb34d-c2a7-495a-ab5c-011d99452f51 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:35.244650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bb34d-c2a7-495a-ab5c-011d99452f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:35.245107 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bb34d-c2a7-495a-ab5c-011d99452f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:35.246650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7bb34d-c2a7-495a-ab5c-011d99452f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:35.249611 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7bb34d-c2a7-495a-ab5c-011d99452f51 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:35.260259 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8c858-a1ba-4178-8cae-53b99aafb3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:35.260949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8c858-a1ba-4178-8cae-53b99aafb3b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:35.261230 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8c858-a1ba-4178-8cae-53b99aafb3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:35.261504 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8c858-a1ba-4178-8cae-53b99aafb3b2 admin admin] PATH_INFO: `/v3/projects/161a20f0c29b408f8f446d51ca5cc07b/users/16eb56fb49974fcb83155d1a17f810cd/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:35.267064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 831/1626] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:35.270518 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:35.289426 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bb34d-c2a7-495a-ab5c-011d99452f51 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:35.292813 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8c858-a1ba-4178-8cae-53b99aafb3b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=161a20f0c29b408f8f446d51ca5cc07b, user_id=16eb56fb49974fcb83155d1a17f810cd, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:35.296373 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8c858-a1ba-4178-8cae-53b99aafb3b2 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:35.315675 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bb34d-c2a7-495a-ab5c-011d99452f51 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:35.328582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecb74b-d8c8-4d40-b321-baffbe4f8a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:35.331331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecb74b-d8c8-4d40-b321-baffbe4f8a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:35.332159 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecb74b-d8c8-4d40-b321-baffbe4f8a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:35.332738 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecb74b-d8c8-4d40-b321-baffbe4f8a1d admin admin] PATH_INFO: `/v3/projects/80d7bbfdb8964029b8ea1fdb1de69b22/users/735d39166b6548f1b560131378bfe9ac/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:35.361014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecb74b-d8c8-4d40-b321-baffbe4f8a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=80d7bbfdb8964029b8ea1fdb1de69b22, user_id=735d39166b6548f1b560131378bfe9ac, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:35.364754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecb74b-d8c8-4d40-b321-baffbe4f8a1d admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:35.498441 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 796/1627] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:22:35 2022] PUT /identity/v3/projects/161a20f0c29b408f8f446d51ca5cc07b/users/16eb56fb49974fcb83155d1a17f810cd/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:22:35.500619 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ce886-163d-4fcb-a08d-333fb2200ff4 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:35.501068 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ce886-163d-4fcb-a08d-333fb2200ff4 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:35.501620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ce886-163d-4fcb-a08d-333fb2200ff4 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:35.515362 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 797/1628] 10.222.0.79 () {54 vars in 912 bytes} [Fri Sep 2 21:22:35 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:22:35.521175 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a6258-264e-4556-9288-3d56bf68df6d None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:35.521470 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a6258-264e-4556-9288-3d56bf68df6d None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:35.521777 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a6258-264e-4556-9288-3d56bf68df6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:35.528544 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 832/1629] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:22:35 2022] PUT /identity/v3/projects/80d7bbfdb8964029b8ea1fdb1de69b22/users/735d39166b6548f1b560131378bfe9ac/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:22:35.531261 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5b9cd-a1e7-4863-9dce-229d522d73d1 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:35.532169 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5b9cd-a1e7-4863-9dce-229d522d73d1 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:35.532312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5b9cd-a1e7-4863-9dce-229d522d73d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:35.575066 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-fa8a6258-264e-4556-9288-3d56bf68df6d None None] MFA Rules not processed for user `16eb56fb49974fcb83155d1a17f810cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:35.577521 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-fa8a6258-264e-4556-9288-3d56bf68df6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:35.581850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-f8a5b9cd-a1e7-4863-9dce-229d522d73d1 None None] MFA Rules not processed for user `632071470f7d409ab7b0129d120320c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:35.584325 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f8a5b9cd-a1e7-4863-9dce-229d522d73d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:35.754677 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 833/1630] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Sep 2 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:35.760229 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 798/1631] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:35.762018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a6258-264e-4556-9288-3d56bf68df6d None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:35.763705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5b9cd-a1e7-4863-9dce-229d522d73d1 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:35.865905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5b9cd-a1e7-4863-9dce-229d522d73d1 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:35.876013 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0c50e-11a2-4d27-a32e-ea7e20a997a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:35.877413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0c50e-11a2-4d27-a32e-ea7e20a997a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:35.877951 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0c50e-11a2-4d27-a32e-ea7e20a997a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:35.878292 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0c50e-11a2-4d27-a32e-ea7e20a997a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:35.878998 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0c50e-11a2-4d27-a32e-ea7e20a997a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:35.880736 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0c50e-11a2-4d27-a32e-ea7e20a997a7 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:35.893695 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 834/1632] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:35.894837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0c50e-11a2-4d27-a32e-ea7e20a997a7 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:35.914466 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a6258-264e-4556-9288-3d56bf68df6d None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:35.921480 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c831e9b-1dc0-4a26-955e-44b1845af822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:35.922198 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c831e9b-1dc0-4a26-955e-44b1845af822 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:35.922920 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c831e9b-1dc0-4a26-955e-44b1845af822 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:35.923214 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c831e9b-1dc0-4a26-955e-44b1845af822 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:35.923888 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c831e9b-1dc0-4a26-955e-44b1845af822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:35.925926 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c831e9b-1dc0-4a26-955e-44b1845af822 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:36.011889 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0c50e-11a2-4d27-a32e-ea7e20a997a7 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:36.019820 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b9e42-3a83-4d48-a324-47d19a23f242 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:36.020545 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b9e42-3a83-4d48-a324-47d19a23f242 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:36.021455 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b9e42-3a83-4d48-a324-47d19a23f242 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:36.023252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b9e42-3a83-4d48-a324-47d19a23f242 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:36.047288 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b9e42-3a83-4d48-a324-47d19a23f242 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:36.516043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b9e42-3a83-4d48-a324-47d19a23f242 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:36.516043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 835/1633] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:22:36.516043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b9e42-3a83-4d48-a324-47d19a23f242 service cinder] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:36.521242 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 799/1634] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:22:35 2022] POST /identity/v3/projects => generated 387 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:36.521242 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c831e9b-1dc0-4a26-955e-44b1845af822 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:36.524059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b9e42-3a83-4d48-a324-47d19a23f242 service cinder] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:36.524059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed91a9-1810-405e-bb93-b4dbbd0b0b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:36.524059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed91a9-1810-405e-bb93-b4dbbd0b0b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:36.524059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed91a9-1810-405e-bb93-b4dbbd0b0b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:36.525269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed91a9-1810-405e-bb93-b4dbbd0b0b07 admin admin] PATH_INFO: `/v3/projects/80d7bbfdb8964029b8ea1fdb1de69b22/users/735d39166b6548f1b560131378bfe9ac/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:36.525269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed91a9-1810-405e-bb93-b4dbbd0b0b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80d7bbfdb8964029b8ea1fdb1de69b22, user_id=735d39166b6548f1b560131378bfe9ac, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:36.525269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed91a9-1810-405e-bb93-b4dbbd0b0b07 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:36.525269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 836/1635] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:22:36 2022] PUT /identity/v3/projects/80d7bbfdb8964029b8ea1fdb1de69b22/users/735d39166b6548f1b560131378bfe9ac/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:22:36.525269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed157780-10f3-4613-a2a7-17db2a02c9c2 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:36.551366 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed157780-10f3-4613-a2a7-17db2a02c9c2 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:36.551366 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed157780-10f3-4613-a2a7-17db2a02c9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:36.551976 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c831e9b-1dc0-4a26-955e-44b1845af822 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:36.552145 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-ed157780-10f3-4613-a2a7-17db2a02c9c2 None None] MFA Rules not processed for user `735d39166b6548f1b560131378bfe9ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:36.552145 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ed157780-10f3-4613-a2a7-17db2a02c9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:36.552790 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d17a6-5085-4f72-998e-a0f8667bc44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:36.552790 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d17a6-5085-4f72-998e-a0f8667bc44d admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:36.552790 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d17a6-5085-4f72-998e-a0f8667bc44d admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:36.552790 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d17a6-5085-4f72-998e-a0f8667bc44d admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:36.553568 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d17a6-5085-4f72-998e-a0f8667bc44d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:36.553568 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d17a6-5085-4f72-998e-a0f8667bc44d admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:36.553929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 837/1636] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:36 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:22:36.553929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:36.553929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed157780-10f3-4613-a2a7-17db2a02c9c2 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:36.651050 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed157780-10f3-4613-a2a7-17db2a02c9c2 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:36.657926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf89f0b-e8d0-4c3d-9073-63cbc1d5f446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:36.658862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf89f0b-e8d0-4c3d-9073-63cbc1d5f446 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:36.659221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf89f0b-e8d0-4c3d-9073-63cbc1d5f446 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:36.660155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf89f0b-e8d0-4c3d-9073-63cbc1d5f446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:36.687810 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf89f0b-e8d0-4c3d-9073-63cbc1d5f446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:36.689387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf89f0b-e8d0-4c3d-9073-63cbc1d5f446 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:36.702089 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 838/1637] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:36 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:22:36.879236 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:36.986991 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 800/1638] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:22:36 2022] POST /identity/v3/users => generated 300 bytes in 893 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:36.987419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf89f0b-e8d0-4c3d-9073-63cbc1d5f446 service cinder] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:37.005007 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d17a6-5085-4f72-998e-a0f8667bc44d admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:37.006405 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf89f0b-e8d0-4c3d-9073-63cbc1d5f446 service cinder] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:37.018473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbad88d-83f6-4dd9-87bb-38e9a7231e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:37.019780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbad88d-83f6-4dd9-87bb-38e9a7231e23 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:37.020442 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbad88d-83f6-4dd9-87bb-38e9a7231e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:37.020933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbad88d-83f6-4dd9-87bb-38e9a7231e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:37.023276 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbad88d-83f6-4dd9-87bb-38e9a7231e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:37.025474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbad88d-83f6-4dd9-87bb-38e9a7231e23 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:37.028828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d17a6-5085-4f72-998e-a0f8667bc44d admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:37.040356 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 839/1639] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:22:37.046393 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbad88d-83f6-4dd9-87bb-38e9a7231e23 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:37.054204 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1c0b0-16b1-4d0d-9b14-2860e1e787f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:37.055776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1c0b0-16b1-4d0d-9b14-2860e1e787f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:37.056291 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1c0b0-16b1-4d0d-9b14-2860e1e787f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:37.056780 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1c0b0-16b1-4d0d-9b14-2860e1e787f3 admin admin] PATH_INFO: `/v3/users/93ceb9bf88924968a3355302ca66a3c0` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:37.061274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b1c0b0-16b1-4d0d-9b14-2860e1e787f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93ceb9bf88924968a3355302ca66a3c0)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:37.067312 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b1c0b0-16b1-4d0d-9b14-2860e1e787f3 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:37.069404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbad88d-83f6-4dd9-87bb-38e9a7231e23 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:37.076106 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04beed25-24ab-43c6-ab47-5c4f9ce2275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:37.076985 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04beed25-24ab-43c6-ab47-5c4f9ce2275a admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:37.077381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04beed25-24ab-43c6-ab47-5c4f9ce2275a admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:37.077762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04beed25-24ab-43c6-ab47-5c4f9ce2275a admin admin] PATH_INFO: `/v3/projects/a7ebc9eaf5de4ce78a63813312ad1229/users/2a7733db349d4d7a92cb5a8ff0602978/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:37.113629 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04beed25-24ab-43c6-ab47-5c4f9ce2275a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ebc9eaf5de4ce78a63813312ad1229, user_id=2a7733db349d4d7a92cb5a8ff0602978, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:37.117569 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04beed25-24ab-43c6-ab47-5c4f9ce2275a admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:37.260039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 840/1640] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:22:37 2022] PUT /identity/v3/projects/a7ebc9eaf5de4ce78a63813312ad1229/users/2a7733db349d4d7a92cb5a8ff0602978/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:22:37.270327 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04beed25-24ab-43c6-ab47-5c4f9ce2275a admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:37.408131 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e1b1c0b0-16b1-4d0d-9b14-2860e1e787f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93ceb9bf88924968a3355302ca66a3c0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:37.414416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e1b1c0b0-16b1-4d0d-9b14-2860e1e787f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93ceb9bf88924968a3355302ca66a3c0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:37.429136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04beed25-24ab-43c6-ab47-5c4f9ce2275a admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:37.435353 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6677d-77a8-4848-8b72-35ee6adc8d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:37.440652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6677d-77a8-4848-8b72-35ee6adc8d10 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:37.440652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6677d-77a8-4848-8b72-35ee6adc8d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:37.440652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6677d-77a8-4848-8b72-35ee6adc8d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:37.440652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6677d-77a8-4848-8b72-35ee6adc8d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:37.441010 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e1b1c0b0-16b1-4d0d-9b14-2860e1e787f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93ceb9bf88924968a3355302ca66a3c0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:37.441092 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6677d-77a8-4848-8b72-35ee6adc8d10 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:37.454684 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 841/1641] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:37.458966 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6677d-77a8-4848-8b72-35ee6adc8d10 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:37.462377 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e1b1c0b0-16b1-4d0d-9b14-2860e1e787f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93ceb9bf88924968a3355302ca66a3c0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:37.465447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e1b1c0b0-16b1-4d0d-9b14-2860e1e787f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93ceb9bf88924968a3355302ca66a3c0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:37.483574 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6677d-77a8-4848-8b72-35ee6adc8d10 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:37.489134 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfaed5-eff4-4895-b554-abb73678dd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:37.490204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfaed5-eff4-4895-b554-abb73678dd0e admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:37.490581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfaed5-eff4-4895-b554-abb73678dd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:37.490943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfaed5-eff4-4895-b554-abb73678dd0e admin admin] PATH_INFO: `/v3/projects/a7ebc9eaf5de4ce78a63813312ad1229/users/2a7733db349d4d7a92cb5a8ff0602978/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:37.496185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfaed5-eff4-4895-b554-abb73678dd0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ebc9eaf5de4ce78a63813312ad1229, user_id=2a7733db349d4d7a92cb5a8ff0602978, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:37.516374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfaed5-eff4-4895-b554-abb73678dd0e admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:37.548255 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 842/1642] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:22:37 2022] PUT /identity/v3/projects/a7ebc9eaf5de4ce78a63813312ad1229/users/2a7733db349d4d7a92cb5a8ff0602978/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:22:37.566933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af67347-4207-493d-a0f9-ea02b45be58a None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:37.567742 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af67347-4207-493d-a0f9-ea02b45be58a None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:37.574145 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af67347-4207-493d-a0f9-ea02b45be58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:37.624029 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 801/1643] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:22:37 2022] DELETE /identity/v3/users/93ceb9bf88924968a3355302ca66a3c0 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:22:37.631103 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12d06b-e8a2-4e60-8aa5-13986ead6498 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:37.633274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12d06b-e8a2-4e60-8aa5-13986ead6498 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:37.635916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12d06b-e8a2-4e60-8aa5-13986ead6498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:37.657347 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-1af67347-4207-493d-a0f9-ea02b45be58a None None] MFA Rules not processed for user `2a7733db349d4d7a92cb5a8ff0602978`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:37.659290 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-1af67347-4207-493d-a0f9-ea02b45be58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:37.698764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-ad12d06b-e8a2-4e60-8aa5-13986ead6498 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:37.707738 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ad12d06b-e8a2-4e60-8aa5-13986ead6498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:37.893440 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 843/1644] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:37.900947 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 802/1645] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:37.906742 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af67347-4207-493d-a0f9-ea02b45be58a None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:37.908836 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-1af67347-4207-493d-a0f9-ea02b45be58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:37.910675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12d06b-e8a2-4e60-8aa5-13986ead6498 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:37.915328 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ad12d06b-e8a2-4e60-8aa5-13986ead6498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:38.127546 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af67347-4207-493d-a0f9-ea02b45be58a None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:38.131772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6cd65-9a87-4d2f-bc4d-a172e75da210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:38.132436 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6cd65-9a87-4d2f-bc4d-a172e75da210 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:38.132726 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6cd65-9a87-4d2f-bc4d-a172e75da210 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:38.133009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6cd65-9a87-4d2f-bc4d-a172e75da210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:38.168127 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6cd65-9a87-4d2f-bc4d-a172e75da210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:38.169101 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6cd65-9a87-4d2f-bc4d-a172e75da210 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:38.209729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12d06b-e8a2-4e60-8aa5-13986ead6498 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:38.216520 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 844/1646] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:22:38.218838 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cc9e1-cd1d-4575-b3eb-ae26ae1570a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:38.219534 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cc9e1-cd1d-4575-b3eb-ae26ae1570a8 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:38.219854 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cc9e1-cd1d-4575-b3eb-ae26ae1570a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:38.220242 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cc9e1-cd1d-4575-b3eb-ae26ae1570a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:38.246716 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cc9e1-cd1d-4575-b3eb-ae26ae1570a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:38.248802 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cc9e1-cd1d-4575-b3eb-ae26ae1570a8 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:38.278562 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 803/1647] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:22:38.762363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023b1a3-1f4f-4e64-9f08-8906a2bd099f None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:38.763542 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023b1a3-1f4f-4e64-9f08-8906a2bd099f None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:38.764285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023b1a3-1f4f-4e64-9f08-8906a2bd099f None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:38.773898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 845/1648] 10.222.0.79 () {54 vars in 962 bytes} [Fri Sep 2 21:22:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:22:38.774160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f7bde-aba1-4bfd-81ba-88d8c57e0fb9 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:38.775222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f7bde-aba1-4bfd-81ba-88d8c57e0fb9 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:38.775847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f7bde-aba1-4bfd-81ba-88d8c57e0fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:38.804930 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:38.826558 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-bb6f7bde-aba1-4bfd-81ba-88d8c57e0fb9 None None] MFA Rules not processed for user `632071470f7d409ab7b0129d120320c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:38.826558 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-bb6f7bde-aba1-4bfd-81ba-88d8c57e0fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:38.959691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:38.962765 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 804/1649] 10.222.0.79 () {58 vars in 1059 bytes} [Fri Sep 2 21:22:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:38.963832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe05368-1c6e-48d8-b281-3cff747fe208 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:38.964123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe05368-1c6e-48d8-b281-3cff747fe208 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:38.964408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe05368-1c6e-48d8-b281-3cff747fe208 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:38.966423 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 846/1650] 10.222.0.79 () {54 vars in 912 bytes} [Fri Sep 2 21:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:22:38.972631 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f957b1-8626-4651-91aa-b635affdb49b None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:38.972925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f957b1-8626-4651-91aa-b635affdb49b None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:38.973211 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f957b1-8626-4651-91aa-b635affdb49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:39.001545 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-75f957b1-8626-4651-91aa-b635affdb49b None None] MFA Rules not processed for user `632071470f7d409ab7b0129d120320c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:39.003381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-75f957b1-8626-4651-91aa-b635affdb49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:39.029661 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 805/1651] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Sep 2 21:22:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:39.041334 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe05368-1c6e-48d8-b281-3cff747fe208 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:39.070807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe05368-1c6e-48d8-b281-3cff747fe208 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:39.079761 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c716d9-b713-411f-a2d0-c8c512a5c67a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:39.137733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c716d9-b713-411f-a2d0-c8c512a5c67a service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:39.137733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c716d9-b713-411f-a2d0-c8c512a5c67a service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:39.137733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c716d9-b713-411f-a2d0-c8c512a5c67a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:39.137733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c716d9-b713-411f-a2d0-c8c512a5c67a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:39.137733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c716d9-b713-411f-a2d0-c8c512a5c67a service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:39.146349 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b6163-28e5-46d0-b647-6d8cf56be9f2 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:39.146879 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b6163-28e5-46d0-b647-6d8cf56be9f2 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:39.147271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b6163-28e5-46d0-b647-6d8cf56be9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:39.175002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 847/1652] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:22:39.253309 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-f72b6163-28e5-46d0-b647-6d8cf56be9f2 None None] MFA Rules not processed for user `2a852dc0243d48648fb11b621537f3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:39.254715 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f72b6163-28e5-46d0-b647-6d8cf56be9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:39.456346 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 806/1653] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:39 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:39.461575 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c716d9-b713-411f-a2d0-c8c512a5c67a service cinder] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:39.463120 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-68c716d9-b713-411f-a2d0-c8c512a5c67a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:39.478154 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c716d9-b713-411f-a2d0-c8c512a5c67a service cinder] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:39.484566 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fe0bf-b856-4aed-b034-0b7a866a2853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:39.485359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fe0bf-b856-4aed-b034-0b7a866a2853 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:39.485543 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fe0bf-b856-4aed-b034-0b7a866a2853 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:39.485897 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fe0bf-b856-4aed-b034-0b7a866a2853 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:39.486595 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fe0bf-b856-4aed-b034-0b7a866a2853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:39.489535 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fe0bf-b856-4aed-b034-0b7a866a2853 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:39.913621 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 848/1654] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:22:39 2022] POST /identity/v3/projects => generated 405 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:39.916288 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b6163-28e5-46d0-b647-6d8cf56be9f2 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:39.946836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b6163-28e5-46d0-b647-6d8cf56be9f2 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:40.085945 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5169a-a61a-4c7c-9ce9-de3d4a567204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:40.087775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5169a-a61a-4c7c-9ce9-de3d4a567204 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:40.089464 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5169a-a61a-4c7c-9ce9-de3d4a567204 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:40.089935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5169a-a61a-4c7c-9ce9-de3d4a567204 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:40.091935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5169a-a61a-4c7c-9ce9-de3d4a567204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:40.094971 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5169a-a61a-4c7c-9ce9-de3d4a567204 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:40.273414 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 807/1655] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:22:39 2022] POST /identity/v3/users => generated 309 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:40.276639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fe0bf-b856-4aed-b034-0b7a866a2853 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:40.295904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fe0bf-b856-4aed-b034-0b7a866a2853 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:40.306531 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0931e59-afa0-4316-8a8e-fda4249e7797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:40.308032 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0931e59-afa0-4316-8a8e-fda4249e7797 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:40.308708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0931e59-afa0-4316-8a8e-fda4249e7797 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:40.310982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0931e59-afa0-4316-8a8e-fda4249e7797 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:40.312851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0931e59-afa0-4316-8a8e-fda4249e7797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:40.318977 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0931e59-afa0-4316-8a8e-fda4249e7797 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:40.404773 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 849/1656] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:40.410250 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5169a-a61a-4c7c-9ce9-de3d4a567204 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:40.431676 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5169a-a61a-4c7c-9ce9-de3d4a567204 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:40.473962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226642ca-8708-4c6a-9eb1-a66bab2cc404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:40.475089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226642ca-8708-4c6a-9eb1-a66bab2cc404 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:40.482520 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226642ca-8708-4c6a-9eb1-a66bab2cc404 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:40.482520 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226642ca-8708-4c6a-9eb1-a66bab2cc404 admin admin] PATH_INFO: `/v3/projects/4f9a5fbcd3f645eb8dd855cc9b16400b/users/976c9e4a03ad42d4a33d6830fe84027c/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:40.510528 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226642ca-8708-4c6a-9eb1-a66bab2cc404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f9a5fbcd3f645eb8dd855cc9b16400b, user_id=976c9e4a03ad42d4a33d6830fe84027c, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:40.523172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226642ca-8708-4c6a-9eb1-a66bab2cc404 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:40.686600 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 808/1657] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:22:40 2022] PUT /identity/v3/projects/4f9a5fbcd3f645eb8dd855cc9b16400b/users/976c9e4a03ad42d4a33d6830fe84027c/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:22:40.691231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0931e59-afa0-4316-8a8e-fda4249e7797 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:40.708140 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0931e59-afa0-4316-8a8e-fda4249e7797 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:40.874691 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70a245-336d-49ca-a4d4-dc85ad8993f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:40.875285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70a245-336d-49ca-a4d4-dc85ad8993f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:40.875667 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70a245-336d-49ca-a4d4-dc85ad8993f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:40.875995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70a245-336d-49ca-a4d4-dc85ad8993f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:40.876897 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70a245-336d-49ca-a4d4-dc85ad8993f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:40.878582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70a245-336d-49ca-a4d4-dc85ad8993f0 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:40.908581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 850/1658] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:40.915293 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226642ca-8708-4c6a-9eb1-a66bab2cc404 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:40.939065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226642ca-8708-4c6a-9eb1-a66bab2cc404 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:40.967179 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5dced-532f-41a3-a68d-3777fa7b78b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:40.967877 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5dced-532f-41a3-a68d-3777fa7b78b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:40.968158 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5dced-532f-41a3-a68d-3777fa7b78b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:40.968841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5dced-532f-41a3-a68d-3777fa7b78b0 admin admin] PATH_INFO: `/v3/projects/4f9a5fbcd3f645eb8dd855cc9b16400b/users/976c9e4a03ad42d4a33d6830fe84027c/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:40.970642 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5dced-532f-41a3-a68d-3777fa7b78b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f9a5fbcd3f645eb8dd855cc9b16400b, user_id=976c9e4a03ad42d4a33d6830fe84027c, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:40.975931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5dced-532f-41a3-a68d-3777fa7b78b0 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:41.002044 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 809/1659] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:22:40 2022] PUT /identity/v3/projects/4f9a5fbcd3f645eb8dd855cc9b16400b/users/976c9e4a03ad42d4a33d6830fe84027c/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:22:41.007937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70a245-336d-49ca-a4d4-dc85ad8993f0 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:41.015011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-5a70a245-336d-49ca-a4d4-dc85ad8993f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:41.016115 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5dced-532f-41a3-a68d-3777fa7b78b0 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:41.018648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-82d5dced-532f-41a3-a68d-3777fa7b78b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:41.189595 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70a245-336d-49ca-a4d4-dc85ad8993f0 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:41.217112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5dced-532f-41a3-a68d-3777fa7b78b0 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:41.237236 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad733d04-c961-46d4-b68e-317e4b87cfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:41.240657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad733d04-c961-46d4-b68e-317e4b87cfae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:41.247778 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad733d04-c961-46d4-b68e-317e4b87cfae admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:41.247778 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad733d04-c961-46d4-b68e-317e4b87cfae admin admin] PATH_INFO: `/v3/projects/f149d8b33b6f4dd2886c27d8c5642e31` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:41.247778 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad733d04-c961-46d4-b68e-317e4b87cfae admin admin] RBAC: Authorizing `identity:delete_project(project_id=f149d8b33b6f4dd2886c27d8c5642e31)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:41.251236 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: WARNING py.warnings [None req-ad733d04-c961-46d4-b68e-317e4b87cfae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:22:41.251236 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: warnings.warn(msg) Sep 02 21:22:41.251236 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: Sep 02 21:22:41.255445 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad733d04-c961-46d4-b68e-317e4b87cfae admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:41.305081 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dc365-e5b7-4d7e-bc16-2c9b08e60fa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:41.313420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dc365-e5b7-4d7e-bc16-2c9b08e60fa8 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:41.314088 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dc365-e5b7-4d7e-bc16-2c9b08e60fa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:41.314539 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dc365-e5b7-4d7e-bc16-2c9b08e60fa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:41.316990 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-634dc365-e5b7-4d7e-bc16-2c9b08e60fa8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:41.449543 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634dc365-e5b7-4d7e-bc16-2c9b08e60fa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:41.452768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634dc365-e5b7-4d7e-bc16-2c9b08e60fa8 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:41.485691 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 851/1660] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:22:41.518903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-ad733d04-c961-46d4-b68e-317e4b87cfae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f149d8b33b6f4dd2886c27d8c5642e31', 'request_id': 'req-ad733d04-c961-46d4-b68e-317e4b87cfae'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:41.538494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-ad733d04-c961-46d4-b68e-317e4b87cfae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f149d8b33b6f4dd2886c27d8c5642e31', 'request_id': 'req-ad733d04-c961-46d4-b68e-317e4b87cfae'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:41.551432 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-ad733d04-c961-46d4-b68e-317e4b87cfae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f149d8b33b6f4dd2886c27d8c5642e31', 'request_id': 'req-ad733d04-c961-46d4-b68e-317e4b87cfae'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:41.726426 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-ad733d04-c961-46d4-b68e-317e4b87cfae admin admin] The token cache is being invalidate because project f149d8b33b6f4dd2886c27d8c5642e31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:22:41.726426 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-ad733d04-c961-46d4-b68e-317e4b87cfae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:41.726426 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-ad733d04-c961-46d4-b68e-317e4b87cfae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:41.736570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 810/1661] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:22:41 2022] DELETE /identity/v3/projects/f149d8b33b6f4dd2886c27d8c5642e31 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:22:41.736722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dc365-e5b7-4d7e-bc16-2c9b08e60fa8 service cinder] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:41.766232 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dc365-e5b7-4d7e-bc16-2c9b08e60fa8 service cinder] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:41.952756 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59fd94-c7fb-47ed-b368-e6f4f1bf35f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:41.953782 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59fd94-c7fb-47ed-b368-e6f4f1bf35f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:41.954117 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59fd94-c7fb-47ed-b368-e6f4f1bf35f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:41.954581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59fd94-c7fb-47ed-b368-e6f4f1bf35f5 admin admin] PATH_INFO: `/v3/users/735d39166b6548f1b560131378bfe9ac` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:41.955854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e59fd94-c7fb-47ed-b368-e6f4f1bf35f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=735d39166b6548f1b560131378bfe9ac)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:41.956887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: WARNING py.warnings [None req-0e59fd94-c7fb-47ed-b368-e6f4f1bf35f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 02 21:22:41.956887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: warnings.warn(msg) Sep 02 21:22:41.956887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: Sep 02 21:22:41.958182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e59fd94-c7fb-47ed-b368-e6f4f1bf35f5 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:42.118739 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:42.288720 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0e59fd94-c7fb-47ed-b368-e6f4f1bf35f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '735d39166b6548f1b560131378bfe9ac'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:42.288720 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0e59fd94-c7fb-47ed-b368-e6f4f1bf35f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '735d39166b6548f1b560131378bfe9ac'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:42.336557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0e59fd94-c7fb-47ed-b368-e6f4f1bf35f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '735d39166b6548f1b560131378bfe9ac'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:42.363822 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0e59fd94-c7fb-47ed-b368-e6f4f1bf35f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '735d39166b6548f1b560131378bfe9ac'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:42.364833 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0e59fd94-c7fb-47ed-b368-e6f4f1bf35f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '735d39166b6548f1b560131378bfe9ac'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:42.370845 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:42.541272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 852/1662] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:22:41 2022] DELETE /identity/v3/users/735d39166b6548f1b560131378bfe9ac => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:22:44.078246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad733d04-c961-46d4-b68e-317e4b87cfae admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:44.079781 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ad733d04-c961-46d4-b68e-317e4b87cfae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:44.111626 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad733d04-c961-46d4-b68e-317e4b87cfae admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:44.290266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22512434-3821-4e5c-bfd6-d555dbada093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:44.296620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22512434-3821-4e5c-bfd6-d555dbada093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:44.298501 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22512434-3821-4e5c-bfd6-d555dbada093 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:44.299190 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22512434-3821-4e5c-bfd6-d555dbada093 admin admin] PATH_INFO: `/v3/projects/80d7bbfdb8964029b8ea1fdb1de69b22` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:44.302405 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22512434-3821-4e5c-bfd6-d555dbada093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80d7bbfdb8964029b8ea1fdb1de69b22)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:44.306983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22512434-3821-4e5c-bfd6-d555dbada093 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:44.639272 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-22512434-3821-4e5c-bfd6-d555dbada093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80d7bbfdb8964029b8ea1fdb1de69b22', 'request_id': 'req-22512434-3821-4e5c-bfd6-d555dbada093'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:44.665307 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-22512434-3821-4e5c-bfd6-d555dbada093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80d7bbfdb8964029b8ea1fdb1de69b22', 'request_id': 'req-22512434-3821-4e5c-bfd6-d555dbada093'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:44.677045 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-22512434-3821-4e5c-bfd6-d555dbada093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80d7bbfdb8964029b8ea1fdb1de69b22', 'request_id': 'req-22512434-3821-4e5c-bfd6-d555dbada093'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:44.868265 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-22512434-3821-4e5c-bfd6-d555dbada093 admin admin] The token cache is being invalidate because project 80d7bbfdb8964029b8ea1fdb1de69b22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:22:44.874611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-22512434-3821-4e5c-bfd6-d555dbada093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:44.876856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-22512434-3821-4e5c-bfd6-d555dbada093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:44.890627 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 811/1663] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:22:44 2022] DELETE /identity/v3/projects/80d7bbfdb8964029b8ea1fdb1de69b22 => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:22:44.895501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea2f62-75dc-4d40-90ca-8a4e1bc1423b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:44.896375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea2f62-75dc-4d40-90ca-8a4e1bc1423b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:44.896841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea2f62-75dc-4d40-90ca-8a4e1bc1423b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:44.938663 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-03ea2f62-75dc-4d40-90ca-8a4e1bc1423b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:44.940225 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-03ea2f62-75dc-4d40-90ca-8a4e1bc1423b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:45.039550 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:45.157866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 853/1664] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:45.172289 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb438fb3-cd03-493d-a44d-beb3aaed7bd4 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:45.173960 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb438fb3-cd03-493d-a44d-beb3aaed7bd4 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:45.174415 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb438fb3-cd03-493d-a44d-beb3aaed7bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:45.295243 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-cb438fb3-cd03-493d-a44d-beb3aaed7bd4 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:45.296769 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-cb438fb3-cd03-493d-a44d-beb3aaed7bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:45.334386 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 812/1665] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:45.340063 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea2f62-75dc-4d40-90ca-8a4e1bc1423b None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:45.388397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea2f62-75dc-4d40-90ca-8a4e1bc1423b None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:45.401401 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3b627-6add-487c-b665-6a85704e8eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:45.407955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3b627-6add-487c-b665-6a85704e8eea admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:45.413858 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3b627-6add-487c-b665-6a85704e8eea admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:45.413858 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3b627-6add-487c-b665-6a85704e8eea admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:45.413858 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3b627-6add-487c-b665-6a85704e8eea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:22:45.413858 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3b627-6add-487c-b665-6a85704e8eea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:45.420669 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3b627-6add-487c-b665-6a85704e8eea admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:45.476692 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 854/1666] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:22:45.479267 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb438fb3-cd03-493d-a44d-beb3aaed7bd4 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:45.529886 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb438fb3-cd03-493d-a44d-beb3aaed7bd4 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:45.563805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22ce62-db2d-4b90-a366-40836f0a625a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:45.565205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22ce62-db2d-4b90-a366-40836f0a625a admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:45.565908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22ce62-db2d-4b90-a366-40836f0a625a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:45.574395 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22ce62-db2d-4b90-a366-40836f0a625a admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:45.574395 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22ce62-db2d-4b90-a366-40836f0a625a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:45.574395 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22ce62-db2d-4b90-a366-40836f0a625a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:45.723718 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 813/1667] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:22:45 2022] POST /identity/v3/projects => generated 385 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:22:45.728165 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3b627-6add-487c-b665-6a85704e8eea admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:45.759747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3b627-6add-487c-b665-6a85704e8eea admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:46.003675 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6ea05-54a3-4ef6-98bc-9463144e0a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:46.005846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6ea05-54a3-4ef6-98bc-9463144e0a6c admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:46.010384 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6ea05-54a3-4ef6-98bc-9463144e0a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:46.011235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6ea05-54a3-4ef6-98bc-9463144e0a6c admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:46.014311 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6ea05-54a3-4ef6-98bc-9463144e0a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:46.027471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6ea05-54a3-4ef6-98bc-9463144e0a6c admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:46.194755 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:46.198227 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 855/1668] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:22:45 2022] POST /identity/v3/users => generated 293 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:46.202149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22ce62-db2d-4b90-a366-40836f0a625a admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:46.226143 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22ce62-db2d-4b90-a366-40836f0a625a admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:46.245390 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0666f-647f-48de-81bb-57767b94c18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:46.248173 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0666f-647f-48de-81bb-57767b94c18d admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:46.248999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0666f-647f-48de-81bb-57767b94c18d admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:46.250789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0666f-647f-48de-81bb-57767b94c18d admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:46.252279 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0666f-647f-48de-81bb-57767b94c18d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:46.254750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0666f-647f-48de-81bb-57767b94c18d admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:46.284963 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 814/1669] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:22:46.291270 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6ea05-54a3-4ef6-98bc-9463144e0a6c admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:46.312740 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6ea05-54a3-4ef6-98bc-9463144e0a6c admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:46.332556 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f1a4e-fa8e-474e-a205-9682a9448e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:46.339979 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f1a4e-fa8e-474e-a205-9682a9448e04 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:46.342146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f1a4e-fa8e-474e-a205-9682a9448e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:46.342582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f1a4e-fa8e-474e-a205-9682a9448e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:46.343452 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f1a4e-fa8e-474e-a205-9682a9448e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:46.349537 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f1a4e-fa8e-474e-a205-9682a9448e04 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:46.379625 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 856/1670] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:46.408388 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0666f-647f-48de-81bb-57767b94c18d admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:46.459894 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0666f-647f-48de-81bb-57767b94c18d admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:46.494471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1242f-982f-433e-87a3-0c8e32d70217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:46.495975 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1242f-982f-433e-87a3-0c8e32d70217 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:46.497141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1242f-982f-433e-87a3-0c8e32d70217 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:46.497770 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1242f-982f-433e-87a3-0c8e32d70217 admin admin] PATH_INFO: `/v3/projects/cd593f07101a4541b52adba5cb338597/users/433bdd53aa6144f0853e5f7a8caf50b0/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:46.580148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1242f-982f-433e-87a3-0c8e32d70217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd593f07101a4541b52adba5cb338597, user_id=433bdd53aa6144f0853e5f7a8caf50b0, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:46.587767 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1242f-982f-433e-87a3-0c8e32d70217 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:46.765419 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 815/1671] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:22:46 2022] PUT /identity/v3/projects/cd593f07101a4541b52adba5cb338597/users/433bdd53aa6144f0853e5f7a8caf50b0/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:22:46.766233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84012263-3d0e-40fc-91a4-6a7210750be6 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:46.766233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84012263-3d0e-40fc-91a4-6a7210750be6 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:46.766233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84012263-3d0e-40fc-91a4-6a7210750be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:46.874094 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-84012263-3d0e-40fc-91a4-6a7210750be6 None None] MFA Rules not processed for user `433bdd53aa6144f0853e5f7a8caf50b0`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:46.875526 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-84012263-3d0e-40fc-91a4-6a7210750be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:46.997848 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 857/1672] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:47.003866 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1242f-982f-433e-87a3-0c8e32d70217 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:47.198607 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1242f-982f-433e-87a3-0c8e32d70217 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:47.241353 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e5bf8-c2da-42ff-8e74-cb9794d88878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:47.248501 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e5bf8-c2da-42ff-8e74-cb9794d88878 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:47.248863 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e5bf8-c2da-42ff-8e74-cb9794d88878 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:47.249339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e5bf8-c2da-42ff-8e74-cb9794d88878 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:47.250865 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e5bf8-c2da-42ff-8e74-cb9794d88878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:47.255019 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e5bf8-c2da-42ff-8e74-cb9794d88878 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:47.432656 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 816/1673] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:22:47 2022] POST /identity/v3/projects => generated 383 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:47.439656 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84012263-3d0e-40fc-91a4-6a7210750be6 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:47.459502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d25eb-d1ed-435e-872d-7b26cf320699 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:47.461371 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d25eb-d1ed-435e-872d-7b26cf320699 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:47.461790 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d25eb-d1ed-435e-872d-7b26cf320699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:47.483437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84012263-3d0e-40fc-91a4-6a7210750be6 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:47.561506 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-872d25eb-d1ed-435e-872d-7b26cf320699 None None] MFA Rules not processed for user `976c9e4a03ad42d4a33d6830fe84027c`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:47.567030 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-872d25eb-d1ed-435e-872d-7b26cf320699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:47.607576 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:47.685003 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7bf85-e3be-44a4-a299-3123c1e8c02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:47.686158 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7bf85-e3be-44a4-a299-3123c1e8c02f admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:47.686719 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7bf85-e3be-44a4-a299-3123c1e8c02f admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:47.687535 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7bf85-e3be-44a4-a299-3123c1e8c02f admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:47.691457 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7bf85-e3be-44a4-a299-3123c1e8c02f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:47.736555 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7bf85-e3be-44a4-a299-3123c1e8c02f admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:47.822644 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 817/1674] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:47 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:47.940682 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d25eb-d1ed-435e-872d-7b26cf320699 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:47.958153 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 858/1675] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:22:47 2022] POST /identity/v3/users => generated 298 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:47.978791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d25eb-d1ed-435e-872d-7b26cf320699 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:47.999552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42849fb4-2752-4ebb-b2b8-8dce20163726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:47.999552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42849fb4-2752-4ebb-b2b8-8dce20163726 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:47.999552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42849fb4-2752-4ebb-b2b8-8dce20163726 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:47.999552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42849fb4-2752-4ebb-b2b8-8dce20163726 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:47.999928 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42849fb4-2752-4ebb-b2b8-8dce20163726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:48.002179 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42849fb4-2752-4ebb-b2b8-8dce20163726 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:48.039853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 818/1676] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:48.042195 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7bf85-e3be-44a4-a299-3123c1e8c02f admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:48.072011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7bf85-e3be-44a4-a299-3123c1e8c02f admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:48.091577 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fade16f-7776-4072-bad6-a1a439fc5d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:48.091577 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fade16f-7776-4072-bad6-a1a439fc5d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:48.091577 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fade16f-7776-4072-bad6-a1a439fc5d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:48.091577 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fade16f-7776-4072-bad6-a1a439fc5d6d admin admin] PATH_INFO: `/v3/projects/9fb6e63db464478388993282157765ff/users/e2d9e9c5aabb4b6699cee583804a0f0b/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:48.125949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fade16f-7776-4072-bad6-a1a439fc5d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb6e63db464478388993282157765ff, user_id=e2d9e9c5aabb4b6699cee583804a0f0b, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:48.130324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fade16f-7776-4072-bad6-a1a439fc5d6d admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:48.334133 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 859/1677] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:22:48 2022] PUT /identity/v3/projects/9fb6e63db464478388993282157765ff/users/e2d9e9c5aabb4b6699cee583804a0f0b/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:22:48.337755 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42849fb4-2752-4ebb-b2b8-8dce20163726 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:48.358980 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42849fb4-2752-4ebb-b2b8-8dce20163726 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:48.569797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a322e-1aa0-4655-bbe9-c705a073f268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:48.570457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a322e-1aa0-4655-bbe9-c705a073f268 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:48.570733 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a322e-1aa0-4655-bbe9-c705a073f268 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:48.571002 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a322e-1aa0-4655-bbe9-c705a073f268 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:48.573946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a322e-1aa0-4655-bbe9-c705a073f268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:48.576279 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a322e-1aa0-4655-bbe9-c705a073f268 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:48.606493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 819/1678] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:48.611410 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fade16f-7776-4072-bad6-a1a439fc5d6d admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:48.627552 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:48.651251 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fade16f-7776-4072-bad6-a1a439fc5d6d admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:48.678565 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd8ec6-7fe7-4b2d-8148-d56623fe5e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:48.678565 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd8ec6-7fe7-4b2d-8148-d56623fe5e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:48.678565 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd8ec6-7fe7-4b2d-8148-d56623fe5e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:48.678565 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd8ec6-7fe7-4b2d-8148-d56623fe5e52 admin admin] PATH_INFO: `/v3/projects/9fb6e63db464478388993282157765ff/users/e2d9e9c5aabb4b6699cee583804a0f0b/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:48.712357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd8ec6-7fe7-4b2d-8148-d56623fe5e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb6e63db464478388993282157765ff, user_id=e2d9e9c5aabb4b6699cee583804a0f0b, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:48.730075 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd8ec6-7fe7-4b2d-8148-d56623fe5e52 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:48.774030 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 860/1679] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:22:48 2022] PUT /identity/v3/projects/9fb6e63db464478388993282157765ff/users/e2d9e9c5aabb4b6699cee583804a0f0b/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:22:48.788383 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e67707-ce26-4816-a10b-f041142e5133 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:48.788828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e67707-ce26-4816-a10b-f041142e5133 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:48.789256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e67707-ce26-4816-a10b-f041142e5133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:48.809603 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:48.849787 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-d7e67707-ce26-4816-a10b-f041142e5133 None None] MFA Rules not processed for user `e2d9e9c5aabb4b6699cee583804a0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:48.851077 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d7e67707-ce26-4816-a10b-f041142e5133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:49.049505 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 820/1680] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:22:49.074955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd8ec6-7fe7-4b2d-8148-d56623fe5e52 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:49.080825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-18fd8ec6-7fe7-4b2d-8148-d56623fe5e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:49.116646 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b40ca-6418-4d04-9bce-1c1b975f2faf None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:49.117046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b40ca-6418-4d04-9bce-1c1b975f2faf None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:49.117227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b40ca-6418-4d04-9bce-1c1b975f2faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:49.188302 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-e36b40ca-6418-4d04-9bce-1c1b975f2faf None None] MFA Rules not processed for user `02bf6738503a44b0908ecd38116842d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:49.188302 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e36b40ca-6418-4d04-9bce-1c1b975f2faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:49.312816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd8ec6-7fe7-4b2d-8148-d56623fe5e52 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:49.325984 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5188241-b011-4b4b-9567-48cf4e272159 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:49.326954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5188241-b011-4b4b-9567-48cf4e272159 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:49.327400 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5188241-b011-4b4b-9567-48cf4e272159 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:49.327975 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5188241-b011-4b4b-9567-48cf4e272159 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:49.337788 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 821/1681] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:49.353122 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea137a16-0b11-4294-9358-560f9c4ffd49 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:49.354021 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea137a16-0b11-4294-9358-560f9c4ffd49 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:49.354021 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea137a16-0b11-4294-9358-560f9c4ffd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:49.395292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-ea137a16-0b11-4294-9358-560f9c4ffd49 None None] MFA Rules not processed for user `02bf6738503a44b0908ecd38116842d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:49.396629 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ea137a16-0b11-4294-9358-560f9c4ffd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:49.421597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 822/1682] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:22:49.431470 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea137a16-0b11-4294-9358-560f9c4ffd49 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:49.437043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ea137a16-0b11-4294-9358-560f9c4ffd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:49.516028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5188241-b011-4b4b-9567-48cf4e272159 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:49.519760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5188241-b011-4b4b-9567-48cf4e272159 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:49.573978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 861/1683] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:22:49.752780 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea137a16-0b11-4294-9358-560f9c4ffd49 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:49.776479 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53a51b-c702-4b03-aea1-445b5f15e81b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:49.777198 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53a51b-c702-4b03-aea1-445b5f15e81b service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:49.777519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53a51b-c702-4b03-aea1-445b5f15e81b service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:49.783020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53a51b-c702-4b03-aea1-445b5f15e81b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:49.817458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53a51b-c702-4b03-aea1-445b5f15e81b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:49.830586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53a51b-c702-4b03-aea1-445b5f15e81b service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:49.881995 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 823/1684] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:22:50.211849 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5188241-b011-4b4b-9567-48cf4e272159 service cinder] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:50.215310 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-e5188241-b011-4b4b-9567-48cf4e272159 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:50.324547 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5188241-b011-4b4b-9567-48cf4e272159 service cinder] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:50.333010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505efbc-5a2a-41b7-94be-8ef855027cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:50.334093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505efbc-5a2a-41b7-94be-8ef855027cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:50.340005 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505efbc-5a2a-41b7-94be-8ef855027cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:50.340328 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505efbc-5a2a-41b7-94be-8ef855027cd1 admin admin] PATH_INFO: `/v3/users/7622cffd25e740bea34fdc1c80e4560f` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:50.350206 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505efbc-5a2a-41b7-94be-8ef855027cd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7622cffd25e740bea34fdc1c80e4560f)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:50.353655 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505efbc-5a2a-41b7-94be-8ef855027cd1 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:50.843734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2505efbc-5a2a-41b7-94be-8ef855027cd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7622cffd25e740bea34fdc1c80e4560f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:50.851806 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2505efbc-5a2a-41b7-94be-8ef855027cd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7622cffd25e740bea34fdc1c80e4560f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:50.888830 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2505efbc-5a2a-41b7-94be-8ef855027cd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7622cffd25e740bea34fdc1c80e4560f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:50.912149 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2505efbc-5a2a-41b7-94be-8ef855027cd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7622cffd25e740bea34fdc1c80e4560f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:50.915066 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2505efbc-5a2a-41b7-94be-8ef855027cd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7622cffd25e740bea34fdc1c80e4560f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:51.073378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b9692-f1fc-427a-9f44-646621a73e27 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:51.074415 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b9692-f1fc-427a-9f44-646621a73e27 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:51.075013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b9692-f1fc-427a-9f44-646621a73e27 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:51.077571 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 824/1685] 10.222.0.79 () {54 vars in 912 bytes} [Fri Sep 2 21:22:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:22:51.101486 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 862/1686] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:22:50 2022] DELETE /identity/v3/users/7622cffd25e740bea34fdc1c80e4560f => generated 0 bytes in 873 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:22:51.101650 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bbc9c-51ed-4b3e-b1f8-6c5ea9a44998 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:51.101650 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bbc9c-51ed-4b3e-b1f8-6c5ea9a44998 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:51.101650 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bbc9c-51ed-4b3e-b1f8-6c5ea9a44998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:51.129220 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f4f24-a12d-4e8d-8ba0-8c25ad73c253 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:51.129220 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f4f24-a12d-4e8d-8ba0-8c25ad73c253 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:51.129220 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f4f24-a12d-4e8d-8ba0-8c25ad73c253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:51.190720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-e01bbc9c-51ed-4b3e-b1f8-6c5ea9a44998 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:51.202251 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e01bbc9c-51ed-4b3e-b1f8-6c5ea9a44998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:51.264123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-c64f4f24-a12d-4e8d-8ba0-8c25ad73c253 None None] MFA Rules not processed for user `aefaf6998acc4434aab62b9625bd25fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:51.265555 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-c64f4f24-a12d-4e8d-8ba0-8c25ad73c253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:51.429663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 825/1687] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:51.463918 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bbc9c-51ed-4b3e-b1f8-6c5ea9a44998 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:51.466576 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e01bbc9c-51ed-4b3e-b1f8-6c5ea9a44998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:51.488649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 863/1688] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Sep 2 21:22:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:51.574153 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef838f-6457-4e50-8356-809515bcc38e None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:51.575402 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef838f-6457-4e50-8356-809515bcc38e None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:51.575933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef838f-6457-4e50-8356-809515bcc38e None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:51.577654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 864/1689] 10.222.0.79 () {54 vars in 921 bytes} [Fri Sep 2 21:22:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:22:51.578766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef838f-6457-4e50-8356-809515bcc38e None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:51.582321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ecef838f-6457-4e50-8356-809515bcc38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:51.589956 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bbc9c-51ed-4b3e-b1f8-6c5ea9a44998 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:51.602047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08fe0e-be0a-48ee-a8df-b50721b6912a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:51.605365 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08fe0e-be0a-48ee-a8df-b50721b6912a service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:51.606942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08fe0e-be0a-48ee-a8df-b50721b6912a service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:51.609553 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08fe0e-be0a-48ee-a8df-b50721b6912a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:51.614194 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-5d08fe0e-be0a-48ee-a8df-b50721b6912a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:51.623465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef838f-6457-4e50-8356-809515bcc38e None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:51.635443 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83072d2d-7b50-440c-a6e2-921a2fbd606a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:51.638415 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83072d2d-7b50-440c-a6e2-921a2fbd606a service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:51.644790 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83072d2d-7b50-440c-a6e2-921a2fbd606a service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:51.644790 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83072d2d-7b50-440c-a6e2-921a2fbd606a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:51.669999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83072d2d-7b50-440c-a6e2-921a2fbd606a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:51.675586 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83072d2d-7b50-440c-a6e2-921a2fbd606a service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:51.727639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 865/1690] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:22:51.732822 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83072d2d-7b50-440c-a6e2-921a2fbd606a service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:51.753845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83072d2d-7b50-440c-a6e2-921a2fbd606a service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:51.773721 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b1cb2-b419-46a3-bc7b-f459e8c2ffd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:51.774422 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b1cb2-b419-46a3-bc7b-f459e8c2ffd9 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:51.778664 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b1cb2-b419-46a3-bc7b-f459e8c2ffd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:51.778664 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b1cb2-b419-46a3-bc7b-f459e8c2ffd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:51.808291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b1cb2-b419-46a3-bc7b-f459e8c2ffd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:51.813960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b1cb2-b419-46a3-bc7b-f459e8c2ffd9 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:51.835983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08fe0e-be0a-48ee-a8df-b50721b6912a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:51.839016 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08fe0e-be0a-48ee-a8df-b50721b6912a service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:51.855114 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 866/1691] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:22:51.864375 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 826/1692] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:22:51.983939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6c838-a843-4666-8091-aa08335dbdc7 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:51.985691 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6c838-a843-4666-8091-aa08335dbdc7 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:51.986260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6c838-a843-4666-8091-aa08335dbdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:52.061732 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-d8f6c838-a843-4666-8091-aa08335dbdc7 None None] MFA Rules not processed for user `aa0f9604ee2e43b4967cbdc779e63e71`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:52.064851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-d8f6c838-a843-4666-8091-aa08335dbdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:52.329104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:52.342098 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 867/1693] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Sep 2 21:22:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:52.363008 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08fe0e-be0a-48ee-a8df-b50721b6912a service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:52.366185 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-5d08fe0e-be0a-48ee-a8df-b50721b6912a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:52.485084 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08fe0e-be0a-48ee-a8df-b50721b6912a service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:52.536202 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:52.568437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a00408-eeda-4f27-9e5b-9740633dd0f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0f9604ee2e43b4967cbdc779e63e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:52.568437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a00408-eeda-4f27-9e5b-9740633dd0f8 service placement] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:52.568437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a00408-eeda-4f27-9e5b-9740633dd0f8 service placement] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:52.568437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a00408-eeda-4f27-9e5b-9740633dd0f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:52.623205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a00408-eeda-4f27-9e5b-9740633dd0f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:52.628366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a00408-eeda-4f27-9e5b-9740633dd0f8 service placement] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:52.748908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 827/1694] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:22:54.255870 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6c838-a843-4666-8091-aa08335dbdc7 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:54.287193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6c838-a843-4666-8091-aa08335dbdc7 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:54.309363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408df71-03c4-4c1e-80f9-5a3b75d856ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0f9604ee2e43b4967cbdc779e63e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:54.310436 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408df71-03c4-4c1e-80f9-5a3b75d856ef service placement] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:54.310933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408df71-03c4-4c1e-80f9-5a3b75d856ef service placement] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:54.311419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408df71-03c4-4c1e-80f9-5a3b75d856ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:54.323481 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-5408df71-03c4-4c1e-80f9-5a3b75d856ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:54.363721 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408df71-03c4-4c1e-80f9-5a3b75d856ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:54.371851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408df71-03c4-4c1e-80f9-5a3b75d856ef service placement] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:54.415403 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 868/1695] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:22:54.623157 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aace30-0459-485d-ad39-66415169905f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:54.624742 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aace30-0459-485d-ad39-66415169905f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:54.625604 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aace30-0459-485d-ad39-66415169905f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:54.781723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-33aace30-0459-485d-ad39-66415169905f None None] MFA Rules not processed for user `c81bafbe3e444e84a7da18ac9d782479`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:54.784271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-33aace30-0459-485d-ad39-66415169905f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:55.100787 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:55.123078 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ae072-4db6-4470-8687-ecd0d690487e None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:55.123722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ae072-4db6-4470-8687-ecd0d690487e None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:55.124167 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ae072-4db6-4470-8687-ecd0d690487e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:55.134426 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 828/1696] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 508 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:55.172708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-728ae072-4db6-4470-8687-ecd0d690487e None None] MFA Rules not processed for user `c81bafbe3e444e84a7da18ac9d782479`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:55.175525 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-728ae072-4db6-4470-8687-ecd0d690487e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:55.194374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 869/1697] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:55.202295 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aace30-0459-485d-ad39-66415169905f None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:55.204915 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-33aace30-0459-485d-ad39-66415169905f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:55.347875 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ae072-4db6-4470-8687-ecd0d690487e None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:55.349944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-728ae072-4db6-4470-8687-ecd0d690487e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:55.453956 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ae072-4db6-4470-8687-ecd0d690487e None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:55.484700 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e7b65-fd89-436a-a1e1-00875b8fa735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:55.485480 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e7b65-fd89-436a-a1e1-00875b8fa735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:55.485757 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e7b65-fd89-436a-a1e1-00875b8fa735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:55.486252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e7b65-fd89-436a-a1e1-00875b8fa735 admin admin] PATH_INFO: `/v3/projects/ca6e4f9f3af64916a1aae6ccb1b492a2` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:55.488378 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e7b65-fd89-436a-a1e1-00875b8fa735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca6e4f9f3af64916a1aae6ccb1b492a2)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:55.499990 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e7b65-fd89-436a-a1e1-00875b8fa735 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:55.710174 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aace30-0459-485d-ad39-66415169905f None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:55.742876 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c0b12-fdda-4624-9b61-3e26d47d2e10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:55.743994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c0b12-fdda-4624-9b61-3e26d47d2e10 service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:55.744451 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c0b12-fdda-4624-9b61-3e26d47d2e10 service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:55.744722 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c0b12-fdda-4624-9b61-3e26d47d2e10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:55.764855 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c0b12-fdda-4624-9b61-3e26d47d2e10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:55.767445 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c0b12-fdda-4624-9b61-3e26d47d2e10 service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:55.841848 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 829/1698] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:55 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:22:55.934803 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-535e7b65-fd89-436a-a1e1-00875b8fa735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca6e4f9f3af64916a1aae6ccb1b492a2', 'request_id': 'req-535e7b65-fd89-436a-a1e1-00875b8fa735'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:55.983474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-535e7b65-fd89-436a-a1e1-00875b8fa735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca6e4f9f3af64916a1aae6ccb1b492a2', 'request_id': 'req-535e7b65-fd89-436a-a1e1-00875b8fa735'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:56.038799 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-535e7b65-fd89-436a-a1e1-00875b8fa735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca6e4f9f3af64916a1aae6ccb1b492a2', 'request_id': 'req-535e7b65-fd89-436a-a1e1-00875b8fa735'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:56.287870 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-535e7b65-fd89-436a-a1e1-00875b8fa735 admin admin] The token cache is being invalidate because project ca6e4f9f3af64916a1aae6ccb1b492a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:22:56.295656 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-535e7b65-fd89-436a-a1e1-00875b8fa735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:56.295656 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-535e7b65-fd89-436a-a1e1-00875b8fa735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:22:56.311995 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31ca8b-4c37-4f60-b942-916ba7a2591f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:56.312998 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31ca8b-4c37-4f60-b942-916ba7a2591f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:56.313798 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31ca8b-4c37-4f60-b942-916ba7a2591f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:56.335745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 870/1699] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:22:55 2022] DELETE /identity/v3/projects/ca6e4f9f3af64916a1aae6ccb1b492a2 => generated 0 bytes in 955 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:22:56.409490 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-cd31ca8b-4c37-4f60-b942-916ba7a2591f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:56.412102 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-cd31ca8b-4c37-4f60-b942-916ba7a2591f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:56.766183 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 830/1700] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:22:56.778336 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15851e5-0d54-44d6-a715-b27c65cb1080 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:56.779754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15851e5-0d54-44d6-a715-b27c65cb1080 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:56.780720 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15851e5-0d54-44d6-a715-b27c65cb1080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:56.834024 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-b15851e5-0d54-44d6-a715-b27c65cb1080 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:56.837121 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b15851e5-0d54-44d6-a715-b27c65cb1080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:56.856438 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 871/1701] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:56.863517 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31ca8b-4c37-4f60-b942-916ba7a2591f None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:56.906862 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31ca8b-4c37-4f60-b942-916ba7a2591f None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:56.930249 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae976ce6-42a5-490e-acc3-5504b11e4c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:56.941883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae976ce6-42a5-490e-acc3-5504b11e4c52 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:56.942364 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae976ce6-42a5-490e-acc3-5504b11e4c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:56.942848 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae976ce6-42a5-490e-acc3-5504b11e4c52 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:56.944023 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae976ce6-42a5-490e-acc3-5504b11e4c52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:22:56.944571 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae976ce6-42a5-490e-acc3-5504b11e4c52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:56.948992 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae976ce6-42a5-490e-acc3-5504b11e4c52 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:56.992851 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 831/1702] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:22:57.001529 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15851e5-0d54-44d6-a715-b27c65cb1080 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:57.025763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15851e5-0d54-44d6-a715-b27c65cb1080 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:57.051705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78329c-2636-4f2d-a733-ca1864cdf5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:57.052983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78329c-2636-4f2d-a733-ca1864cdf5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:57.053565 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78329c-2636-4f2d-a733-ca1864cdf5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:57.054711 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78329c-2636-4f2d-a733-ca1864cdf5c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:57.056072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78329c-2636-4f2d-a733-ca1864cdf5c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:57.066174 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78329c-2636-4f2d-a733-ca1864cdf5c0 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:57.125857 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:57.399699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 872/1703] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:22:56 2022] POST /identity/v3/projects => generated 367 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:57.401339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae976ce6-42a5-490e-acc3-5504b11e4c52 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:57.448710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae976ce6-42a5-490e-acc3-5504b11e4c52 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:57.740282 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c50f31-5689-4f6f-84fc-3707cc587cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:57.744755 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c50f31-5689-4f6f-84fc-3707cc587cbf admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:57.745863 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c50f31-5689-4f6f-84fc-3707cc587cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:57.746721 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c50f31-5689-4f6f-84fc-3707cc587cbf admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:57.748227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c50f31-5689-4f6f-84fc-3707cc587cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:57.752982 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c50f31-5689-4f6f-84fc-3707cc587cbf admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:58.015806 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 832/1704] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:22:57 2022] POST /identity/v3/users => generated 284 bytes in 596 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:22:58.016714 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78329c-2636-4f2d-a733-ca1864cdf5c0 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:58.044793 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78329c-2636-4f2d-a733-ca1864cdf5c0 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:58.077238 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6c59f-611d-47ba-8782-22220cb9fdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:58.078576 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6c59f-611d-47ba-8782-22220cb9fdb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:58.079476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6c59f-611d-47ba-8782-22220cb9fdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:58.080346 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6c59f-611d-47ba-8782-22220cb9fdb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:58.081338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6c59f-611d-47ba-8782-22220cb9fdb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:58.084173 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6c59f-611d-47ba-8782-22220cb9fdb2 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:58.132357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 873/1705] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:58.139308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c50f31-5689-4f6f-84fc-3707cc587cbf admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:58.172800 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c50f31-5689-4f6f-84fc-3707cc587cbf admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:58.196048 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e876e-3c1a-418f-b282-ffdc0cd40d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:58.197418 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e876e-3c1a-418f-b282-ffdc0cd40d9a admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:58.198330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e876e-3c1a-418f-b282-ffdc0cd40d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:58.199619 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e876e-3c1a-418f-b282-ffdc0cd40d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:58.201027 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e876e-3c1a-418f-b282-ffdc0cd40d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:58.231659 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e876e-3c1a-418f-b282-ffdc0cd40d9a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:58.273560 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 833/1706] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:22:58.274943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6c59f-611d-47ba-8782-22220cb9fdb2 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:58.295162 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6c59f-611d-47ba-8782-22220cb9fdb2 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:58.313414 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35cc12-a851-41c7-a397-9e14e6233fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:58.315493 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35cc12-a851-41c7-a397-9e14e6233fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:58.316355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35cc12-a851-41c7-a397-9e14e6233fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:58.317069 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35cc12-a851-41c7-a397-9e14e6233fe7 admin admin] PATH_INFO: `/v3/projects/58f941afef264b53a9f0ff9c68788da2/users/fd4ca60d02ce48f783fe71a578b69031/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:58.364229 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35cc12-a851-41c7-a397-9e14e6233fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f941afef264b53a9f0ff9c68788da2, user_id=fd4ca60d02ce48f783fe71a578b69031, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:58.385387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35cc12-a851-41c7-a397-9e14e6233fe7 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:58.434728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:58.506835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 874/1707] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:22:58 2022] PUT /identity/v3/projects/58f941afef264b53a9f0ff9c68788da2/users/fd4ca60d02ce48f783fe71a578b69031/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:22:58.522384 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f44a3-70fa-4486-9e2a-3a05f56908f4 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:58.522689 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f44a3-70fa-4486-9e2a-3a05f56908f4 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:58.523087 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f44a3-70fa-4486-9e2a-3a05f56908f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:58.623961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-fb6f44a3-70fa-4486-9e2a-3a05f56908f4 None None] MFA Rules not processed for user `fd4ca60d02ce48f783fe71a578b69031`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:58.628970 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-fb6f44a3-70fa-4486-9e2a-3a05f56908f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:58.789063 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f21f88-68e7-41ec-a5e8-d5ee04df7d23 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:58.789063 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f21f88-68e7-41ec-a5e8-d5ee04df7d23 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:58.789063 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f21f88-68e7-41ec-a5e8-d5ee04df7d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:58.834090 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 834/1708] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:58.859795 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f44a3-70fa-4486-9e2a-3a05f56908f4 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:58.870304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:58.874117 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-fb6f44a3-70fa-4486-9e2a-3a05f56908f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:58.888409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-65f21f88-68e7-41ec-a5e8-d5ee04df7d23 None None] MFA Rules not processed for user `aa84378418324708b40f0791e2217ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:58.889674 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-65f21f88-68e7-41ec-a5e8-d5ee04df7d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:59.066128 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f44a3-70fa-4486-9e2a-3a05f56908f4 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:59.073009 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b691b-a2d1-4427-9174-6430635e3fcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:59.073691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b691b-a2d1-4427-9174-6430635e3fcc service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:59.074792 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b691b-a2d1-4427-9174-6430635e3fcc service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:59.075075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b691b-a2d1-4427-9174-6430635e3fcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:59.105274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b691b-a2d1-4427-9174-6430635e3fcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:59.109500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b691b-a2d1-4427-9174-6430635e3fcc service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:59.118735 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 875/1709] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:22:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:22:59.122348 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba68b62-0397-4fde-9075-3d59b0d2516a None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:59.122647 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba68b62-0397-4fde-9075-3d59b0d2516a None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:59.123002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba68b62-0397-4fde-9075-3d59b0d2516a None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:59.131709 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 876/1710] 10.222.0.79 () {54 vars in 921 bytes} [Fri Sep 2 21:22:59 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:22:59.164910 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71840a16-1a91-4a69-97cf-7e418feefd6a None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:59.165206 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71840a16-1a91-4a69-97cf-7e418feefd6a None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:59.165495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71840a16-1a91-4a69-97cf-7e418feefd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:59.196078 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 835/1711] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:22:59.230639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-71840a16-1a91-4a69-97cf-7e418feefd6a None None] MFA Rules not processed for user `aa0f9604ee2e43b4967cbdc779e63e71`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:22:59.233486 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-71840a16-1a91-4a69-97cf-7e418feefd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:59.447157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 877/1712] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Sep 2 21:22:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:22:59.501258 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b691b-a2d1-4427-9174-6430635e3fcc service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:59.502972 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-be5b691b-a2d1-4427-9174-6430635e3fcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:59.554916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b691b-a2d1-4427-9174-6430635e3fcc service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:22:59.578642 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04116ec-6846-45ad-9e09-090fed869457 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0f9604ee2e43b4967cbdc779e63e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:22:59.587065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04116ec-6846-45ad-9e09-090fed869457 service placement] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:22:59.587065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04116ec-6846-45ad-9e09-090fed869457 service placement] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:22:59.587065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04116ec-6846-45ad-9e09-090fed869457 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:22:59.632609 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71840a16-1a91-4a69-97cf-7e418feefd6a None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:59.638429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04116ec-6846-45ad-9e09-090fed869457 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:22:59.638835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-71840a16-1a91-4a69-97cf-7e418feefd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:59.639790 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04116ec-6846-45ad-9e09-090fed869457 service placement] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:22:59.653745 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 836/1713] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:22:59.749698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04116ec-6846-45ad-9e09-090fed869457 service placement] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:22:59.752238 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e04116ec-6846-45ad-9e09-090fed869457 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:22:59.992908 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71840a16-1a91-4a69-97cf-7e418feefd6a None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:00.018342 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300411a-e8af-41c8-aedf-e8e0b07dbae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:00.020197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300411a-e8af-41c8-aedf-e8e0b07dbae5 service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:00.021387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300411a-e8af-41c8-aedf-e8e0b07dbae5 service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:00.021797 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300411a-e8af-41c8-aedf-e8e0b07dbae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:00.081688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300411a-e8af-41c8-aedf-e8e0b07dbae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:00.086216 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300411a-e8af-41c8-aedf-e8e0b07dbae5 service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:00.092974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04116ec-6846-45ad-9e09-090fed869457 service placement] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:00.117450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5d1cd-8301-4fab-8fa4-ed1b97bd54a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:00.121284 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5d1cd-8301-4fab-8fa4-ed1b97bd54a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:00.124114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5d1cd-8301-4fab-8fa4-ed1b97bd54a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:00.126059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5d1cd-8301-4fab-8fa4-ed1b97bd54a2 admin admin] PATH_INFO: `/v3/users/2a852dc0243d48648fb11b621537f3d6` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:00.132887 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5d1cd-8301-4fab-8fa4-ed1b97bd54a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a852dc0243d48648fb11b621537f3d6)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:00.134718 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 878/1714] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:22:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:00.136339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5d1cd-8301-4fab-8fa4-ed1b97bd54a2 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:00.240233 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:00.510504 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a8a5d1cd-8301-4fab-8fa4-ed1b97bd54a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a852dc0243d48648fb11b621537f3d6'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:00.515642 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a8a5d1cd-8301-4fab-8fa4-ed1b97bd54a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a852dc0243d48648fb11b621537f3d6'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:00.569608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a8a5d1cd-8301-4fab-8fa4-ed1b97bd54a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a852dc0243d48648fb11b621537f3d6'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:00.685867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c624862-a6e6-45e5-8d60-db26a2f04210 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:00.686187 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c624862-a6e6-45e5-8d60-db26a2f04210 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:00.686468 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c624862-a6e6-45e5-8d60-db26a2f04210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:00.719216 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a8a5d1cd-8301-4fab-8fa4-ed1b97bd54a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a852dc0243d48648fb11b621537f3d6'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:00.723362 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a8a5d1cd-8301-4fab-8fa4-ed1b97bd54a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a852dc0243d48648fb11b621537f3d6'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:00.845326 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-3c624862-a6e6-45e5-8d60-db26a2f04210 None None] MFA Rules not processed for user `cceaf0c4877a4316af9d15c642c9dfc4`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:00.848801 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-3c624862-a6e6-45e5-8d60-db26a2f04210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:00.949401 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 837/1715] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:22:59 2022] DELETE /identity/v3/users/2a852dc0243d48648fb11b621537f3d6 => generated 0 bytes in 1196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:23:00.951332 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420efd7-7d20-430a-87ad-f10621946b21 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:00.953714 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420efd7-7d20-430a-87ad-f10621946b21 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:00.954140 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420efd7-7d20-430a-87ad-f10621946b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:01.041475 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-f420efd7-7d20-430a-87ad-f10621946b21 None None] MFA Rules not processed for user `c81bafbe3e444e84a7da18ac9d782479`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:01.054187 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f420efd7-7d20-430a-87ad-f10621946b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:01.148420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 879/1716] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:23:01.150444 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c624862-a6e6-45e5-8d60-db26a2f04210 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:01.155274 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-3c624862-a6e6-45e5-8d60-db26a2f04210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:01.233118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c624862-a6e6-45e5-8d60-db26a2f04210 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:01.344635 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 838/1717] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:01.348729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420efd7-7d20-430a-87ad-f10621946b21 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:01.367094 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f420efd7-7d20-430a-87ad-f10621946b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:01.507897 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d3120-ed85-4a35-aa0a-e9d4f194aaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:01.514051 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d3120-ed85-4a35-aa0a-e9d4f194aaae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:01.514755 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d3120-ed85-4a35-aa0a-e9d4f194aaae admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:01.515252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d3120-ed85-4a35-aa0a-e9d4f194aaae admin admin] PATH_INFO: `/v3/users/66d4ab66a7ea49358832911cf6beb240` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:01.518440 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d3120-ed85-4a35-aa0a-e9d4f194aaae admin admin] RBAC: Authorizing `identity:delete_user(user_id=66d4ab66a7ea49358832911cf6beb240)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:01.525322 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d3120-ed85-4a35-aa0a-e9d4f194aaae admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:01.655938 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420efd7-7d20-430a-87ad-f10621946b21 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:01.675093 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fa1a1-4a59-488e-be18-2ac2ea95b7a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:01.686021 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fa1a1-4a59-488e-be18-2ac2ea95b7a7 service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:01.686993 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fa1a1-4a59-488e-be18-2ac2ea95b7a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:01.688027 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fa1a1-4a59-488e-be18-2ac2ea95b7a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:01.700773 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-635fa1a1-4a59-488e-be18-2ac2ea95b7a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:01.807523 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:01.853474 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fa1a1-4a59-488e-be18-2ac2ea95b7a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:01.855455 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fa1a1-4a59-488e-be18-2ac2ea95b7a7 service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:01.874818 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 839/1718] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:01.875940 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fa1a1-4a59-488e-be18-2ac2ea95b7a7 service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:01.877595 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-635fa1a1-4a59-488e-be18-2ac2ea95b7a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:02.020547 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-d58d3120-ed85-4a35-aa0a-e9d4f194aaae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66d4ab66a7ea49358832911cf6beb240'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:02.029799 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-d58d3120-ed85-4a35-aa0a-e9d4f194aaae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66d4ab66a7ea49358832911cf6beb240'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:02.081898 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fa1a1-4a59-488e-be18-2ac2ea95b7a7 service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:02.113985 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-d58d3120-ed85-4a35-aa0a-e9d4f194aaae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66d4ab66a7ea49358832911cf6beb240'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:02.121836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b7bad-b2ff-4a76-9d1a-fb93adcea59f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:02.122598 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b7bad-b2ff-4a76-9d1a-fb93adcea59f service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:02.124021 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b7bad-b2ff-4a76-9d1a-fb93adcea59f service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:02.124573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b7bad-b2ff-4a76-9d1a-fb93adcea59f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:02.152989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-d58d3120-ed85-4a35-aa0a-e9d4f194aaae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66d4ab66a7ea49358832911cf6beb240'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:02.163762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-d58d3120-ed85-4a35-aa0a-e9d4f194aaae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66d4ab66a7ea49358832911cf6beb240'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:02.272024 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 880/1719] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:01 2022] DELETE /identity/v3/users/66d4ab66a7ea49358832911cf6beb240 => generated 0 bytes in 1123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:02.273852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf2c7e-3ddf-49db-9eb7-c158b86eebae None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:02.277066 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf2c7e-3ddf-49db-9eb7-c158b86eebae None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:02.278020 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf2c7e-3ddf-49db-9eb7-c158b86eebae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:02.294488 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b7bad-b2ff-4a76-9d1a-fb93adcea59f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:02.296458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b7bad-b2ff-4a76-9d1a-fb93adcea59f service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:02.308561 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 840/1720] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:02.310320 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db441fc-923c-411b-82b5-aba65cadd86d None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:02.310766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db441fc-923c-411b-82b5-aba65cadd86d None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:02.311293 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db441fc-923c-411b-82b5-aba65cadd86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:02.358258 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-8db441fc-923c-411b-82b5-aba65cadd86d None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:02.360469 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8db441fc-923c-411b-82b5-aba65cadd86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:02.443931 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-cddf2c7e-3ddf-49db-9eb7-c158b86eebae None None] MFA Rules not processed for user `f45f65dd3a844cb583e42d837d2a58d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:02.445332 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-cddf2c7e-3ddf-49db-9eb7-c158b86eebae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:02.528021 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 841/1721] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:02.565013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db441fc-923c-411b-82b5-aba65cadd86d None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:02.568981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8db441fc-923c-411b-82b5-aba65cadd86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:02.734156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 881/1722] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Sep 2 21:23:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:02.745129 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf2c7e-3ddf-49db-9eb7-c158b86eebae None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:02.753132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-cddf2c7e-3ddf-49db-9eb7-c158b86eebae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:02.801144 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db441fc-923c-411b-82b5-aba65cadd86d None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:02.821637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:02.829489 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435d557-35d6-4017-bd08-c25a0a7b69f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:02.830408 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435d557-35d6-4017-bd08-c25a0a7b69f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:02.830926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf2c7e-3ddf-49db-9eb7-c158b86eebae None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:02.831474 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435d557-35d6-4017-bd08-c25a0a7b69f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:02.834086 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435d557-35d6-4017-bd08-c25a0a7b69f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:02.860694 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435d557-35d6-4017-bd08-c25a0a7b69f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:02.860694 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435d557-35d6-4017-bd08-c25a0a7b69f8 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:02.882350 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598e59b-c666-4724-8aed-a93ed9029cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:02.883457 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598e59b-c666-4724-8aed-a93ed9029cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:02.888472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598e59b-c666-4724-8aed-a93ed9029cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:02.889039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598e59b-c666-4724-8aed-a93ed9029cb8 admin admin] PATH_INFO: `/v3/projects/8647a378fc0e46eb9a96d8ff503c6ef4` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:02.895089 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598e59b-c666-4724-8aed-a93ed9029cb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8647a378fc0e46eb9a96d8ff503c6ef4)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:02.899546 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 842/1723] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:23:02.900904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771cce7-4cc5-4169-91f5-7ed162ac979f None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:02.901212 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771cce7-4cc5-4169-91f5-7ed162ac979f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:02.901484 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771cce7-4cc5-4169-91f5-7ed162ac979f None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:02.910409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598e59b-c666-4724-8aed-a93ed9029cb8 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:02.913715 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 843/1724] 10.222.0.79 () {54 vars in 912 bytes} [Fri Sep 2 21:23:02 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:23:02.921178 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e58255-df53-475a-a186-617e5391fd62 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:02.923165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e58255-df53-475a-a186-617e5391fd62 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:02.923165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e58255-df53-475a-a186-617e5391fd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:02.957722 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-15e58255-df53-475a-a186-617e5391fd62 None None] MFA Rules not processed for user `aefaf6998acc4434aab62b9625bd25fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:02.959750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-15e58255-df53-475a-a186-617e5391fd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:02.982104 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 844/1725] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Sep 2 21:23:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:23:03.001741 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e58255-df53-475a-a186-617e5391fd62 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:03.003395 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-15e58255-df53-475a-a186-617e5391fd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:03.021070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e58255-df53-475a-a186-617e5391fd62 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:03.036783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d84fe0-30a2-4105-9d8c-07172f78df8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:03.036783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d84fe0-30a2-4105-9d8c-07172f78df8c service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:03.036783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d84fe0-30a2-4105-9d8c-07172f78df8c service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:03.036783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d84fe0-30a2-4105-9d8c-07172f78df8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:03.054716 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d84fe0-30a2-4105-9d8c-07172f78df8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:03.056286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d84fe0-30a2-4105-9d8c-07172f78df8c service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:03.118503 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 845/1726] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:03.274028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c598e59b-c666-4724-8aed-a93ed9029cb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8647a378fc0e46eb9a96d8ff503c6ef4', 'request_id': 'req-c598e59b-c666-4724-8aed-a93ed9029cb8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:03.312646 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c598e59b-c666-4724-8aed-a93ed9029cb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8647a378fc0e46eb9a96d8ff503c6ef4', 'request_id': 'req-c598e59b-c666-4724-8aed-a93ed9029cb8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:03.350548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c598e59b-c666-4724-8aed-a93ed9029cb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8647a378fc0e46eb9a96d8ff503c6ef4', 'request_id': 'req-c598e59b-c666-4724-8aed-a93ed9029cb8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:03.573183 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c598e59b-c666-4724-8aed-a93ed9029cb8 admin admin] The token cache is being invalidate because project 8647a378fc0e46eb9a96d8ff503c6ef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:03.573183 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c598e59b-c666-4724-8aed-a93ed9029cb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:03.577175 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d84fe0-30a2-4105-9d8c-07172f78df8c service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:03.578295 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c598e59b-c666-4724-8aed-a93ed9029cb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:03.580045 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-38d84fe0-30a2-4105-9d8c-07172f78df8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:03.583392 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 882/1727] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:02 2022] DELETE /identity/v3/projects/8647a378fc0e46eb9a96d8ff503c6ef4 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:03.589952 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598e59b-c666-4724-8aed-a93ed9029cb8 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:03.611309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-c598e59b-c666-4724-8aed-a93ed9029cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:03.926897 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598e59b-c666-4724-8aed-a93ed9029cb8 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:03.952398 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3de2e-234d-4150-83b2-b8aad8fde7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:03.953366 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3de2e-234d-4150-83b2-b8aad8fde7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:03.953850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3de2e-234d-4150-83b2-b8aad8fde7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:03.954330 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3de2e-234d-4150-83b2-b8aad8fde7e2 admin admin] PATH_INFO: `/v3/users/976c9e4a03ad42d4a33d6830fe84027c` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:03.970090 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3de2e-234d-4150-83b2-b8aad8fde7e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=976c9e4a03ad42d4a33d6830fe84027c)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:03.974822 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3de2e-234d-4150-83b2-b8aad8fde7e2 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:04.039716 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d84fe0-30a2-4105-9d8c-07172f78df8c service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:04.318183 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1aba3-f7cf-442a-90e1-266717bbad5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da2b1dc9dae413a8ee63ad67e840f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:04.326925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1aba3-f7cf-442a-90e1-266717bbad5c service swift] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:04.327348 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1aba3-f7cf-442a-90e1-266717bbad5c service swift] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:04.327841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1aba3-f7cf-442a-90e1-266717bbad5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:04.331425 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d3e1aba3-f7cf-442a-90e1-266717bbad5c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:04.424133 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b8a3de2e-234d-4150-83b2-b8aad8fde7e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '976c9e4a03ad42d4a33d6830fe84027c'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:04.425526 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b8a3de2e-234d-4150-83b2-b8aad8fde7e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '976c9e4a03ad42d4a33d6830fe84027c'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:04.489988 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b8a3de2e-234d-4150-83b2-b8aad8fde7e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '976c9e4a03ad42d4a33d6830fe84027c'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:04.569658 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b8a3de2e-234d-4150-83b2-b8aad8fde7e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '976c9e4a03ad42d4a33d6830fe84027c'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:04.578155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b8a3de2e-234d-4150-83b2-b8aad8fde7e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '976c9e4a03ad42d4a33d6830fe84027c'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:04.642620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1aba3-f7cf-442a-90e1-266717bbad5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:04.645149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1aba3-f7cf-442a-90e1-266717bbad5c service swift] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:04.658297 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 846/1728] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Sep 2 21:23:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1082 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 02 21:23:04.931457 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 883/1729] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:03 2022] DELETE /identity/v3/users/976c9e4a03ad42d4a33d6830fe84027c => generated 0 bytes in 1342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:05.204928 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:06.117905 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1aba3-f7cf-442a-90e1-266717bbad5c service swift] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:06.192764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1aba3-f7cf-442a-90e1-266717bbad5c service swift] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:06.554785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67baf724-526b-4710-9a99-65d1bb97d648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:06.555746 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67baf724-526b-4710-9a99-65d1bb97d648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:06.555746 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67baf724-526b-4710-9a99-65d1bb97d648 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:06.556011 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67baf724-526b-4710-9a99-65d1bb97d648 admin admin] PATH_INFO: `/v3/projects/4f9a5fbcd3f645eb8dd855cc9b16400b` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:06.567318 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67baf724-526b-4710-9a99-65d1bb97d648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f9a5fbcd3f645eb8dd855cc9b16400b)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:06.581314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67baf724-526b-4710-9a99-65d1bb97d648 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:06.942596 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-67baf724-526b-4710-9a99-65d1bb97d648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f9a5fbcd3f645eb8dd855cc9b16400b', 'request_id': 'req-67baf724-526b-4710-9a99-65d1bb97d648'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:06.974267 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-67baf724-526b-4710-9a99-65d1bb97d648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f9a5fbcd3f645eb8dd855cc9b16400b', 'request_id': 'req-67baf724-526b-4710-9a99-65d1bb97d648'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:06.982326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-67baf724-526b-4710-9a99-65d1bb97d648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f9a5fbcd3f645eb8dd855cc9b16400b', 'request_id': 'req-67baf724-526b-4710-9a99-65d1bb97d648'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:07.000237 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3de2e-234d-4150-83b2-b8aad8fde7e2 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:07.002951 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b8a3de2e-234d-4150-83b2-b8aad8fde7e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:07.068873 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3de2e-234d-4150-83b2-b8aad8fde7e2 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:07.243935 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb9bab-0f56-4848-b953-1440034c412d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:07.244606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb9bab-0f56-4848-b953-1440034c412d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:07.244927 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb9bab-0f56-4848-b953-1440034c412d admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:07.245497 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb9bab-0f56-4848-b953-1440034c412d admin admin] PATH_INFO: `/v3/projects/38f7612716054ce88a6791878374e3ef` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:07.247632 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb9bab-0f56-4848-b953-1440034c412d admin admin] RBAC: Authorizing `identity:delete_project(project_id=38f7612716054ce88a6791878374e3ef)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:07.260668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-67baf724-526b-4710-9a99-65d1bb97d648 admin admin] The token cache is being invalidate because project 4f9a5fbcd3f645eb8dd855cc9b16400b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:07.261520 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-67baf724-526b-4710-9a99-65d1bb97d648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:07.263036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-67baf724-526b-4710-9a99-65d1bb97d648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:07.274097 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 847/1730] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:06 2022] DELETE /identity/v3/projects/4f9a5fbcd3f645eb8dd855cc9b16400b => generated 0 bytes in 1157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:07.276713 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb9bab-0f56-4848-b953-1440034c412d admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:07.284821 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60038f-d807-45d1-a960-6d0e4881ad31 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:07.291870 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60038f-d807-45d1-a960-6d0e4881ad31 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:07.295626 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60038f-d807-45d1-a960-6d0e4881ad31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:07.385786 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-ce60038f-d807-45d1-a960-6d0e4881ad31 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:07.412777 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ce60038f-d807-45d1-a960-6d0e4881ad31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:07.440018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 848/1731] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:07.456252 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97be10-e6ec-4920-809e-ec9d2f2ecebc None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:07.456600 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97be10-e6ec-4920-809e-ec9d2f2ecebc None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:07.456877 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97be10-e6ec-4920-809e-ec9d2f2ecebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:07.536206 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:07.579092 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-3a97be10-e6ec-4920-809e-ec9d2f2ecebc None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:07.581373 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-3a97be10-e6ec-4920-809e-ec9d2f2ecebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:07.596789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-64bb9bab-0f56-4848-b953-1440034c412d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38f7612716054ce88a6791878374e3ef', 'request_id': 'req-64bb9bab-0f56-4848-b953-1440034c412d'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:07.623043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-64bb9bab-0f56-4848-b953-1440034c412d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38f7612716054ce88a6791878374e3ef', 'request_id': 'req-64bb9bab-0f56-4848-b953-1440034c412d'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:07.645314 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-64bb9bab-0f56-4848-b953-1440034c412d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38f7612716054ce88a6791878374e3ef', 'request_id': 'req-64bb9bab-0f56-4848-b953-1440034c412d'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:07.770758 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-64bb9bab-0f56-4848-b953-1440034c412d admin admin] The token cache is being invalidate because project 38f7612716054ce88a6791878374e3ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:07.771061 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-64bb9bab-0f56-4848-b953-1440034c412d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:07.773316 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-64bb9bab-0f56-4848-b953-1440034c412d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:07.781475 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 884/1732] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:06 2022] DELETE /identity/v3/projects/38f7612716054ce88a6791878374e3ef => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:07.784698 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb9bab-0f56-4848-b953-1440034c412d admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:07.798486 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-64bb9bab-0f56-4848-b953-1440034c412d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:07.928938 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 849/1733] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:07.942104 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97be10-e6ec-4920-809e-ec9d2f2ecebc None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:07.983952 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97be10-e6ec-4920-809e-ec9d2f2ecebc None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:08.016812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f888c1-a47b-4a74-b13e-e2d603d7adf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:08.017743 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f888c1-a47b-4a74-b13e-e2d603d7adf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:08.022569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f888c1-a47b-4a74-b13e-e2d603d7adf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:08.023035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f888c1-a47b-4a74-b13e-e2d603d7adf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:08.024247 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f888c1-a47b-4a74-b13e-e2d603d7adf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:23:08.024769 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f888c1-a47b-4a74-b13e-e2d603d7adf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:08.034306 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f888c1-a47b-4a74-b13e-e2d603d7adf3 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:08.068792 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 850/1734] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:23:08.076125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f888c1-a47b-4a74-b13e-e2d603d7adf3 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:08.118177 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f888c1-a47b-4a74-b13e-e2d603d7adf3 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:08.156221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb9bab-0f56-4848-b953-1440034c412d admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:08.169074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef247f31-b0ca-44e9-b590-ac4cb236c4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:08.169754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef247f31-b0ca-44e9-b590-ac4cb236c4aa admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:08.170670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef247f31-b0ca-44e9-b590-ac4cb236c4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:08.170670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef247f31-b0ca-44e9-b590-ac4cb236c4aa admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:08.171085 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef247f31-b0ca-44e9-b590-ac4cb236c4aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:08.177416 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eeec80-5865-4a30-af4c-83e377419edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:08.179513 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eeec80-5865-4a30-af4c-83e377419edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:08.179513 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eeec80-5865-4a30-af4c-83e377419edd admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:08.183922 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eeec80-5865-4a30-af4c-83e377419edd admin admin] PATH_INFO: `/v3/users/16eb56fb49974fcb83155d1a17f810cd` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:08.187010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eeec80-5865-4a30-af4c-83e377419edd admin admin] RBAC: Authorizing `identity:delete_user(user_id=16eb56fb49974fcb83155d1a17f810cd)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:08.192203 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef247f31-b0ca-44e9-b590-ac4cb236c4aa admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:08.201994 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eeec80-5865-4a30-af4c-83e377419edd admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:08.386223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 851/1735] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:23:08 2022] POST /identity/v3/projects => generated 355 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:08.388633 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21f5a5-0877-464a-a344-3342be9e1c44 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:08.389106 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21f5a5-0877-464a-a344-3342be9e1c44 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:08.389551 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21f5a5-0877-464a-a344-3342be9e1c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:08.469341 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-ac21f5a5-0877-464a-a344-3342be9e1c44 None None] MFA Rules not processed for user `aefaf6998acc4434aab62b9625bd25fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:08.473754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ac21f5a5-0877-464a-a344-3342be9e1c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:08.724728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-12eeec80-5865-4a30-af4c-83e377419edd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16eb56fb49974fcb83155d1a17f810cd'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:08.725990 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-12eeec80-5865-4a30-af4c-83e377419edd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16eb56fb49974fcb83155d1a17f810cd'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:08.794035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 852/1736] 10.222.0.98 () {58 vars in 1015 bytes} [Fri Sep 2 21:23:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:08.798112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21f5a5-0877-464a-a344-3342be9e1c44 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:08.820707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-12eeec80-5865-4a30-af4c-83e377419edd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16eb56fb49974fcb83155d1a17f810cd'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:08.842139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:08.879641 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-12eeec80-5865-4a30-af4c-83e377419edd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16eb56fb49974fcb83155d1a17f810cd'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:08.881894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-12eeec80-5865-4a30-af4c-83e377419edd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16eb56fb49974fcb83155d1a17f810cd'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:08.985982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 885/1737] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:07 2022] DELETE /identity/v3/users/16eb56fb49974fcb83155d1a17f810cd => generated 0 bytes in 1195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:08.985982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eeec80-5865-4a30-af4c-83e377419edd admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:08.985982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-12eeec80-5865-4a30-af4c-83e377419edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:09.072880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:09.094804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eeec80-5865-4a30-af4c-83e377419edd admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:09.109399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9a17d-3f4d-495a-b7b7-c0ea5db5f27a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:09.110625 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9a17d-3f4d-495a-b7b7-c0ea5db5f27a service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:09.129212 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9a17d-3f4d-495a-b7b7-c0ea5db5f27a service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:09.129865 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9a17d-3f4d-495a-b7b7-c0ea5db5f27a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:09.172119 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-05f9a17d-3f4d-495a-b7b7-c0ea5db5f27a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:09.215820 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21f5a5-0877-464a-a344-3342be9e1c44 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:09.270847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9a17d-3f4d-495a-b7b7-c0ea5db5f27a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:09.288839 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9a17d-3f4d-495a-b7b7-c0ea5db5f27a service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:09.380135 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 886/1738] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:09.457307 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282dabd3-86f1-4759-b8df-ef72a71e60a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:09.458733 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282dabd3-86f1-4759-b8df-ef72a71e60a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:09.460543 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282dabd3-86f1-4759-b8df-ef72a71e60a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:09.461232 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282dabd3-86f1-4759-b8df-ef72a71e60a4 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:09.466783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282dabd3-86f1-4759-b8df-ef72a71e60a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:09.475875 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282dabd3-86f1-4759-b8df-ef72a71e60a4 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:09.628593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 853/1739] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:23:08 2022] POST /identity/v3/users => generated 278 bytes in 834 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:09.633392 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9a17d-3f4d-495a-b7b7-c0ea5db5f27a service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:09.634909 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-05f9a17d-3f4d-495a-b7b7-c0ea5db5f27a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:09.660144 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9a17d-3f4d-495a-b7b7-c0ea5db5f27a service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:09.668619 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f73e54-6c00-45a6-b040-04cc6f4c1c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:09.669259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f73e54-6c00-45a6-b040-04cc6f4c1c24 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:09.669747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f73e54-6c00-45a6-b040-04cc6f4c1c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:09.670086 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f73e54-6c00-45a6-b040-04cc6f4c1c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:09.670759 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f73e54-6c00-45a6-b040-04cc6f4c1c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:09.675762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f73e54-6c00-45a6-b040-04cc6f4c1c24 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:09.730002 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282dabd3-86f1-4759-b8df-ef72a71e60a4 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:09.740784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 887/1740] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:09.751142 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282dabd3-86f1-4759-b8df-ef72a71e60a4 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:09.769528 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c701fd-de08-46e9-b0c9-107e02fb561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:09.770471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c701fd-de08-46e9-b0c9-107e02fb561e admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:09.770761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c701fd-de08-46e9-b0c9-107e02fb561e admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:09.771053 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c701fd-de08-46e9-b0c9-107e02fb561e admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:09.771740 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c701fd-de08-46e9-b0c9-107e02fb561e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:09.773389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c701fd-de08-46e9-b0c9-107e02fb561e admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:09.783529 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:09.818103 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f73e54-6c00-45a6-b040-04cc6f4c1c24 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:09.832351 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 854/1741] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:09.843114 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f73e54-6c00-45a6-b040-04cc6f4c1c24 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:09.855230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31d60c-a916-419a-96f8-1ca71ec91d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:09.856364 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31d60c-a916-419a-96f8-1ca71ec91d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:09.856619 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31d60c-a916-419a-96f8-1ca71ec91d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:09.857502 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31d60c-a916-419a-96f8-1ca71ec91d43 admin admin] PATH_INFO: `/v3/projects/07e10374404d4ef7bdfc3331fca3d493/users/2b25c48924524ff5a27be3cf8e736242/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:09.909198 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31d60c-a916-419a-96f8-1ca71ec91d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07e10374404d4ef7bdfc3331fca3d493, user_id=2b25c48924524ff5a27be3cf8e736242, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:09.911922 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31d60c-a916-419a-96f8-1ca71ec91d43 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:10.030313 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499eaaf0-4abd-4d0f-9a27-bc76938ace1b None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:10.030764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499eaaf0-4abd-4d0f-9a27-bc76938ace1b None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:10.030947 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499eaaf0-4abd-4d0f-9a27-bc76938ace1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:10.033911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 888/1742] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:09 2022] PUT /identity/v3/projects/07e10374404d4ef7bdfc3331fca3d493/users/2b25c48924524ff5a27be3cf8e736242/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:10.129396 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-499eaaf0-4abd-4d0f-9a27-bc76938ace1b None None] MFA Rules not processed for user `2b25c48924524ff5a27be3cf8e736242`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:10.131257 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-499eaaf0-4abd-4d0f-9a27-bc76938ace1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:10.368357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 855/1743] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:10.373463 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31d60c-a916-419a-96f8-1ca71ec91d43 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:10.563102 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31d60c-a916-419a-96f8-1ca71ec91d43 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:10.571926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044af0a-7999-4c3c-a716-92a34d94b9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:10.572599 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044af0a-7999-4c3c-a716-92a34d94b9fb admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:10.573513 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044af0a-7999-4c3c-a716-92a34d94b9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:10.574364 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044af0a-7999-4c3c-a716-92a34d94b9fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:10.575080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044af0a-7999-4c3c-a716-92a34d94b9fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:10.577151 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044af0a-7999-4c3c-a716-92a34d94b9fb admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:10.750567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 889/1744] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:23:10 2022] POST /identity/v3/projects => generated 355 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:10.752024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499eaaf0-4abd-4d0f-9a27-bc76938ace1b None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:10.771385 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499eaaf0-4abd-4d0f-9a27-bc76938ace1b None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:10.792316 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:10.956190 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf9ab5-59b5-426d-b146-1e1a3073b217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:10.957242 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf9ab5-59b5-426d-b146-1e1a3073b217 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:10.957704 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf9ab5-59b5-426d-b146-1e1a3073b217 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:10.958202 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf9ab5-59b5-426d-b146-1e1a3073b217 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:10.959092 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf9ab5-59b5-426d-b146-1e1a3073b217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:10.961697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf9ab5-59b5-426d-b146-1e1a3073b217 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:11.123814 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 856/1745] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:23:10 2022] POST /identity/v3/users => generated 284 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:11.132152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044af0a-7999-4c3c-a716-92a34d94b9fb admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:11.150666 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044af0a-7999-4c3c-a716-92a34d94b9fb admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:11.170961 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e40aa9-0309-44b5-95b3-b5100b0abd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:11.171627 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e40aa9-0309-44b5-95b3-b5100b0abd1e admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:11.171923 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e40aa9-0309-44b5-95b3-b5100b0abd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:11.172200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e40aa9-0309-44b5-95b3-b5100b0abd1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:11.178530 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e40aa9-0309-44b5-95b3-b5100b0abd1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:11.189936 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e40aa9-0309-44b5-95b3-b5100b0abd1e admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:11.213130 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf9ab5-59b5-426d-b146-1e1a3073b217 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:11.214353 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 890/1746] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:11.227166 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:11.242967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf9ab5-59b5-426d-b146-1e1a3073b217 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:11.244261 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e40aa9-0309-44b5-95b3-b5100b0abd1e admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:11.247785 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-10e40aa9-0309-44b5-95b3-b5100b0abd1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:11.262251 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4cdca-da2d-4bd5-8ab8-a5766bde4ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:11.276781 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4cdca-da2d-4bd5-8ab8-a5766bde4ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:11.277360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4cdca-da2d-4bd5-8ab8-a5766bde4ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:11.277864 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4cdca-da2d-4bd5-8ab8-a5766bde4ce5 admin admin] PATH_INFO: `/v3/projects/af20c8267a0640f88d19f4f413010ba1/users/18cb32144d664c428692caf8e6cf29b8/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:11.286693 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e40aa9-0309-44b5-95b3-b5100b0abd1e admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:11.303641 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b4f7d-4b62-4d22-bd9d-15488fbef097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:11.310571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b4f7d-4b62-4d22-bd9d-15488fbef097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:11.311666 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b4f7d-4b62-4d22-bd9d-15488fbef097 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:11.314166 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b4f7d-4b62-4d22-bd9d-15488fbef097 admin admin] PATH_INFO: `/v3/projects/161a20f0c29b408f8f446d51ca5cc07b` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:11.338782 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b4f7d-4b62-4d22-bd9d-15488fbef097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=161a20f0c29b408f8f446d51ca5cc07b)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:11.360119 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b4f7d-4b62-4d22-bd9d-15488fbef097 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:11.384726 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4cdca-da2d-4bd5-8ab8-a5766bde4ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af20c8267a0640f88d19f4f413010ba1, user_id=18cb32144d664c428692caf8e6cf29b8, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:11.403924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4cdca-da2d-4bd5-8ab8-a5766bde4ce5 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:11.408001 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:11.572106 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 857/1747] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:11 2022] PUT /identity/v3/projects/af20c8267a0640f88d19f4f413010ba1/users/18cb32144d664c428692caf8e6cf29b8/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:11.576760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4cdca-da2d-4bd5-8ab8-a5766bde4ce5 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:11.751239 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9b8b4f7d-4b62-4d22-bd9d-15488fbef097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '161a20f0c29b408f8f446d51ca5cc07b', 'request_id': 'req-9b8b4f7d-4b62-4d22-bd9d-15488fbef097'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:11.769306 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9b8b4f7d-4b62-4d22-bd9d-15488fbef097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '161a20f0c29b408f8f446d51ca5cc07b', 'request_id': 'req-9b8b4f7d-4b62-4d22-bd9d-15488fbef097'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:11.790664 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9b8b4f7d-4b62-4d22-bd9d-15488fbef097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '161a20f0c29b408f8f446d51ca5cc07b', 'request_id': 'req-9b8b4f7d-4b62-4d22-bd9d-15488fbef097'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:11.929870 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4cdca-da2d-4bd5-8ab8-a5766bde4ce5 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:11.948460 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9b8b4f7d-4b62-4d22-bd9d-15488fbef097 admin admin] The token cache is being invalidate because project 161a20f0c29b408f8f446d51ca5cc07b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:11.951515 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9b8b4f7d-4b62-4d22-bd9d-15488fbef097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:11.951515 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9b8b4f7d-4b62-4d22-bd9d-15488fbef097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:11.951947 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 891/1748] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:11 2022] DELETE /identity/v3/projects/161a20f0c29b408f8f446d51ca5cc07b => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:11.956950 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b4f7d-4b62-4d22-bd9d-15488fbef097 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:11.959118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-9b8b4f7d-4b62-4d22-bd9d-15488fbef097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:12.179351 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dc487-13f7-43fd-8eee-11deb01cec4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:12.181377 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dc487-13f7-43fd-8eee-11deb01cec4a admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:12.181757 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dc487-13f7-43fd-8eee-11deb01cec4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:12.182148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dc487-13f7-43fd-8eee-11deb01cec4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:12.183018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78dc487-13f7-43fd-8eee-11deb01cec4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:12.188238 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78dc487-13f7-43fd-8eee-11deb01cec4a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:12.208561 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 858/1749] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 629 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:12.208561 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dc487-13f7-43fd-8eee-11deb01cec4a admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:12.211400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d78dc487-13f7-43fd-8eee-11deb01cec4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:12.228200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dc487-13f7-43fd-8eee-11deb01cec4a admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:12.234540 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c0af0-707c-4219-a995-2f865ef2f1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:12.236195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c0af0-707c-4219-a995-2f865ef2f1e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:12.236424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c0af0-707c-4219-a995-2f865ef2f1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:12.236756 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c0af0-707c-4219-a995-2f865ef2f1e9 admin admin] PATH_INFO: `/v3/users/433bdd53aa6144f0853e5f7a8caf50b0` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:12.239655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c0af0-707c-4219-a995-2f865ef2f1e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=433bdd53aa6144f0853e5f7a8caf50b0)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:12.243235 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c0af0-707c-4219-a995-2f865ef2f1e9 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:12.274917 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b4f7d-4b62-4d22-bd9d-15488fbef097 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:12.295877 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cbe57-0fd6-4eed-b5cb-61806925227d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:12.302972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cbe57-0fd6-4eed-b5cb-61806925227d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:12.304378 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cbe57-0fd6-4eed-b5cb-61806925227d admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:12.307207 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cbe57-0fd6-4eed-b5cb-61806925227d admin admin] PATH_INFO: `/v3/users/2a7733db349d4d7a92cb5a8ff0602978` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:12.309553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9cbe57-0fd6-4eed-b5cb-61806925227d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a7733db349d4d7a92cb5a8ff0602978)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:12.331427 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9cbe57-0fd6-4eed-b5cb-61806925227d admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:12.553256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2c3c0af0-707c-4219-a995-2f865ef2f1e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '433bdd53aa6144f0853e5f7a8caf50b0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:12.554052 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2c3c0af0-707c-4219-a995-2f865ef2f1e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '433bdd53aa6144f0853e5f7a8caf50b0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:12.593110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2c3c0af0-707c-4219-a995-2f865ef2f1e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '433bdd53aa6144f0853e5f7a8caf50b0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:12.655648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2c3c0af0-707c-4219-a995-2f865ef2f1e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '433bdd53aa6144f0853e5f7a8caf50b0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:12.657047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2c3c0af0-707c-4219-a995-2f865ef2f1e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '433bdd53aa6144f0853e5f7a8caf50b0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:12.769255 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9c9cbe57-0fd6-4eed-b5cb-61806925227d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a7733db349d4d7a92cb5a8ff0602978'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:12.774471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9c9cbe57-0fd6-4eed-b5cb-61806925227d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a7733db349d4d7a92cb5a8ff0602978'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:12.842130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9c9cbe57-0fd6-4eed-b5cb-61806925227d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a7733db349d4d7a92cb5a8ff0602978'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:12.866375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9c9cbe57-0fd6-4eed-b5cb-61806925227d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a7733db349d4d7a92cb5a8ff0602978'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:12.867265 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9c9cbe57-0fd6-4eed-b5cb-61806925227d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a7733db349d4d7a92cb5a8ff0602978'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:12.869583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 859/1750] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:12 2022] DELETE /identity/v3/users/433bdd53aa6144f0853e5f7a8caf50b0 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:12.870995 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c0af0-707c-4219-a995-2f865ef2f1e9 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:12.872778 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-2c3c0af0-707c-4219-a995-2f865ef2f1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:13.001118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 892/1751] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:11 2022] DELETE /identity/v3/users/2a7733db349d4d7a92cb5a8ff0602978 => generated 0 bytes in 1045 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:13.006118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b58ea-2b86-459c-8000-fabaca144f0a None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:13.007342 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b58ea-2b86-459c-8000-fabaca144f0a None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:13.009758 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b58ea-2b86-459c-8000-fabaca144f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:13.121555 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-dd1b58ea-2b86-459c-8000-fabaca144f0a None None] MFA Rules not processed for user `aa84378418324708b40f0791e2217ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:13.123027 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-dd1b58ea-2b86-459c-8000-fabaca144f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:13.151805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c0af0-707c-4219-a995-2f865ef2f1e9 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:13.269612 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 893/1752] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:13.271153 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cc52c-d683-4bba-9bf4-6f6687cbf5c6 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:13.271546 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cc52c-d683-4bba-9bf4-6f6687cbf5c6 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:13.271854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cc52c-d683-4bba-9bf4-6f6687cbf5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:13.319635 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-974cc52c-d683-4bba-9bf4-6f6687cbf5c6 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:13.321101 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-974cc52c-d683-4bba-9bf4-6f6687cbf5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:13.413769 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c51a18-58aa-4546-86ef-8fe80a2539c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:13.424562 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c51a18-58aa-4546-86ef-8fe80a2539c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:13.425347 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c51a18-58aa-4546-86ef-8fe80a2539c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:13.425904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c51a18-58aa-4546-86ef-8fe80a2539c8 admin admin] PATH_INFO: `/v3/projects/af20c8267a0640f88d19f4f413010ba1/users/18cb32144d664c428692caf8e6cf29b8/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:13.428732 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c51a18-58aa-4546-86ef-8fe80a2539c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af20c8267a0640f88d19f4f413010ba1, user_id=18cb32144d664c428692caf8e6cf29b8, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:13.438128 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c51a18-58aa-4546-86ef-8fe80a2539c8 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:13.534600 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 860/1753] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:12 2022] PUT /identity/v3/projects/af20c8267a0640f88d19f4f413010ba1/users/18cb32144d664c428692caf8e6cf29b8/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:13.543039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 894/1754] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:13.550680 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb61b18-aefe-48b2-9384-144467cbc97f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:13.551039 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb61b18-aefe-48b2-9384-144467cbc97f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:13.551329 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb61b18-aefe-48b2-9384-144467cbc97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:13.559348 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974cc52c-d683-4bba-9bf4-6f6687cbf5c6 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:13.561080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-974cc52c-d683-4bba-9bf4-6f6687cbf5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:13.633287 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:13.688366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-dcb61b18-aefe-48b2-9384-144467cbc97f None None] MFA Rules not processed for user `18cb32144d664c428692caf8e6cf29b8`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:13.695158 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-dcb61b18-aefe-48b2-9384-144467cbc97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:13.815073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974cc52c-d683-4bba-9bf4-6f6687cbf5c6 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:13.882239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 861/1755] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:13.904222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb61b18-aefe-48b2-9384-144467cbc97f None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:13.907883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-dcb61b18-aefe-48b2-9384-144467cbc97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:13.974257 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2ff40-502f-4609-809f-205d13be10fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:13.975548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2ff40-502f-4609-809f-205d13be10fa service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:13.976582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2ff40-502f-4609-809f-205d13be10fa service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:13.977083 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2ff40-502f-4609-809f-205d13be10fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:14.118045 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb61b18-aefe-48b2-9384-144467cbc97f None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:14.123462 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8c5e3-f5d6-4578-a09b-e4281b789c07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:14.124111 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8c5e3-f5d6-4578-a09b-e4281b789c07 service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:14.124407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8c5e3-f5d6-4578-a09b-e4281b789c07 service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:14.124693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8c5e3-f5d6-4578-a09b-e4281b789c07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:14.157204 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8c5e3-f5d6-4578-a09b-e4281b789c07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:14.158927 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8c5e3-f5d6-4578-a09b-e4281b789c07 service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:14.190522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 862/1756] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:13 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:14.220454 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2ff40-502f-4609-809f-205d13be10fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:14.222218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2ff40-502f-4609-809f-205d13be10fa service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:14.239023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 895/1757] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:23:14.283035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:14.718771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8c5e3-f5d6-4578-a09b-e4281b789c07 service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:14.722086 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-18e8c5e3-f5d6-4578-a09b-e4281b789c07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:14.750535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8c5e3-f5d6-4578-a09b-e4281b789c07 service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:14.763124 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450b25f-6b87-458a-bff4-a6dabf956a81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:14.765591 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450b25f-6b87-458a-bff4-a6dabf956a81 service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:14.766157 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450b25f-6b87-458a-bff4-a6dabf956a81 service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:14.775213 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450b25f-6b87-458a-bff4-a6dabf956a81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:14.780561 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f450b25f-6b87-458a-bff4-a6dabf956a81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:14.990762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450b25f-6b87-458a-bff4-a6dabf956a81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:14.992942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450b25f-6b87-458a-bff4-a6dabf956a81 service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:15.035629 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 863/1758] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:15.124647 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd1c0f-309c-4f5c-976d-cd1d019c4fcd None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:15.125225 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd1c0f-309c-4f5c-976d-cd1d019c4fcd None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:15.125438 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd1c0f-309c-4f5c-976d-cd1d019c4fcd None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:15.127854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 896/1759] 10.222.0.79 () {54 vars in 921 bytes} [Fri Sep 2 21:23:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:23:15.305090 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2195d-0125-4085-9dd6-76a0c1f13b74 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:15.305090 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2195d-0125-4085-9dd6-76a0c1f13b74 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:15.305090 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2195d-0125-4085-9dd6-76a0c1f13b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:15.374630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-1ee2195d-0125-4085-9dd6-76a0c1f13b74 None None] MFA Rules not processed for user `632071470f7d409ab7b0129d120320c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:15.376089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-1ee2195d-0125-4085-9dd6-76a0c1f13b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:15.600997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 864/1760] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Sep 2 21:23:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:15.915215 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738ec40-3d06-4fc1-b523-048515c90ede None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:15.915507 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738ec40-3d06-4fc1-b523-048515c90ede None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:15.915797 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738ec40-3d06-4fc1-b523-048515c90ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:15.948164 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-d738ec40-3d06-4fc1-b523-048515c90ede None None] MFA Rules not processed for user `cceaf0c4877a4316af9d15c642c9dfc4`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:15.949455 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-d738ec40-3d06-4fc1-b523-048515c90ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:16.101574 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 897/1761] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:16.249270 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0463356-9dca-4ea6-bc29-eec242d6d85d None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:16.249557 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0463356-9dca-4ea6-bc29-eec242d6d85d None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:16.249905 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0463356-9dca-4ea6-bc29-eec242d6d85d None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:16.252115 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 865/1762] 10.222.0.79 () {54 vars in 921 bytes} [Fri Sep 2 21:23:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:23:16.258163 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab2f12-455b-441c-9ac2-90155501cebc None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:16.258772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab2f12-455b-441c-9ac2-90155501cebc None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:16.258772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab2f12-455b-441c-9ac2-90155501cebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:16.327642 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0463356-9dca-4ea6-bc29-eec242d6d85d None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:16.330166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-c0463356-9dca-4ea6-bc29-eec242d6d85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:16.339313 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-7aab2f12-455b-441c-9ac2-90155501cebc None None] MFA Rules not processed for user `632071470f7d409ab7b0129d120320c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:16.342937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-7aab2f12-455b-441c-9ac2-90155501cebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:16.365163 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0463356-9dca-4ea6-bc29-eec242d6d85d None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:16.389936 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 898/1763] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Sep 2 21:23:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:16.391215 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab2f12-455b-441c-9ac2-90155501cebc None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:16.398206 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-7aab2f12-455b-441c-9ac2-90155501cebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:16.408489 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4275bf4-18ea-42bc-85cc-cfbc10f4f0a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:16.409623 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4275bf4-18ea-42bc-85cc-cfbc10f4f0a7 service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:16.410527 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4275bf4-18ea-42bc-85cc-cfbc10f4f0a7 service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:16.411039 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4275bf4-18ea-42bc-85cc-cfbc10f4f0a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:16.427332 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4275bf4-18ea-42bc-85cc-cfbc10f4f0a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:16.432400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4275bf4-18ea-42bc-85cc-cfbc10f4f0a7 service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:16.436766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab2f12-455b-441c-9ac2-90155501cebc None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:16.443718 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b4696-56d6-4c98-9def-3824f229abef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:16.444616 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b4696-56d6-4c98-9def-3824f229abef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:16.445142 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b4696-56d6-4c98-9def-3824f229abef admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:16.445456 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b4696-56d6-4c98-9def-3824f229abef admin admin] PATH_INFO: `/v3/projects/cd593f07101a4541b52adba5cb338597` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:16.448644 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b4696-56d6-4c98-9def-3824f229abef admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd593f07101a4541b52adba5cb338597)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:16.451975 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b4696-56d6-4c98-9def-3824f229abef admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:16.462274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 866/1764] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:16.463554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4275bf4-18ea-42bc-85cc-cfbc10f4f0a7 service nova] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:16.465255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d4275bf4-18ea-42bc-85cc-cfbc10f4f0a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:16.486050 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4275bf4-18ea-42bc-85cc-cfbc10f4f0a7 service nova] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:16.496898 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0affbe-ba7e-4ef6-a97f-86d7cd350adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:16.497648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0affbe-ba7e-4ef6-a97f-86d7cd350adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:16.498227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0affbe-ba7e-4ef6-a97f-86d7cd350adf admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:16.498801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0affbe-ba7e-4ef6-a97f-86d7cd350adf admin admin] PATH_INFO: `/v3/projects/a7ebc9eaf5de4ce78a63813312ad1229` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:16.501779 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0affbe-ba7e-4ef6-a97f-86d7cd350adf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7ebc9eaf5de4ce78a63813312ad1229)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:16.506144 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0affbe-ba7e-4ef6-a97f-86d7cd350adf admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:16.648954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-be9b4696-56d6-4c98-9def-3824f229abef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd593f07101a4541b52adba5cb338597', 'request_id': 'req-be9b4696-56d6-4c98-9def-3824f229abef'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:16.655674 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-be9b4696-56d6-4c98-9def-3824f229abef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd593f07101a4541b52adba5cb338597', 'request_id': 'req-be9b4696-56d6-4c98-9def-3824f229abef'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:16.679867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-be9b4696-56d6-4c98-9def-3824f229abef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd593f07101a4541b52adba5cb338597', 'request_id': 'req-be9b4696-56d6-4c98-9def-3824f229abef'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:16.780153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-aa0affbe-ba7e-4ef6-a97f-86d7cd350adf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ebc9eaf5de4ce78a63813312ad1229', 'request_id': 'req-aa0affbe-ba7e-4ef6-a97f-86d7cd350adf'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:16.788790 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-aa0affbe-ba7e-4ef6-a97f-86d7cd350adf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ebc9eaf5de4ce78a63813312ad1229', 'request_id': 'req-aa0affbe-ba7e-4ef6-a97f-86d7cd350adf'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:16.797882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-aa0affbe-ba7e-4ef6-a97f-86d7cd350adf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ebc9eaf5de4ce78a63813312ad1229', 'request_id': 'req-aa0affbe-ba7e-4ef6-a97f-86d7cd350adf'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:16.809104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-be9b4696-56d6-4c98-9def-3824f229abef admin admin] The token cache is being invalidate because project cd593f07101a4541b52adba5cb338597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:16.809919 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-be9b4696-56d6-4c98-9def-3824f229abef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:16.810903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-be9b4696-56d6-4c98-9def-3824f229abef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:16.814689 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 899/1765] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:16 2022] DELETE /identity/v3/projects/cd593f07101a4541b52adba5cb338597 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:16.818191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b4696-56d6-4c98-9def-3824f229abef admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:16.821610 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-be9b4696-56d6-4c98-9def-3824f229abef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:16.915769 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b4696-56d6-4c98-9def-3824f229abef admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:16.959704 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-aa0affbe-ba7e-4ef6-a97f-86d7cd350adf admin admin] The token cache is being invalidate because project a7ebc9eaf5de4ce78a63813312ad1229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:16.960950 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-aa0affbe-ba7e-4ef6-a97f-86d7cd350adf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:16.961435 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-aa0affbe-ba7e-4ef6-a97f-86d7cd350adf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:16.964575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 867/1766] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:16 2022] DELETE /identity/v3/projects/a7ebc9eaf5de4ce78a63813312ad1229 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:16.965305 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0affbe-ba7e-4ef6-a97f-86d7cd350adf admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:16.971040 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-aa0affbe-ba7e-4ef6-a97f-86d7cd350adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:17.089470 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99a653-6b82-4d5b-a8b9-35d4cf4ed80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:17.090594 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99a653-6b82-4d5b-a8b9-35d4cf4ed80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:17.091238 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99a653-6b82-4d5b-a8b9-35d4cf4ed80a admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:17.091723 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99a653-6b82-4d5b-a8b9-35d4cf4ed80a admin admin] PATH_INFO: `/v3/users/fd4ca60d02ce48f783fe71a578b69031` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:17.093163 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99a653-6b82-4d5b-a8b9-35d4cf4ed80a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd4ca60d02ce48f783fe71a578b69031)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:17.097551 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99a653-6b82-4d5b-a8b9-35d4cf4ed80a admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:17.128261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0affbe-ba7e-4ef6-a97f-86d7cd350adf admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:17.139337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5d8fe-7e62-4a91-9c3f-25178ef4f6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:17.144670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5d8fe-7e62-4a91-9c3f-25178ef4f6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:17.144670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5d8fe-7e62-4a91-9c3f-25178ef4f6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:17.144670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5d8fe-7e62-4a91-9c3f-25178ef4f6b6 admin admin] PATH_INFO: `/v3/users/e2d9e9c5aabb4b6699cee583804a0f0b` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:17.144670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5d8fe-7e62-4a91-9c3f-25178ef4f6b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2d9e9c5aabb4b6699cee583804a0f0b)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:17.154134 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5d8fe-7e62-4a91-9c3f-25178ef4f6b6 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:17.404749 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:17.478144 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-aad5d8fe-7e62-4a91-9c3f-25178ef4f6b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2d9e9c5aabb4b6699cee583804a0f0b'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:17.482980 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-aad5d8fe-7e62-4a91-9c3f-25178ef4f6b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2d9e9c5aabb4b6699cee583804a0f0b'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:17.486057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-5b99a653-6b82-4d5b-a8b9-35d4cf4ed80a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd4ca60d02ce48f783fe71a578b69031'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:17.494126 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-5b99a653-6b82-4d5b-a8b9-35d4cf4ed80a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd4ca60d02ce48f783fe71a578b69031'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:17.499378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-aad5d8fe-7e62-4a91-9c3f-25178ef4f6b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2d9e9c5aabb4b6699cee583804a0f0b'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:17.518513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-aad5d8fe-7e62-4a91-9c3f-25178ef4f6b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2d9e9c5aabb4b6699cee583804a0f0b'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:17.520253 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-aad5d8fe-7e62-4a91-9c3f-25178ef4f6b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2d9e9c5aabb4b6699cee583804a0f0b'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:17.547873 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-5b99a653-6b82-4d5b-a8b9-35d4cf4ed80a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd4ca60d02ce48f783fe71a578b69031'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:17.567006 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-5b99a653-6b82-4d5b-a8b9-35d4cf4ed80a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd4ca60d02ce48f783fe71a578b69031'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:17.569794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-5b99a653-6b82-4d5b-a8b9-35d4cf4ed80a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd4ca60d02ce48f783fe71a578b69031'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:17.636627 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 868/1767] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:16 2022] DELETE /identity/v3/users/e2d9e9c5aabb4b6699cee583804a0f0b => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:17.644135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230d739-3bbf-4497-a185-0787bea2f610 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:17.645235 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230d739-3bbf-4497-a185-0787bea2f610 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:17.645547 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230d739-3bbf-4497-a185-0787bea2f610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:17.719073 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-9230d739-3bbf-4497-a185-0787bea2f610 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:17.720254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-9230d739-3bbf-4497-a185-0787bea2f610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:17.814712 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 900/1768] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:16 2022] DELETE /identity/v3/users/fd4ca60d02ce48f783fe71a578b69031 => generated 0 bytes in 994 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:17.816551 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01120c-d499-46dd-b01e-d28d49e36816 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:17.817224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01120c-d499-46dd-b01e-d28d49e36816 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:17.817734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01120c-d499-46dd-b01e-d28d49e36816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:17.870639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-ea01120c-d499-46dd-b01e-d28d49e36816 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:17.872603 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ea01120c-d499-46dd-b01e-d28d49e36816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:17.876722 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 869/1769] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:17.888668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230d739-3bbf-4497-a185-0787bea2f610 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:17.899926 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-9230d739-3bbf-4497-a185-0787bea2f610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:17.966709 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:18.072787 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 901/1770] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:18.078505 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9f6f5-ebd8-4fbc-b3de-866809351a28 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:18.079205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9f6f5-ebd8-4fbc-b3de-866809351a28 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:18.080014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9f6f5-ebd8-4fbc-b3de-866809351a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:18.130544 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-5ff9f6f5-ebd8-4fbc-b3de-866809351a28 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:18.146977 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-5ff9f6f5-ebd8-4fbc-b3de-866809351a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:18.163418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 902/1771] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:18.167601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9f6f5-ebd8-4fbc-b3de-866809351a28 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:18.167963 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-5ff9f6f5-ebd8-4fbc-b3de-866809351a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:18.261022 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230d739-3bbf-4497-a185-0787bea2f610 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:18.348259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9f6f5-ebd8-4fbc-b3de-866809351a28 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:18.364925 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a647d-c66d-4458-9cd1-3c212cbb734b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:18.365625 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a647d-c66d-4458-9cd1-3c212cbb734b service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:18.366013 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a647d-c66d-4458-9cd1-3c212cbb734b service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:18.366301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a647d-c66d-4458-9cd1-3c212cbb734b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:18.390852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a647d-c66d-4458-9cd1-3c212cbb734b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:18.392315 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a647d-c66d-4458-9cd1-3c212cbb734b service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:18.422863 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 903/1772] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:18.426268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a647d-c66d-4458-9cd1-3c212cbb734b service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:18.453230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a647d-c66d-4458-9cd1-3c212cbb734b service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:18.456048 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d928f43-9aec-4b1a-9f6a-89b27fcf3971 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:18.456550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d928f43-9aec-4b1a-9f6a-89b27fcf3971 service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:18.456835 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d928f43-9aec-4b1a-9f6a-89b27fcf3971 service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:18.457682 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d928f43-9aec-4b1a-9f6a-89b27fcf3971 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:18.462988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8d928f43-9aec-4b1a-9f6a-89b27fcf3971 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:18.466615 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38261bc-9d93-451c-a219-81569a8d4567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:18.467244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38261bc-9d93-451c-a219-81569a8d4567 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:18.467639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38261bc-9d93-451c-a219-81569a8d4567 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:18.469128 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38261bc-9d93-451c-a219-81569a8d4567 admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:18.469842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38261bc-9d93-451c-a219-81569a8d4567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:23:18.472649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38261bc-9d93-451c-a219-81569a8d4567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:18.480113 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38261bc-9d93-451c-a219-81569a8d4567 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:18.506868 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d928f43-9aec-4b1a-9f6a-89b27fcf3971 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:18.515801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d928f43-9aec-4b1a-9f6a-89b27fcf3971 service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:18.522832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 904/1773] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:23:18.529842 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38261bc-9d93-451c-a219-81569a8d4567 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:18.549050 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38261bc-9d93-451c-a219-81569a8d4567 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:18.567411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573a782-ba24-4f51-b981-8f03e099b4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:18.567984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 870/1774] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:23:18.569538 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573a782-ba24-4f51-b981-8f03e099b4fa admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:18.571035 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573a782-ba24-4f51-b981-8f03e099b4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:18.571771 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573a782-ba24-4f51-b981-8f03e099b4fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:18.575324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573a782-ba24-4f51-b981-8f03e099b4fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:18.582526 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573a782-ba24-4f51-b981-8f03e099b4fa admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:18.729583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d928f43-9aec-4b1a-9f6a-89b27fcf3971 service nova] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:18.731988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8d928f43-9aec-4b1a-9f6a-89b27fcf3971 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:18.772222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d928f43-9aec-4b1a-9f6a-89b27fcf3971 service nova] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:18.801198 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 905/1775] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:23:18 2022] POST /identity/v3/projects => generated 383 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:23:18.803208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfac3a0-7ceb-4498-a9b3-321e5deab3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:18.803978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfac3a0-7ceb-4498-a9b3-321e5deab3ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:18.804326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfac3a0-7ceb-4498-a9b3-321e5deab3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:18.804670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfac3a0-7ceb-4498-a9b3-321e5deab3ce admin admin] PATH_INFO: `/v3/projects/9fb6e63db464478388993282157765ff` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:18.811339 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573a782-ba24-4f51-b981-8f03e099b4fa admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:18.811820 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfac3a0-7ceb-4498-a9b3-321e5deab3ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fb6e63db464478388993282157765ff)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:18.814284 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfac3a0-7ceb-4498-a9b3-321e5deab3ce admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:19.004970 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-9cfac3a0-7ceb-4498-a9b3-321e5deab3ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fb6e63db464478388993282157765ff', 'request_id': 'req-9cfac3a0-7ceb-4498-a9b3-321e5deab3ce'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:19.008421 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573a782-ba24-4f51-b981-8f03e099b4fa admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:19.043943 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-9cfac3a0-7ceb-4498-a9b3-321e5deab3ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fb6e63db464478388993282157765ff', 'request_id': 'req-9cfac3a0-7ceb-4498-a9b3-321e5deab3ce'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:19.099679 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-9cfac3a0-7ceb-4498-a9b3-321e5deab3ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fb6e63db464478388993282157765ff', 'request_id': 'req-9cfac3a0-7ceb-4498-a9b3-321e5deab3ce'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:19.165249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a4ec7-bbd9-4a81-a202-9e42009fc70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:19.165968 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a4ec7-bbd9-4a81-a202-9e42009fc70f admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:19.166250 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a4ec7-bbd9-4a81-a202-9e42009fc70f admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:19.166726 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a4ec7-bbd9-4a81-a202-9e42009fc70f admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:19.167597 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a4ec7-bbd9-4a81-a202-9e42009fc70f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:19.170031 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a4ec7-bbd9-4a81-a202-9e42009fc70f admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:19.271286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-9cfac3a0-7ceb-4498-a9b3-321e5deab3ce admin admin] The token cache is being invalidate because project 9fb6e63db464478388993282157765ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:19.271592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-9cfac3a0-7ceb-4498-a9b3-321e5deab3ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:19.274488 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-9cfac3a0-7ceb-4498-a9b3-321e5deab3ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:19.283218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 871/1776] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:18 2022] DELETE /identity/v3/projects/9fb6e63db464478388993282157765ff => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:23:19.285534 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52539836-f04d-487c-a8ef-495253026a57 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:19.285754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52539836-f04d-487c-a8ef-495253026a57 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:19.286117 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52539836-f04d-487c-a8ef-495253026a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:19.328219 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 906/1777] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:23:18 2022] POST /identity/v3/users => generated 292 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:19.331223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a4ec7-bbd9-4a81-a202-9e42009fc70f admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:19.333965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-6a1a4ec7-bbd9-4a81-a202-9e42009fc70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:19.368281 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-52539836-f04d-487c-a8ef-495253026a57 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:19.370138 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-52539836-f04d-487c-a8ef-495253026a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:19.371228 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a4ec7-bbd9-4a81-a202-9e42009fc70f admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:19.377624 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ab294-c17e-4234-b766-f768487efab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:19.378294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ab294-c17e-4234-b766-f768487efab0 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:19.378655 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ab294-c17e-4234-b766-f768487efab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:19.379075 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ab294-c17e-4234-b766-f768487efab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:19.379923 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ab294-c17e-4234-b766-f768487efab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:19.382106 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ab294-c17e-4234-b766-f768487efab0 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:19.402051 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 872/1778] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:19.410759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ac835-73fd-422b-8430-27b71e301674 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:19.411300 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ac835-73fd-422b-8430-27b71e301674 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:19.411835 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ac835-73fd-422b-8430-27b71e301674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:19.433868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 907/1779] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:23:19.436278 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ab294-c17e-4234-b766-f768487efab0 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:19.456027 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-a62ac835-73fd-422b-8430-27b71e301674 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:19.458035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-a62ac835-73fd-422b-8430-27b71e301674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:19.485117 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 873/1780] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:19.486289 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ab294-c17e-4234-b766-f768487efab0 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:19.486626 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ac835-73fd-422b-8430-27b71e301674 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:19.502593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258da82b-03d1-4222-a9c5-f6136c5739c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:19.503339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ac835-73fd-422b-8430-27b71e301674 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:19.504114 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258da82b-03d1-4222-a9c5-f6136c5739c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:19.505124 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258da82b-03d1-4222-a9c5-f6136c5739c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:19.505464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258da82b-03d1-4222-a9c5-f6136c5739c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:19.511281 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258da82b-03d1-4222-a9c5-f6136c5739c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:19.512254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed82174-acd6-49cc-8757-fe9e3452eec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:19.513359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed82174-acd6-49cc-8757-fe9e3452eec2 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:19.514409 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed82174-acd6-49cc-8757-fe9e3452eec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:19.515115 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed82174-acd6-49cc-8757-fe9e3452eec2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:19.516932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed82174-acd6-49cc-8757-fe9e3452eec2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:23:19.517441 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed82174-acd6-49cc-8757-fe9e3452eec2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:19.517659 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258da82b-03d1-4222-a9c5-f6136c5739c3 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:19.520506 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed82174-acd6-49cc-8757-fe9e3452eec2 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:19.538516 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 874/1781] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:23:19.543331 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed82174-acd6-49cc-8757-fe9e3452eec2 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:19.559284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 908/1782] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:19.561026 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258da82b-03d1-4222-a9c5-f6136c5739c3 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:19.568120 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed82174-acd6-49cc-8757-fe9e3452eec2 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:19.575296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b8b4c-9a0c-4571-86ae-9b17c4a731df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:19.576929 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b8b4c-9a0c-4571-86ae-9b17c4a731df admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:19.577399 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b8b4c-9a0c-4571-86ae-9b17c4a731df admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:19.579536 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b8b4c-9a0c-4571-86ae-9b17c4a731df admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:19.580818 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b8b4c-9a0c-4571-86ae-9b17c4a731df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:19.586015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b8b4c-9a0c-4571-86ae-9b17c4a731df admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:19.591743 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258da82b-03d1-4222-a9c5-f6136c5739c3 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:19.626699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ac6be-dc10-40bc-9ce2-e052ca5d1de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:19.627657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ac6be-dc10-40bc-9ce2-e052ca5d1de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:19.627657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ac6be-dc10-40bc-9ce2-e052ca5d1de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:19.628010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ac6be-dc10-40bc-9ce2-e052ca5d1de4 admin admin] PATH_INFO: `/v3/projects/15528dcc6cf94fe7a16da96bf551680e/users/05a14f6961ca4e398d28d06420494364/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:19.673079 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ac6be-dc10-40bc-9ce2-e052ca5d1de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15528dcc6cf94fe7a16da96bf551680e, user_id=05a14f6961ca4e398d28d06420494364, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:19.675677 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ac6be-dc10-40bc-9ce2-e052ca5d1de4 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:19.707052 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 875/1783] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:23:19 2022] POST /identity/v3/projects => generated 361 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:19.711326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b8b4c-9a0c-4571-86ae-9b17c4a731df admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:19.824641 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 909/1784] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:19 2022] PUT /identity/v3/projects/15528dcc6cf94fe7a16da96bf551680e/users/05a14f6961ca4e398d28d06420494364/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:19.833203 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40393e-3127-4f4e-aef3-4c1770f9ac61 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:19.833999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40393e-3127-4f4e-aef3-4c1770f9ac61 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:19.851539 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40393e-3127-4f4e-aef3-4c1770f9ac61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:19.945336 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b8b4c-9a0c-4571-86ae-9b17c4a731df admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:19.957137 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-7d40393e-3127-4f4e-aef3-4c1770f9ac61 None None] MFA Rules not processed for user `05a14f6961ca4e398d28d06420494364`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:19.962552 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-7d40393e-3127-4f4e-aef3-4c1770f9ac61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:20.093045 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10405f-fc10-42fd-8f0e-11f23479b6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:20.093775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10405f-fc10-42fd-8f0e-11f23479b6c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:20.094157 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10405f-fc10-42fd-8f0e-11f23479b6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:20.094508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10405f-fc10-42fd-8f0e-11f23479b6c6 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:20.096660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10405f-fc10-42fd-8f0e-11f23479b6c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:20.099151 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10405f-fc10-42fd-8f0e-11f23479b6c6 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:20.135853 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 910/1785] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:20.137483 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40393e-3127-4f4e-aef3-4c1770f9ac61 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:20.196480 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40393e-3127-4f4e-aef3-4c1770f9ac61 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:20.212678 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30218df1-3311-4789-bc32-71d1ea651aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:20.215559 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30218df1-3311-4789-bc32-71d1ea651aac admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:20.215885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30218df1-3311-4789-bc32-71d1ea651aac admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:20.217634 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30218df1-3311-4789-bc32-71d1ea651aac admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:20.221042 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30218df1-3311-4789-bc32-71d1ea651aac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:20.221042 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30218df1-3311-4789-bc32-71d1ea651aac admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:20.267558 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 876/1786] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:23:19 2022] POST /identity/v3/users => generated 281 bytes in 557 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:20.278735 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10405f-fc10-42fd-8f0e-11f23479b6c6 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:20.305224 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10405f-fc10-42fd-8f0e-11f23479b6c6 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:20.326235 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bc075-1c04-45e1-b8b4-cd02d20e82eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:20.327185 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bc075-1c04-45e1-b8b4-cd02d20e82eb admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:20.327535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bc075-1c04-45e1-b8b4-cd02d20e82eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:20.327956 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bc075-1c04-45e1-b8b4-cd02d20e82eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:20.341706 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199bc075-1c04-45e1-b8b4-cd02d20e82eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:20.341706 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199bc075-1c04-45e1-b8b4-cd02d20e82eb admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:20.359059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 877/1787] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:20.365132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bc075-1c04-45e1-b8b4-cd02d20e82eb admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:20.378949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bc075-1c04-45e1-b8b4-cd02d20e82eb admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:20.386837 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8076a-8bc9-4531-91ac-a2e33bdbe7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:20.388410 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8076a-8bc9-4531-91ac-a2e33bdbe7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:20.388983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8076a-8bc9-4531-91ac-a2e33bdbe7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:20.389507 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8076a-8bc9-4531-91ac-a2e33bdbe7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:20.390917 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8076a-8bc9-4531-91ac-a2e33bdbe7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:20.393719 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8076a-8bc9-4531-91ac-a2e33bdbe7a0 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:20.423063 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 878/1788] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:20.427544 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8076a-8bc9-4531-91ac-a2e33bdbe7a0 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:20.446243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 911/1789] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:23:20 2022] POST /identity/v3/projects => generated 383 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:20.446457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8076a-8bc9-4531-91ac-a2e33bdbe7a0 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:20.448173 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30218df1-3311-4789-bc32-71d1ea651aac admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:20.557724 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d192c9-26de-40df-bbe0-730473b2fa13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:20.559546 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d192c9-26de-40df-bbe0-730473b2fa13 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:20.560018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d192c9-26de-40df-bbe0-730473b2fa13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:20.560446 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d192c9-26de-40df-bbe0-730473b2fa13 admin admin] PATH_INFO: `/v3/projects/d27caa908e584351ba28598c3bdddd23/users/e59a5ef5539d4b6386e9fea1eaedd71a/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:20.584919 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d192c9-26de-40df-bbe0-730473b2fa13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27caa908e584351ba28598c3bdddd23, user_id=e59a5ef5539d4b6386e9fea1eaedd71a, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:20.589192 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d192c9-26de-40df-bbe0-730473b2fa13 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:20.676892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30218df1-3311-4789-bc32-71d1ea651aac admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:20.714604 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3218d40-c32c-450f-a154-53ff68ecf362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:20.720548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3218d40-c32c-450f-a154-53ff68ecf362 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:20.724902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3218d40-c32c-450f-a154-53ff68ecf362 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:20.724902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3218d40-c32c-450f-a154-53ff68ecf362 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:20.724902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3218d40-c32c-450f-a154-53ff68ecf362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:20.730493 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3218d40-c32c-450f-a154-53ff68ecf362 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:20.760359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 879/1790] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:20 2022] PUT /identity/v3/projects/d27caa908e584351ba28598c3bdddd23/users/e59a5ef5539d4b6386e9fea1eaedd71a/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:23:20.762632 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d192c9-26de-40df-bbe0-730473b2fa13 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:20.774616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:20.801260 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-40d192c9-26de-40df-bbe0-730473b2fa13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:20.899281 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 912/1791] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:23:20 2022] POST /identity/v3/users => generated 298 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:20.905057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f2f49-b7aa-4ec5-a795-2f2a7edfdb22 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:20.908549 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f2f49-b7aa-4ec5-a795-2f2a7edfdb22 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:20.909015 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f2f49-b7aa-4ec5-a795-2f2a7edfdb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:20.945203 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d192c9-26de-40df-bbe0-730473b2fa13 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:20.957605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a198f6-9ec0-428f-8a4a-5eb2945470e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:20.960288 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a198f6-9ec0-428f-8a4a-5eb2945470e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:20.960693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a198f6-9ec0-428f-8a4a-5eb2945470e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:20.960867 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a198f6-9ec0-428f-8a4a-5eb2945470e0 admin admin] PATH_INFO: `/v3/projects/58f941afef264b53a9f0ff9c68788da2` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:20.965846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a198f6-9ec0-428f-8a4a-5eb2945470e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58f941afef264b53a9f0ff9c68788da2)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:20.971145 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a198f6-9ec0-428f-8a4a-5eb2945470e0 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:20.998647 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-ee3f2f49-b7aa-4ec5-a795-2f2a7edfdb22 None None] MFA Rules not processed for user `e59a5ef5539d4b6386e9fea1eaedd71a`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:21.001362 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ee3f2f49-b7aa-4ec5-a795-2f2a7edfdb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:21.196977 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 913/1792] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:21.196977 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f2f49-b7aa-4ec5-a795-2f2a7edfdb22 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:21.196977 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f2f49-b7aa-4ec5-a795-2f2a7edfdb22 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:21.196977 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134aebc-9a9c-4b23-baee-a292577775cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:21.199568 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134aebc-9a9c-4b23-baee-a292577775cc admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:21.199568 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134aebc-9a9c-4b23-baee-a292577775cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:21.199568 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134aebc-9a9c-4b23-baee-a292577775cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:21.199568 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134aebc-9a9c-4b23-baee-a292577775cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:21.199568 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134aebc-9a9c-4b23-baee-a292577775cc admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:21.199568 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 914/1793] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:21.200717 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134aebc-9a9c-4b23-baee-a292577775cc admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:21.212941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134aebc-9a9c-4b23-baee-a292577775cc admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:21.220516 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017719c-f588-4230-a1af-2d92f6d43ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:21.222490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017719c-f588-4230-a1af-2d92f6d43ecf admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:21.222490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017719c-f588-4230-a1af-2d92f6d43ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:21.222688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017719c-f588-4230-a1af-2d92f6d43ecf admin admin] PATH_INFO: `/v3/projects/1737f931891e4741b19f98893d96709a/users/03410ce370074aa68ab506409f2fb2f9/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:21.245591 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017719c-f588-4230-a1af-2d92f6d43ecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1737f931891e4741b19f98893d96709a, user_id=03410ce370074aa68ab506409f2fb2f9, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:21.248757 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017719c-f588-4230-a1af-2d92f6d43ecf admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:21.470784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 915/1794] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:21 2022] PUT /identity/v3/projects/1737f931891e4741b19f98893d96709a/users/03410ce370074aa68ab506409f2fb2f9/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:21.483282 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017719c-f588-4230-a1af-2d92f6d43ecf admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:21.483282 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-5017719c-f588-4230-a1af-2d92f6d43ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:21.502522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-22a198f6-9ec0-428f-8a4a-5eb2945470e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58f941afef264b53a9f0ff9c68788da2', 'request_id': 'req-22a198f6-9ec0-428f-8a4a-5eb2945470e0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:21.521956 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-22a198f6-9ec0-428f-8a4a-5eb2945470e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58f941afef264b53a9f0ff9c68788da2', 'request_id': 'req-22a198f6-9ec0-428f-8a4a-5eb2945470e0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:21.534606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-22a198f6-9ec0-428f-8a4a-5eb2945470e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58f941afef264b53a9f0ff9c68788da2', 'request_id': 'req-22a198f6-9ec0-428f-8a4a-5eb2945470e0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:21.575795 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017719c-f588-4230-a1af-2d92f6d43ecf admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:21.652519 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f1a83-e77c-414c-9de2-1949aabf28ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:21.652519 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f1a83-e77c-414c-9de2-1949aabf28ca service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:21.653107 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f1a83-e77c-414c-9de2-1949aabf28ca service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:21.653227 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f1a83-e77c-414c-9de2-1949aabf28ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:21.703248 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-22a198f6-9ec0-428f-8a4a-5eb2945470e0 admin admin] The token cache is being invalidate because project 58f941afef264b53a9f0ff9c68788da2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:21.746724 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-22a198f6-9ec0-428f-8a4a-5eb2945470e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:21.746724 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-22a198f6-9ec0-428f-8a4a-5eb2945470e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:21.746724 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 880/1795] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:20 2022] DELETE /identity/v3/projects/58f941afef264b53a9f0ff9c68788da2 => generated 0 bytes in 944 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:21.746724 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a198f6-9ec0-428f-8a4a-5eb2945470e0 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:21.746724 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-22a198f6-9ec0-428f-8a4a-5eb2945470e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:21.754554 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f1a83-e77c-414c-9de2-1949aabf28ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:21.756042 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f1a83-e77c-414c-9de2-1949aabf28ca service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:21.769135 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 916/1796] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:21.769135 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658cf0-de50-4417-a87f-174b5d53e950 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:21.771222 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658cf0-de50-4417-a87f-174b5d53e950 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:21.771549 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658cf0-de50-4417-a87f-174b5d53e950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:21.810255 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-72658cf0-de50-4417-a87f-174b5d53e950 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:21.812166 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-72658cf0-de50-4417-a87f-174b5d53e950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:21.840124 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a198f6-9ec0-428f-8a4a-5eb2945470e0 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:21.847396 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c7bc5-2855-4454-9fbf-1a26d929ff5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:21.848615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c7bc5-2855-4454-9fbf-1a26d929ff5c admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:21.849197 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c7bc5-2855-4454-9fbf-1a26d929ff5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:21.849586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c7bc5-2855-4454-9fbf-1a26d929ff5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:21.850429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c7bc5-2855-4454-9fbf-1a26d929ff5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:21.854221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c7bc5-2855-4454-9fbf-1a26d929ff5c admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:21.873508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 881/1797] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:21.875440 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c7bc5-2855-4454-9fbf-1a26d929ff5c admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:21.878389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-516c7bc5-2855-4454-9fbf-1a26d929ff5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:21.923603 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 917/1798] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:21.923603 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72658cf0-de50-4417-a87f-174b5d53e950 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:21.930590 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c7bc5-2855-4454-9fbf-1a26d929ff5c admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:21.934432 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72658cf0-de50-4417-a87f-174b5d53e950 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:21.941131 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5b708-562e-4419-ae1f-374a52c939dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:21.942439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5b708-562e-4419-ae1f-374a52c939dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:21.942932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5b708-562e-4419-ae1f-374a52c939dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:21.943393 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5b708-562e-4419-ae1f-374a52c939dc admin admin] PATH_INFO: `/v3/users/e59a5ef5539d4b6386e9fea1eaedd71a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:21.944829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5b708-562e-4419-ae1f-374a52c939dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e59a5ef5539d4b6386e9fea1eaedd71a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:21.945957 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319b2f5-8dc6-441d-af22-3316cd079592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:21.946644 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319b2f5-8dc6-441d-af22-3316cd079592 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:21.948161 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319b2f5-8dc6-441d-af22-3316cd079592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:21.948347 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5b708-562e-4419-ae1f-374a52c939dc admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:21.948733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319b2f5-8dc6-441d-af22-3316cd079592 admin admin] PATH_INFO: `/v3/projects/1737f931891e4741b19f98893d96709a/users/03410ce370074aa68ab506409f2fb2f9/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:21.951914 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319b2f5-8dc6-441d-af22-3316cd079592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1737f931891e4741b19f98893d96709a, user_id=03410ce370074aa68ab506409f2fb2f9, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:21.954828 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319b2f5-8dc6-441d-af22-3316cd079592 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:21.978129 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 918/1799] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:21 2022] PUT /identity/v3/projects/1737f931891e4741b19f98893d96709a/users/03410ce370074aa68ab506409f2fb2f9/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:21.979716 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd2cc8-69a3-45a6-a9fe-bd7a85efd9e8 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:21.980004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd2cc8-69a3-45a6-a9fe-bd7a85efd9e8 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:21.980645 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd2cc8-69a3-45a6-a9fe-bd7a85efd9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:22.008033 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-ecbd2cc8-69a3-45a6-a9fe-bd7a85efd9e8 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:22.009134 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ecbd2cc8-69a3-45a6-a9fe-bd7a85efd9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:22.093221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 919/1800] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:22.093221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91f40f-3b8e-4c80-b18e-cecf3ecf712f None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:22.093221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91f40f-3b8e-4c80-b18e-cecf3ecf712f None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:22.093221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91f40f-3b8e-4c80-b18e-cecf3ecf712f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:22.126103 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-7d91f40f-3b8e-4c80-b18e-cecf3ecf712f None None] MFA Rules not processed for user `03410ce370074aa68ab506409f2fb2f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:22.127954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-7d91f40f-3b8e-4c80-b18e-cecf3ecf712f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:22.199607 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 920/1801] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:22.200627 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91f40f-3b8e-4c80-b18e-cecf3ecf712f None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:22.211812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91f40f-3b8e-4c80-b18e-cecf3ecf712f None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:22.216943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c1bf9-2e1c-47b9-8a28-6ed55e2dc120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:22.217564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c1bf9-2e1c-47b9-8a28-6ed55e2dc120 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:22.217879 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c1bf9-2e1c-47b9-8a28-6ed55e2dc120 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:22.218163 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c1bf9-2e1c-47b9-8a28-6ed55e2dc120 admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:22.218827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c1bf9-2e1c-47b9-8a28-6ed55e2dc120 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:23:22.219153 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c1bf9-2e1c-47b9-8a28-6ed55e2dc120 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:22.220808 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c1bf9-2e1c-47b9-8a28-6ed55e2dc120 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:22.234457 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 921/1802] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:23:22.235503 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c1bf9-2e1c-47b9-8a28-6ed55e2dc120 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:22.237475 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f05c1bf9-2e1c-47b9-8a28-6ed55e2dc120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:22.299335 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c1bf9-2e1c-47b9-8a28-6ed55e2dc120 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:22.303326 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677689d-b713-4ec0-a3d2-af0bb96667dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:22.304011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677689d-b713-4ec0-a3d2-af0bb96667dc service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:22.304344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677689d-b713-4ec0-a3d2-af0bb96667dc service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:22.304832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677689d-b713-4ec0-a3d2-af0bb96667dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:22.315711 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677689d-b713-4ec0-a3d2-af0bb96667dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:22.317291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677689d-b713-4ec0-a3d2-af0bb96667dc service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:22.330714 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 922/1803] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:22.332501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677689d-b713-4ec0-a3d2-af0bb96667dc service cinder] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:22.340037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2fb5b708-562e-4419-ae1f-374a52c939dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e59a5ef5539d4b6386e9fea1eaedd71a'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:22.340763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2fb5b708-562e-4419-ae1f-374a52c939dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e59a5ef5539d4b6386e9fea1eaedd71a'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:22.343822 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677689d-b713-4ec0-a3d2-af0bb96667dc service cinder] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:22.349239 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7eb6c-d459-4f84-8719-a2d9c071eae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:22.366601 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2fb5b708-562e-4419-ae1f-374a52c939dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e59a5ef5539d4b6386e9fea1eaedd71a'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:22.367517 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7eb6c-d459-4f84-8719-a2d9c071eae8 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:22.367517 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7eb6c-d459-4f84-8719-a2d9c071eae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:22.367517 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7eb6c-d459-4f84-8719-a2d9c071eae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:22.367517 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7eb6c-d459-4f84-8719-a2d9c071eae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:22.367517 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7eb6c-d459-4f84-8719-a2d9c071eae8 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:22.368168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2fb5b708-562e-4419-ae1f-374a52c939dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e59a5ef5539d4b6386e9fea1eaedd71a'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:22.369500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2fb5b708-562e-4419-ae1f-374a52c939dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e59a5ef5539d4b6386e9fea1eaedd71a'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:22.519693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 882/1804] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:21 2022] DELETE /identity/v3/users/e59a5ef5539d4b6386e9fea1eaedd71a => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:22.519693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5b708-562e-4419-ae1f-374a52c939dc admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:22.519693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-2fb5b708-562e-4419-ae1f-374a52c939dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:22.520152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 923/1805] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:23:22 2022] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:22.520427 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7eb6c-d459-4f84-8719-a2d9c071eae8 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:22.522373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-d3d7eb6c-d459-4f84-8719-a2d9c071eae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:22.599242 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5b708-562e-4419-ae1f-374a52c939dc admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:22.605513 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7eb6c-d459-4f84-8719-a2d9c071eae8 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:22.613047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60076b2a-1471-4498-abd3-9be2c17d87f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:22.614482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60076b2a-1471-4498-abd3-9be2c17d87f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:22.615273 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60076b2a-1471-4498-abd3-9be2c17d87f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:22.615785 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60076b2a-1471-4498-abd3-9be2c17d87f0 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:22.616656 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60076b2a-1471-4498-abd3-9be2c17d87f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:22.618943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60076b2a-1471-4498-abd3-9be2c17d87f0 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:22.655409 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606283d1-e296-4112-b42b-907e0a4adaa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:22.656121 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606283d1-e296-4112-b42b-907e0a4adaa3 service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:22.656405 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606283d1-e296-4112-b42b-907e0a4adaa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:22.656682 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606283d1-e296-4112-b42b-907e0a4adaa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:22.659064 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-606283d1-e296-4112-b42b-907e0a4adaa3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:22.730474 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606283d1-e296-4112-b42b-907e0a4adaa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:22.733845 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606283d1-e296-4112-b42b-907e0a4adaa3 service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:22.744163 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 883/1806] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:22.744638 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ae2b6-fca3-41e8-9f7b-1d2b820d7dad None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:22.745534 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ae2b6-fca3-41e8-9f7b-1d2b820d7dad None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:22.745534 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ae2b6-fca3-41e8-9f7b-1d2b820d7dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:22.778072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 924/1807] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:23:22 2022] POST /identity/v3/users => generated 287 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:22.779693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-0c4ae2b6-fca3-41e8-9f7b-1d2b820d7dad None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:22.781921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60076b2a-1471-4498-abd3-9be2c17d87f0 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:22.783481 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-0c4ae2b6-fca3-41e8-9f7b-1d2b820d7dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:22.798989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60076b2a-1471-4498-abd3-9be2c17d87f0 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:22.807377 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07896cbc-ba85-4ce1-a39e-743453304d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:22.808149 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07896cbc-ba85-4ce1-a39e-743453304d86 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:22.808552 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07896cbc-ba85-4ce1-a39e-743453304d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:22.808812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07896cbc-ba85-4ce1-a39e-743453304d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:22.809898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07896cbc-ba85-4ce1-a39e-743453304d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:22.812556 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07896cbc-ba85-4ce1-a39e-743453304d86 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:22.813068 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 884/1808] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:22.825529 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ae2b6-fca3-41e8-9f7b-1d2b820d7dad None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:22.827437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-0c4ae2b6-fca3-41e8-9f7b-1d2b820d7dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:22.831042 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 925/1809] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:22.840915 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07896cbc-ba85-4ce1-a39e-743453304d86 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:22.854031 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07896cbc-ba85-4ce1-a39e-743453304d86 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:22.862659 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e7e57-c5b9-4917-aa61-2d75d703eb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:22.863908 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e7e57-c5b9-4917-aa61-2d75d703eb0c admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:22.863908 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e7e57-c5b9-4917-aa61-2d75d703eb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:22.864120 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e7e57-c5b9-4917-aa61-2d75d703eb0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:22.864759 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e7e57-c5b9-4917-aa61-2d75d703eb0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:22.866433 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e7e57-c5b9-4917-aa61-2d75d703eb0c admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:22.884748 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 926/1810] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:22.888611 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e7e57-c5b9-4917-aa61-2d75d703eb0c admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:22.904197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e7e57-c5b9-4917-aa61-2d75d703eb0c admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:22.915913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d2b3d-a1c6-46dc-8d2b-72ce29151f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:22.917155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d2b3d-a1c6-46dc-8d2b-72ce29151f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:22.922256 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d2b3d-a1c6-46dc-8d2b-72ce29151f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:22.922855 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d2b3d-a1c6-46dc-8d2b-72ce29151f35 admin admin] PATH_INFO: `/v3/projects/945be97c1d2540eea02f1a4065bb94a5/users/e17b6593ad20491fad65320c3b8636a2/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:22.931528 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ae2b6-fca3-41e8-9f7b-1d2b820d7dad None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:22.937552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cad28f-2ca7-47da-b3f5-0444dc27d856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:22.943817 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d2b3d-a1c6-46dc-8d2b-72ce29151f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=945be97c1d2540eea02f1a4065bb94a5, user_id=e17b6593ad20491fad65320c3b8636a2, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:22.945694 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cad28f-2ca7-47da-b3f5-0444dc27d856 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:22.946017 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cad28f-2ca7-47da-b3f5-0444dc27d856 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:22.954205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cad28f-2ca7-47da-b3f5-0444dc27d856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:22.954587 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d2b3d-a1c6-46dc-8d2b-72ce29151f35 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:22.965101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cad28f-2ca7-47da-b3f5-0444dc27d856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:22.966675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cad28f-2ca7-47da-b3f5-0444dc27d856 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:22.978822 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 885/1811] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:23:23.101069 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 927/1812] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:22 2022] PUT /identity/v3/projects/945be97c1d2540eea02f1a4065bb94a5/users/e17b6593ad20491fad65320c3b8636a2/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:23.118630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9f7d1-144e-4780-a095-ca3d0851c529 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:23.119413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9f7d1-144e-4780-a095-ca3d0851c529 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:23.119694 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9f7d1-144e-4780-a095-ca3d0851c529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:23.152834 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-d8d9f7d1-144e-4780-a095-ca3d0851c529 None None] MFA Rules not processed for user `e17b6593ad20491fad65320c3b8636a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:23.154108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d8d9f7d1-144e-4780-a095-ca3d0851c529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:23.229476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 886/1813] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:23.240699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d2b3d-a1c6-46dc-8d2b-72ce29151f35 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:23.242682 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-979d2b3d-a1c6-46dc-8d2b-72ce29151f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:23.359979 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d2b3d-a1c6-46dc-8d2b-72ce29151f35 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:23.372069 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c45e6b-f27d-4fbc-b75a-eb6d06d64e8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:23.372726 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c45e6b-f27d-4fbc-b75a-eb6d06d64e8b service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:23.373096 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c45e6b-f27d-4fbc-b75a-eb6d06d64e8b service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:23.373362 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c45e6b-f27d-4fbc-b75a-eb6d06d64e8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:23.397140 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c45e6b-f27d-4fbc-b75a-eb6d06d64e8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:23.397140 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c45e6b-f27d-4fbc-b75a-eb6d06d64e8b service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:23.411580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 928/1814] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:23.584647 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9f7d1-144e-4780-a095-ca3d0851c529 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:23.587050 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d8d9f7d1-144e-4780-a095-ca3d0851c529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:23.710061 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c45e6b-f27d-4fbc-b75a-eb6d06d64e8b service nova] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:23.713561 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9f7d1-144e-4780-a095-ca3d0851c529 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:23.718450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773ccbb-d51a-4c66-8485-29c1eb134207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:23.719107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773ccbb-d51a-4c66-8485-29c1eb134207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:23.719418 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773ccbb-d51a-4c66-8485-29c1eb134207 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:23.724402 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773ccbb-d51a-4c66-8485-29c1eb134207 admin admin] PATH_INFO: `/v3/projects/d27caa908e584351ba28598c3bdddd23` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:23.724402 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773ccbb-d51a-4c66-8485-29c1eb134207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d27caa908e584351ba28598c3bdddd23)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:23.724402 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773ccbb-d51a-4c66-8485-29c1eb134207 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:23.724843 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c45e6b-f27d-4fbc-b75a-eb6d06d64e8b service nova] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:23.730690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351525e5-8002-4baf-9e6f-3fa992b17db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:23.731743 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351525e5-8002-4baf-9e6f-3fa992b17db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:23.732043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351525e5-8002-4baf-9e6f-3fa992b17db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:23.732338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351525e5-8002-4baf-9e6f-3fa992b17db0 admin admin] PATH_INFO: `/v3/users/e17b6593ad20491fad65320c3b8636a2` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:23.733765 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351525e5-8002-4baf-9e6f-3fa992b17db0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e17b6593ad20491fad65320c3b8636a2)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:23.735766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351525e5-8002-4baf-9e6f-3fa992b17db0 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:23.939090 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-9773ccbb-d51a-4c66-8485-29c1eb134207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd27caa908e584351ba28598c3bdddd23', 'request_id': 'req-9773ccbb-d51a-4c66-8485-29c1eb134207'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:23.941340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:23.950470 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-9773ccbb-d51a-4c66-8485-29c1eb134207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd27caa908e584351ba28598c3bdddd23', 'request_id': 'req-9773ccbb-d51a-4c66-8485-29c1eb134207'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:23.963756 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-9773ccbb-d51a-4c66-8485-29c1eb134207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd27caa908e584351ba28598c3bdddd23', 'request_id': 'req-9773ccbb-d51a-4c66-8485-29c1eb134207'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:24.160177 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-9773ccbb-d51a-4c66-8485-29c1eb134207 admin admin] The token cache is being invalidate because project d27caa908e584351ba28598c3bdddd23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:24.161043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-9773ccbb-d51a-4c66-8485-29c1eb134207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:24.161429 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-351525e5-8002-4baf-9e6f-3fa992b17db0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e17b6593ad20491fad65320c3b8636a2'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:24.163035 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-351525e5-8002-4baf-9e6f-3fa992b17db0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e17b6593ad20491fad65320c3b8636a2'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:24.164746 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-9773ccbb-d51a-4c66-8485-29c1eb134207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:24.169902 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 887/1815] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:23 2022] DELETE /identity/v3/projects/d27caa908e584351ba28598c3bdddd23 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:24.191922 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923a570-4476-4833-8d91-a8c7a5b3eccc None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:24.192383 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-351525e5-8002-4baf-9e6f-3fa992b17db0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e17b6593ad20491fad65320c3b8636a2'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:24.196605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923a570-4476-4833-8d91-a8c7a5b3eccc None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:24.197618 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923a570-4476-4833-8d91-a8c7a5b3eccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:24.203521 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-351525e5-8002-4baf-9e6f-3fa992b17db0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e17b6593ad20491fad65320c3b8636a2'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:24.205291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-351525e5-8002-4baf-9e6f-3fa992b17db0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e17b6593ad20491fad65320c3b8636a2'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:24.278571 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-e923a570-4476-4833-8d91-a8c7a5b3eccc None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:24.283585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e923a570-4476-4833-8d91-a8c7a5b3eccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:24.332760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 929/1816] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:23 2022] DELETE /identity/v3/users/e17b6593ad20491fad65320c3b8636a2 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:24.338434 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf24b5-d59f-422b-b248-edff3d074126 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:24.338727 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf24b5-d59f-422b-b248-edff3d074126 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:24.339116 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf24b5-d59f-422b-b248-edff3d074126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:24.403092 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-12cf24b5-d59f-422b-b248-edff3d074126 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:24.407724 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-12cf24b5-d59f-422b-b248-edff3d074126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:24.496418 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 888/1817] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:24.499482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cba77-3bf8-4e23-8593-a740810e74c0 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:24.500305 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cba77-3bf8-4e23-8593-a740810e74c0 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:24.501027 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cba77-3bf8-4e23-8593-a740810e74c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:24.530082 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-051cba77-3bf8-4e23-8593-a740810e74c0 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:24.531428 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-051cba77-3bf8-4e23-8593-a740810e74c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:24.552074 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 930/1818] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:24.578160 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf24b5-d59f-422b-b248-edff3d074126 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:24.588184 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-12cf24b5-d59f-422b-b248-edff3d074126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:24.685000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 889/1819] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:23:24.691355 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cba77-3bf8-4e23-8593-a740810e74c0 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:24.706550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cba77-3bf8-4e23-8593-a740810e74c0 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:24.718682 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae4427-6364-4df3-88d8-3199cd0b5052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:24.719631 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae4427-6364-4df3-88d8-3199cd0b5052 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:24.722407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae4427-6364-4df3-88d8-3199cd0b5052 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:24.729652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae4427-6364-4df3-88d8-3199cd0b5052 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:24.729652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae4427-6364-4df3-88d8-3199cd0b5052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:23:24.729652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae4427-6364-4df3-88d8-3199cd0b5052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:24.729652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae4427-6364-4df3-88d8-3199cd0b5052 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:24.767660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 890/1820] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:23:24.770609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae4427-6364-4df3-88d8-3199cd0b5052 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:24.783444 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf24b5-d59f-422b-b248-edff3d074126 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:24.792290 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17622f-44ff-488b-b2a7-89a92fb54f0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:24.798047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae4427-6364-4df3-88d8-3199cd0b5052 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:24.798223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17622f-44ff-488b-b2a7-89a92fb54f0b service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:24.798223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17622f-44ff-488b-b2a7-89a92fb54f0b service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:24.798223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17622f-44ff-488b-b2a7-89a92fb54f0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:24.803897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433f6a9-68db-44ce-9f00-92b52a1e6490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:24.804708 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433f6a9-68db-44ce-9f00-92b52a1e6490 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:24.804981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433f6a9-68db-44ce-9f00-92b52a1e6490 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:24.805288 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433f6a9-68db-44ce-9f00-92b52a1e6490 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:24.806005 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433f6a9-68db-44ce-9f00-92b52a1e6490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:24.808263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433f6a9-68db-44ce-9f00-92b52a1e6490 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:24.811828 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17622f-44ff-488b-b2a7-89a92fb54f0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:24.813987 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17622f-44ff-488b-b2a7-89a92fb54f0b service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:24.830542 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 931/1821] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:24.938491 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 891/1822] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:23:24 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:24.942896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17622f-44ff-488b-b2a7-89a92fb54f0b service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:24.958077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17622f-44ff-488b-b2a7-89a92fb54f0b service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:25.051393 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5390fe0-1cce-4ffd-9cb1-94883ead8599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:25.051981 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5390fe0-1cce-4ffd-9cb1-94883ead8599 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:25.052267 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5390fe0-1cce-4ffd-9cb1-94883ead8599 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:25.052544 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5390fe0-1cce-4ffd-9cb1-94883ead8599 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:25.053435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5390fe0-1cce-4ffd-9cb1-94883ead8599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:25.055407 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5390fe0-1cce-4ffd-9cb1-94883ead8599 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:25.242222 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 932/1823] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:23:24 2022] POST /identity/v3/users => generated 292 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:25.249859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433f6a9-68db-44ce-9f00-92b52a1e6490 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:25.261535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433f6a9-68db-44ce-9f00-92b52a1e6490 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:25.266426 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3eb17-1d5a-4a88-bd03-eda9905d628d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:25.267148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3eb17-1d5a-4a88-bd03-eda9905d628d admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:25.267430 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3eb17-1d5a-4a88-bd03-eda9905d628d admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:25.267708 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3eb17-1d5a-4a88-bd03-eda9905d628d admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:25.268365 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac3eb17-1d5a-4a88-bd03-eda9905d628d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:25.269992 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac3eb17-1d5a-4a88-bd03-eda9905d628d admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:25.281676 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 892/1824] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:25.285669 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5390fe0-1cce-4ffd-9cb1-94883ead8599 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:25.298401 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5390fe0-1cce-4ffd-9cb1-94883ead8599 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:25.305112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a96c70-2488-41e8-a8d8-6b795d4e08d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:25.305112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a96c70-2488-41e8-a8d8-6b795d4e08d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:25.305112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a96c70-2488-41e8-a8d8-6b795d4e08d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:25.306993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a96c70-2488-41e8-a8d8-6b795d4e08d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:25.306993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a96c70-2488-41e8-a8d8-6b795d4e08d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:25.308700 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a96c70-2488-41e8-a8d8-6b795d4e08d3 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:25.323929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 933/1825] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:23:25.328129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3eb17-1d5a-4a88-bd03-eda9905d628d admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:25.339657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3eb17-1d5a-4a88-bd03-eda9905d628d admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:25.345932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d465f-5193-4e74-9579-ffa1bc531592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:25.346752 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d465f-5193-4e74-9579-ffa1bc531592 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:25.355595 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d465f-5193-4e74-9579-ffa1bc531592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:25.355595 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d465f-5193-4e74-9579-ffa1bc531592 admin admin] PATH_INFO: `/v3/projects/a7d3aba8e5d5452b88cbb355462a8f22/users/2a4fc98eabd44786ad9b796860d527d0/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:25.363886 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d465f-5193-4e74-9579-ffa1bc531592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7d3aba8e5d5452b88cbb355462a8f22, user_id=2a4fc98eabd44786ad9b796860d527d0, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:25.366682 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d465f-5193-4e74-9579-ffa1bc531592 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:25.500357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a96c70-2488-41e8-a8d8-6b795d4e08d3 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:25.504451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-d0a96c70-2488-41e8-a8d8-6b795d4e08d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:25.512221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 893/1826] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:25 2022] PUT /identity/v3/projects/a7d3aba8e5d5452b88cbb355462a8f22/users/2a4fc98eabd44786ad9b796860d527d0/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:25.522854 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b795c6-21c7-4bce-b185-a79dcc5e0820 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:25.523422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b795c6-21c7-4bce-b185-a79dcc5e0820 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:25.524030 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b795c6-21c7-4bce-b185-a79dcc5e0820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:25.532455 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a96c70-2488-41e8-a8d8-6b795d4e08d3 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:25.563882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-26b795c6-21c7-4bce-b185-a79dcc5e0820 None None] MFA Rules not processed for user `2a4fc98eabd44786ad9b796860d527d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:25.565464 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-26b795c6-21c7-4bce-b185-a79dcc5e0820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:25.668147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4d292-3835-4b2b-b84f-e2bfc5869164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:25.669053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4d292-3835-4b2b-b84f-e2bfc5869164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:25.669190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4d292-3835-4b2b-b84f-e2bfc5869164 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:25.669790 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4d292-3835-4b2b-b84f-e2bfc5869164 admin admin] PATH_INFO: `/v3/projects/945be97c1d2540eea02f1a4065bb94a5` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:25.672998 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4d292-3835-4b2b-b84f-e2bfc5869164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=945be97c1d2540eea02f1a4065bb94a5)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:25.678530 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 894/1827] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:23:25.681700 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b795c6-21c7-4bce-b185-a79dcc5e0820 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:25.684375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4d292-3835-4b2b-b84f-e2bfc5869164 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:25.708413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b795c6-21c7-4bce-b185-a79dcc5e0820 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:25.721278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011375d2-8fc3-4a3f-a9e7-21a6b1a04d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:25.722436 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011375d2-8fc3-4a3f-a9e7-21a6b1a04d41 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:25.722794 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011375d2-8fc3-4a3f-a9e7-21a6b1a04d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:25.723093 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011375d2-8fc3-4a3f-a9e7-21a6b1a04d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:25.726307 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011375d2-8fc3-4a3f-a9e7-21a6b1a04d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:25.732264 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011375d2-8fc3-4a3f-a9e7-21a6b1a04d41 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:26.023483 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 895/1828] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:23:25 2022] POST /identity/v3/projects => generated 383 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:26.024268 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011375d2-8fc3-4a3f-a9e7-21a6b1a04d41 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:26.034961 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-ebd4d292-3835-4b2b-b84f-e2bfc5869164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '945be97c1d2540eea02f1a4065bb94a5', 'request_id': 'req-ebd4d292-3835-4b2b-b84f-e2bfc5869164'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:26.044431 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-ebd4d292-3835-4b2b-b84f-e2bfc5869164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '945be97c1d2540eea02f1a4065bb94a5', 'request_id': 'req-ebd4d292-3835-4b2b-b84f-e2bfc5869164'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:26.051368 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-ebd4d292-3835-4b2b-b84f-e2bfc5869164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '945be97c1d2540eea02f1a4065bb94a5', 'request_id': 'req-ebd4d292-3835-4b2b-b84f-e2bfc5869164'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:26.138255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011375d2-8fc3-4a3f-a9e7-21a6b1a04d41 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:26.138255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5e5b0-de6c-4605-a12d-d415a6feab57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:26.138255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5e5b0-de6c-4605-a12d-d415a6feab57 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:26.138255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5e5b0-de6c-4605-a12d-d415a6feab57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:26.138562 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5e5b0-de6c-4605-a12d-d415a6feab57 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:26.138651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5e5b0-de6c-4605-a12d-d415a6feab57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:26.140606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5e5b0-de6c-4605-a12d-d415a6feab57 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:26.228814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-ebd4d292-3835-4b2b-b84f-e2bfc5869164 admin admin] The token cache is being invalidate because project 945be97c1d2540eea02f1a4065bb94a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:26.228814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-ebd4d292-3835-4b2b-b84f-e2bfc5869164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:26.228814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-ebd4d292-3835-4b2b-b84f-e2bfc5869164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:26.228814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 934/1829] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:25 2022] DELETE /identity/v3/projects/945be97c1d2540eea02f1a4065bb94a5 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:23:26.238659 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efad06e-174a-4594-b100-bb5a5abb77b6 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:26.239366 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efad06e-174a-4594-b100-bb5a5abb77b6 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:26.239833 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efad06e-174a-4594-b100-bb5a5abb77b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:26.288547 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-2efad06e-174a-4594-b100-bb5a5abb77b6 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:26.289790 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-2efad06e-174a-4594-b100-bb5a5abb77b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:26.319758 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 935/1830] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:26.319960 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 896/1831] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:23:26 2022] POST /identity/v3/users => generated 292 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:23:26.330991 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1917d-e293-433b-9a16-831f26d755a2 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:26.331296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1917d-e293-433b-9a16-831f26d755a2 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:26.331558 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1917d-e293-433b-9a16-831f26d755a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:26.335176 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efad06e-174a-4594-b100-bb5a5abb77b6 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:26.338903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-2efad06e-174a-4594-b100-bb5a5abb77b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:26.383452 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efad06e-174a-4594-b100-bb5a5abb77b6 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:26.393601 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-0df1917d-e293-433b-9a16-831f26d755a2 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:26.394878 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-0df1917d-e293-433b-9a16-831f26d755a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:26.398391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf5e99-7924-49cf-b0c2-8f245132cbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:26.399021 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf5e99-7924-49cf-b0c2-8f245132cbee admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:26.399709 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf5e99-7924-49cf-b0c2-8f245132cbee admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:26.399709 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf5e99-7924-49cf-b0c2-8f245132cbee admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:26.400642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf5e99-7924-49cf-b0c2-8f245132cbee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:26.402977 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf5e99-7924-49cf-b0c2-8f245132cbee admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:26.433013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 897/1832] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:26.435341 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1917d-e293-433b-9a16-831f26d755a2 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:26.453898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 936/1833] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:26.454937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf5e99-7924-49cf-b0c2-8f245132cbee admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:26.475645 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1917d-e293-433b-9a16-831f26d755a2 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:26.493886 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf5e99-7924-49cf-b0c2-8f245132cbee admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:26.498993 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee5ca7-8e7a-489d-b3eb-283674799000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:26.499924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee5ca7-8e7a-489d-b3eb-283674799000 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:26.500365 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee5ca7-8e7a-489d-b3eb-283674799000 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:26.500804 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee5ca7-8e7a-489d-b3eb-283674799000 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:26.501646 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee5ca7-8e7a-489d-b3eb-283674799000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:23:26.503204 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee5ca7-8e7a-489d-b3eb-283674799000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:26.505872 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee5ca7-8e7a-489d-b3eb-283674799000 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:26.515024 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8107dee-9d4c-4322-8920-bce6f143b61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:26.515779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8107dee-9d4c-4322-8920-bce6f143b61d admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:26.515931 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8107dee-9d4c-4322-8920-bce6f143b61d admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:26.516208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8107dee-9d4c-4322-8920-bce6f143b61d admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:26.516862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8107dee-9d4c-4322-8920-bce6f143b61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:26.518659 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8107dee-9d4c-4322-8920-bce6f143b61d admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:26.532056 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 898/1834] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:23:26.538817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee5ca7-8e7a-489d-b3eb-283674799000 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:26.558608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee5ca7-8e7a-489d-b3eb-283674799000 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:26.569466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 937/1835] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:26.571036 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8107dee-9d4c-4322-8920-bce6f143b61d admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:26.573438 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d946d-4d96-4ca2-a724-15d22d5661b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:26.574477 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d946d-4d96-4ca2-a724-15d22d5661b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:26.574913 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d946d-4d96-4ca2-a724-15d22d5661b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:26.577325 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d946d-4d96-4ca2-a724-15d22d5661b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:26.578283 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d946d-4d96-4ca2-a724-15d22d5661b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:26.580424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d946d-4d96-4ca2-a724-15d22d5661b1 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:26.592194 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8107dee-9d4c-4322-8920-bce6f143b61d admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:26.605233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1609d-b911-4192-9547-7fc866a989b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:26.606455 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1609d-b911-4192-9547-7fc866a989b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:26.607311 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1609d-b911-4192-9547-7fc866a989b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:26.607788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1609d-b911-4192-9547-7fc866a989b7 admin admin] PATH_INFO: `/v3/projects/9d4fc05819d4418c957c7c8974db34cf/users/9142b795625d431ca602606ace2c8ff2/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:26.632339 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1609d-b911-4192-9547-7fc866a989b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d4fc05819d4418c957c7c8974db34cf, user_id=9142b795625d431ca602606ace2c8ff2, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:26.636140 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1609d-b911-4192-9547-7fc866a989b7 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:28.155422 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 938/1836] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:26 2022] PUT /identity/v3/projects/9d4fc05819d4418c957c7c8974db34cf/users/9142b795625d431ca602606ace2c8ff2/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 1575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:28.157032 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ac663-7486-4ba8-ad57-37b0a575d220 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:28.158353 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ac663-7486-4ba8-ad57-37b0a575d220 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:28.158663 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ac663-7486-4ba8-ad57-37b0a575d220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:28.162526 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 899/1837] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:23:26 2022] POST /identity/v3/projects => generated 407 bytes in 1626 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:28.169974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d946d-4d96-4ca2-a724-15d22d5661b1 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:28.265447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d946d-4d96-4ca2-a724-15d22d5661b1 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:28.283744 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-2e2ac663-7486-4ba8-ad57-37b0a575d220 None None] MFA Rules not processed for user `9142b795625d431ca602606ace2c8ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:28.286646 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04429053-5fde-44c9-a884-71afb1828cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:28.288125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04429053-5fde-44c9-a884-71afb1828cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:28.288503 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-2e2ac663-7486-4ba8-ad57-37b0a575d220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:28.288902 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04429053-5fde-44c9-a884-71afb1828cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:28.289360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04429053-5fde-44c9-a884-71afb1828cd2 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:28.292124 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04429053-5fde-44c9-a884-71afb1828cd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:28.296797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04429053-5fde-44c9-a884-71afb1828cd2 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:28.439884 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 939/1838] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:28.442097 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ac663-7486-4ba8-ad57-37b0a575d220 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:28.457929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ac663-7486-4ba8-ad57-37b0a575d220 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:28.469462 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d28a7-58d0-4116-af44-6175f0c20bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:28.470335 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d28a7-58d0-4116-af44-6175f0c20bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:28.470872 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d28a7-58d0-4116-af44-6175f0c20bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:28.471385 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d28a7-58d0-4116-af44-6175f0c20bc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:28.472404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d28a7-58d0-4116-af44-6175f0c20bc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:28.475654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d28a7-58d0-4116-af44-6175f0c20bc4 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:28.515337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 900/1839] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:23:28 2022] POST /identity/v3/users => generated 304 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:28.517503 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04429053-5fde-44c9-a884-71afb1828cd2 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:28.635021 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04429053-5fde-44c9-a884-71afb1828cd2 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:28.645639 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c8e6a-cbba-4376-866a-beafae201a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:28.646355 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c8e6a-cbba-4376-866a-beafae201a61 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:28.646643 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c8e6a-cbba-4376-866a-beafae201a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:28.646927 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c8e6a-cbba-4376-866a-beafae201a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:28.648392 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c8e6a-cbba-4376-866a-beafae201a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:28.650199 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c8e6a-cbba-4376-866a-beafae201a61 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:28.669899 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 901/1840] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:28.677014 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c8e6a-cbba-4376-866a-beafae201a61 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:28.688194 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 940/1841] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:23:28 2022] POST /identity/v3/projects => generated 385 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:28.696495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d28a7-58d0-4116-af44-6175f0c20bc4 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:28.711214 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c8e6a-cbba-4376-866a-beafae201a61 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:28.735284 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:28.835306 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d28a7-58d0-4116-af44-6175f0c20bc4 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:28.841456 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646c0cb-d5d1-485b-9029-db39c6135014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:28.843332 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646c0cb-d5d1-485b-9029-db39c6135014 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:28.843726 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646c0cb-d5d1-485b-9029-db39c6135014 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:28.844108 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646c0cb-d5d1-485b-9029-db39c6135014 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:28.844935 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646c0cb-d5d1-485b-9029-db39c6135014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:28.847070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646c0cb-d5d1-485b-9029-db39c6135014 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:28.878337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed5bb3-6426-4dbe-a57f-4f843d54ddb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:28.879033 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed5bb3-6426-4dbe-a57f-4f843d54ddb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:28.879321 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed5bb3-6426-4dbe-a57f-4f843d54ddb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:28.879624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed5bb3-6426-4dbe-a57f-4f843d54ddb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:28.880351 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed5bb3-6426-4dbe-a57f-4f843d54ddb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:28.882293 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed5bb3-6426-4dbe-a57f-4f843d54ddb9 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:28.896823 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 902/1842] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:28.904281 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed5bb3-6426-4dbe-a57f-4f843d54ddb9 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:28.943096 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed5bb3-6426-4dbe-a57f-4f843d54ddb9 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:28.963474 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0eff5-e804-4328-9dce-f15780c7bc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:28.964372 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0eff5-e804-4328-9dce-f15780c7bc01 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:28.964806 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0eff5-e804-4328-9dce-f15780c7bc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:28.968210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0eff5-e804-4328-9dce-f15780c7bc01 admin admin] PATH_INFO: `/v3/projects/bfb3ed97632d4fa086f76d0cfc45f0d7/users/0edc5fee591a4eafa2b9f82ac8ad8c3b/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:29.004740 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0eff5-e804-4328-9dce-f15780c7bc01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb3ed97632d4fa086f76d0cfc45f0d7, user_id=0edc5fee591a4eafa2b9f82ac8ad8c3b, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:29.010159 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0eff5-e804-4328-9dce-f15780c7bc01 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:29.045380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 941/1843] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:23:28 2022] POST /identity/v3/users => generated 299 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:23:29.062339 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646c0cb-d5d1-485b-9029-db39c6135014 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:29.073909 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646c0cb-d5d1-485b-9029-db39c6135014 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:29.083913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7663913-68fd-4319-ac78-1a62b3cd4b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:29.084672 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7663913-68fd-4319-ac78-1a62b3cd4b85 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:29.085172 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7663913-68fd-4319-ac78-1a62b3cd4b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:29.085558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7663913-68fd-4319-ac78-1a62b3cd4b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:29.086681 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7663913-68fd-4319-ac78-1a62b3cd4b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:29.088471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7663913-68fd-4319-ac78-1a62b3cd4b85 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:29.100935 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 942/1844] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:23:29.105970 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7663913-68fd-4319-ac78-1a62b3cd4b85 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:29.120037 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7663913-68fd-4319-ac78-1a62b3cd4b85 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:29.126213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580657b-5875-4bb3-93b5-96e733077b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:29.127076 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580657b-5875-4bb3-93b5-96e733077b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:29.127475 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580657b-5875-4bb3-93b5-96e733077b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:29.127880 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580657b-5875-4bb3-93b5-96e733077b49 admin admin] PATH_INFO: `/v3/projects/16589708a7144f578841698f36e12d8a/users/d0a836d4d814449fa68cc49654cfa3de/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:29.144957 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580657b-5875-4bb3-93b5-96e733077b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16589708a7144f578841698f36e12d8a, user_id=d0a836d4d814449fa68cc49654cfa3de, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:29.147851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580657b-5875-4bb3-93b5-96e733077b49 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:29.199460 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 903/1845] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:28 2022] PUT /identity/v3/projects/bfb3ed97632d4fa086f76d0cfc45f0d7/users/0edc5fee591a4eafa2b9f82ac8ad8c3b/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:29.214621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d2e3b-de12-4921-ba4a-e673b0c248c4 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:29.215171 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d2e3b-de12-4921-ba4a-e673b0c248c4 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:29.215622 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d2e3b-de12-4921-ba4a-e673b0c248c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:29.290167 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-f21d2e3b-de12-4921-ba4a-e673b0c248c4 None None] MFA Rules not processed for user `0edc5fee591a4eafa2b9f82ac8ad8c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:29.291407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f21d2e3b-de12-4921-ba4a-e673b0c248c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:29.302343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 943/1846] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:29 2022] PUT /identity/v3/projects/16589708a7144f578841698f36e12d8a/users/d0a836d4d814449fa68cc49654cfa3de/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:29.307279 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580657b-5875-4bb3-93b5-96e733077b49 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:29.401076 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 904/1847] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:29 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:29.402591 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d2e3b-de12-4921-ba4a-e673b0c248c4 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:29.465732 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580657b-5875-4bb3-93b5-96e733077b49 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:29.472667 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307049a-f003-421c-8218-b825fb272bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:29.473390 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307049a-f003-421c-8218-b825fb272bdf admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:29.473570 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307049a-f003-421c-8218-b825fb272bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:29.474144 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307049a-f003-421c-8218-b825fb272bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:29.475684 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307049a-f003-421c-8218-b825fb272bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:29.478093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307049a-f003-421c-8218-b825fb272bdf admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:29.492185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 944/1848] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:29.508088 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d2e3b-de12-4921-ba4a-e673b0c248c4 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:29.508309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307049a-f003-421c-8218-b825fb272bdf admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:29.517932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c20f82-bcf3-4df4-8074-fd8d93dcc64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:29.518582 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c20f82-bcf3-4df4-8074-fd8d93dcc64f admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:29.518938 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c20f82-bcf3-4df4-8074-fd8d93dcc64f admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:29.519274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c20f82-bcf3-4df4-8074-fd8d93dcc64f admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:29.519935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c20f82-bcf3-4df4-8074-fd8d93dcc64f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:29.522230 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c20f82-bcf3-4df4-8074-fd8d93dcc64f admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:29.522549 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307049a-f003-421c-8218-b825fb272bdf admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:29.536787 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82855b6c-1b52-413b-b260-fe7c819fb652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:29.542119 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82855b6c-1b52-413b-b260-fe7c819fb652 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:29.542676 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82855b6c-1b52-413b-b260-fe7c819fb652 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:29.543181 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82855b6c-1b52-413b-b260-fe7c819fb652 admin admin] PATH_INFO: `/v3/projects/16589708a7144f578841698f36e12d8a/users/d0a836d4d814449fa68cc49654cfa3de/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:29.548415 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82855b6c-1b52-413b-b260-fe7c819fb652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16589708a7144f578841698f36e12d8a, user_id=d0a836d4d814449fa68cc49654cfa3de, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:29.552156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82855b6c-1b52-413b-b260-fe7c819fb652 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:29.584367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 945/1849] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:29 2022] PUT /identity/v3/projects/16589708a7144f578841698f36e12d8a/users/d0a836d4d814449fa68cc49654cfa3de/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:29.588930 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe2eae-3df9-4665-851a-aa8665ab0aaf None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:29.589244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe2eae-3df9-4665-851a-aa8665ab0aaf None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:29.589535 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe2eae-3df9-4665-851a-aa8665ab0aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:29.662435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-9efe2eae-3df9-4665-851a-aa8665ab0aaf None None] MFA Rules not processed for user `d0a836d4d814449fa68cc49654cfa3de`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:29.663859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-9efe2eae-3df9-4665-851a-aa8665ab0aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:29.787304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 905/1850] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:23:29 2022] POST /identity/v3/projects => generated 409 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:29.788996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c20f82-bcf3-4df4-8074-fd8d93dcc64f admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:29.795578 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 946/1851] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:23:29.795757 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-56c20f82-bcf3-4df4-8074-fd8d93dcc64f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:29.795839 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe2eae-3df9-4665-851a-aa8665ab0aaf None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:29.876766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe2eae-3df9-4665-851a-aa8665ab0aaf None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:29.899146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c20f82-bcf3-4df4-8074-fd8d93dcc64f admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:29.917138 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfcf7d-a40f-4f08-8e62-6bec02671f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:29.917781 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfcf7d-a40f-4f08-8e62-6bec02671f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:29.918158 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfcf7d-a40f-4f08-8e62-6bec02671f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:29.918411 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfcf7d-a40f-4f08-8e62-6bec02671f9c admin admin] PATH_INFO: `/v3/users/05a14f6961ca4e398d28d06420494364` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:29.920390 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebfcf7d-a40f-4f08-8e62-6bec02671f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a14f6961ca4e398d28d06420494364)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:29.922554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebfcf7d-a40f-4f08-8e62-6bec02671f9c admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:29.962050 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24927b-6e03-49b3-9c24-0d31e9d9a81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:29.962682 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24927b-6e03-49b3-9c24-0d31e9d9a81e admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:29.962970 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24927b-6e03-49b3-9c24-0d31e9d9a81e admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:29.963250 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24927b-6e03-49b3-9c24-0d31e9d9a81e admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:29.963900 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24927b-6e03-49b3-9c24-0d31e9d9a81e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:29.966495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24927b-6e03-49b3-9c24-0d31e9d9a81e admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:30.101797 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 947/1852] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:23:29 2022] POST /identity/v3/users => generated 311 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:30.104091 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24927b-6e03-49b3-9c24-0d31e9d9a81e admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:30.107886 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-8e24927b-6e03-49b3-9c24-0d31e9d9a81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:30.190871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24927b-6e03-49b3-9c24-0d31e9d9a81e admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:30.197484 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68c4f2-4607-41b8-b754-dc60dfc35147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:30.198353 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68c4f2-4607-41b8-b754-dc60dfc35147 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:30.198726 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68c4f2-4607-41b8-b754-dc60dfc35147 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:30.199405 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68c4f2-4607-41b8-b754-dc60dfc35147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:30.209931 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-8d68c4f2-4607-41b8-b754-dc60dfc35147 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:30.234317 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-aebfcf7d-a40f-4f08-8e62-6bec02671f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a14f6961ca4e398d28d06420494364'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:30.236659 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-aebfcf7d-a40f-4f08-8e62-6bec02671f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a14f6961ca4e398d28d06420494364'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:30.269901 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-aebfcf7d-a40f-4f08-8e62-6bec02671f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a14f6961ca4e398d28d06420494364'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:30.315585 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68c4f2-4607-41b8-b754-dc60dfc35147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:30.316629 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-aebfcf7d-a40f-4f08-8e62-6bec02671f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a14f6961ca4e398d28d06420494364'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:30.318767 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68c4f2-4607-41b8-b754-dc60dfc35147 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:30.319138 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-aebfcf7d-a40f-4f08-8e62-6bec02671f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a14f6961ca4e398d28d06420494364'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:30.346627 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 948/1853] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:30.347770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68c4f2-4607-41b8-b754-dc60dfc35147 service cinder] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:30.368360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68c4f2-4607-41b8-b754-dc60dfc35147 service cinder] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:30.374897 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf4bc4-1b7a-4960-972c-e5395d070f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:30.376053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf4bc4-1b7a-4960-972c-e5395d070f26 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:30.376979 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf4bc4-1b7a-4960-972c-e5395d070f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:30.377587 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf4bc4-1b7a-4960-972c-e5395d070f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:30.378930 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf4bc4-1b7a-4960-972c-e5395d070f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:30.381913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf4bc4-1b7a-4960-972c-e5395d070f26 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:30.395363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 949/1854] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:30.399210 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf4bc4-1b7a-4960-972c-e5395d070f26 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:30.402942 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-2ccf4bc4-1b7a-4960-972c-e5395d070f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:30.421351 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf4bc4-1b7a-4960-972c-e5395d070f26 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:30.432989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa24860-236c-4eb5-81dc-ae6007ce2a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:30.433834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa24860-236c-4eb5-81dc-ae6007ce2a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:30.434243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa24860-236c-4eb5-81dc-ae6007ce2a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:30.434980 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa24860-236c-4eb5-81dc-ae6007ce2a4d admin admin] PATH_INFO: `/v3/projects/1460362c1ca94a79bb9a0f2eb92b7b0f/users/d3fecefda89b42a88af3da52d61770a3/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:30.454788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa24860-236c-4eb5-81dc-ae6007ce2a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1460362c1ca94a79bb9a0f2eb92b7b0f, user_id=d3fecefda89b42a88af3da52d61770a3, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:30.458404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa24860-236c-4eb5-81dc-ae6007ce2a4d admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:30.472784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 906/1855] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:29 2022] DELETE /identity/v3/users/05a14f6961ca4e398d28d06420494364 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:30.491468 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8c437-2552-457b-a638-af42ea7692da None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:30.492043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8c437-2552-457b-a638-af42ea7692da None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:30.492549 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8c437-2552-457b-a638-af42ea7692da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:30.542293 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-e7d8c437-2552-457b-a638-af42ea7692da None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:30.544581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e7d8c437-2552-457b-a638-af42ea7692da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:30.545907 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 950/1856] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:30 2022] PUT /identity/v3/projects/1460362c1ca94a79bb9a0f2eb92b7b0f/users/d3fecefda89b42a88af3da52d61770a3/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:23:30.550989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa24860-236c-4eb5-81dc-ae6007ce2a4d admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:30.563448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:30.786307 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa24860-236c-4eb5-81dc-ae6007ce2a4d admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:30.807004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79219fa0-2d06-4cc0-b5f7-1674ce8c4bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:30.807004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79219fa0-2d06-4cc0-b5f7-1674ce8c4bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:30.807340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79219fa0-2d06-4cc0-b5f7-1674ce8c4bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:30.808856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79219fa0-2d06-4cc0-b5f7-1674ce8c4bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:30.808856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79219fa0-2d06-4cc0-b5f7-1674ce8c4bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:30.811880 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79219fa0-2d06-4cc0-b5f7-1674ce8c4bb6 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:30.839881 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 951/1857] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:30.842603 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79219fa0-2d06-4cc0-b5f7-1674ce8c4bb6 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:30.871332 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 907/1858] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:30.874927 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79219fa0-2d06-4cc0-b5f7-1674ce8c4bb6 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:30.887907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8c437-2552-457b-a638-af42ea7692da None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:30.890436 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e7d8c437-2552-457b-a638-af42ea7692da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:30.892787 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045f277-506a-4548-831a-d443ae152c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:30.893740 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045f277-506a-4548-831a-d443ae152c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:30.894387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045f277-506a-4548-831a-d443ae152c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:30.894943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045f277-506a-4548-831a-d443ae152c8e admin admin] PATH_INFO: `/v3/projects/1460362c1ca94a79bb9a0f2eb92b7b0f/users/d3fecefda89b42a88af3da52d61770a3/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:30.900337 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045f277-506a-4548-831a-d443ae152c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1460362c1ca94a79bb9a0f2eb92b7b0f, user_id=d3fecefda89b42a88af3da52d61770a3, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:30.925977 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045f277-506a-4548-831a-d443ae152c8e admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:30.999116 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 952/1859] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:30 2022] PUT /identity/v3/projects/1460362c1ca94a79bb9a0f2eb92b7b0f/users/d3fecefda89b42a88af3da52d61770a3/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:31.001377 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d928125-c41b-4aeb-a309-df6cebf7a084 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:31.001675 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d928125-c41b-4aeb-a309-df6cebf7a084 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:31.002063 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d928125-c41b-4aeb-a309-df6cebf7a084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:31.057156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8c437-2552-457b-a638-af42ea7692da None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:31.080824 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-2d928125-c41b-4aeb-a309-df6cebf7a084 None None] MFA Rules not processed for user `d3fecefda89b42a88af3da52d61770a3`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:31.086887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-2d928125-c41b-4aeb-a309-df6cebf7a084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:31.202969 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21167d-e907-4ab7-b5de-148a55ee1d4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:31.205233 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21167d-e907-4ab7-b5de-148a55ee1d4e service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:31.208220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21167d-e907-4ab7-b5de-148a55ee1d4e service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:31.208949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21167d-e907-4ab7-b5de-148a55ee1d4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:31.241955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 953/1860] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:30 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:31.310085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:31.338556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21167d-e907-4ab7-b5de-148a55ee1d4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:31.355425 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21167d-e907-4ab7-b5de-148a55ee1d4e service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:31.355425 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 908/1861] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:23:31.456689 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d928125-c41b-4aeb-a309-df6cebf7a084 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:31.458178 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-2d928125-c41b-4aeb-a309-df6cebf7a084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:31.508853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18c2ff-ce12-4ea9-8cd7-7f8dca3d99a7 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:31.516144 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18c2ff-ce12-4ea9-8cd7-7f8dca3d99a7 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:31.516144 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18c2ff-ce12-4ea9-8cd7-7f8dca3d99a7 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:31.516144 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 909/1862] 10.222.0.79 () {54 vars in 921 bytes} [Fri Sep 2 21:23:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 02 21:23:31.583562 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbd4cc-20f0-4ea3-9cf3-d4ea63d4a46d None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:31.583562 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbd4cc-20f0-4ea3-9cf3-d4ea63d4a46d None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:31.583825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d928125-c41b-4aeb-a309-df6cebf7a084 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:31.583916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbd4cc-20f0-4ea3-9cf3-d4ea63d4a46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:31.584015 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7612c85-744f-40af-8f40-a410ce681bcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:31.584015 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7612c85-744f-40af-8f40-a410ce681bcb service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:31.584015 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7612c85-744f-40af-8f40-a410ce681bcb service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:31.584015 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7612c85-744f-40af-8f40-a410ce681bcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:31.590690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7612c85-744f-40af-8f40-a410ce681bcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:31.591507 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-cfdbd4cc-20f0-4ea3-9cf3-d4ea63d4a46d None None] MFA Rules not processed for user `632071470f7d409ab7b0129d120320c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:31.592636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-cfdbd4cc-20f0-4ea3-9cf3-d4ea63d4a46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:31.594059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7612c85-744f-40af-8f40-a410ce681bcb service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:31.610499 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 954/1863] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:31 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:31.750687 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 910/1864] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Sep 2 21:23:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:32.127440 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7612c85-744f-40af-8f40-a410ce681bcb service cinder] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:32.129188 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-d7612c85-744f-40af-8f40-a410ce681bcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:32.188357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7612c85-744f-40af-8f40-a410ce681bcb service cinder] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:32.197296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53317eaf-c07a-4e80-a1fa-1fa4c7873b4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:32.198195 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53317eaf-c07a-4e80-a1fa-1fa4c7873b4e service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:32.198589 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53317eaf-c07a-4e80-a1fa-1fa4c7873b4e service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:32.198971 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53317eaf-c07a-4e80-a1fa-1fa4c7873b4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:32.217497 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53317eaf-c07a-4e80-a1fa-1fa4c7873b4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:32.220027 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53317eaf-c07a-4e80-a1fa-1fa4c7873b4e service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:32.241901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 955/1865] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:32.483703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbd4cc-20f0-4ea3-9cf3-d4ea63d4a46d None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:32.486010 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-cfdbd4cc-20f0-4ea3-9cf3-d4ea63d4a46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:32.501271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbd4cc-20f0-4ea3-9cf3-d4ea63d4a46d None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:32.506420 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa0a42-64ef-424f-809d-e4d9c34c7573 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:32.506420 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa0a42-64ef-424f-809d-e4d9c34c7573 service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:32.506695 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa0a42-64ef-424f-809d-e4d9c34c7573 service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:32.506975 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa0a42-64ef-424f-809d-e4d9c34c7573 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:32.509228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-dcaa0a42-64ef-424f-809d-e4d9c34c7573 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:32.607599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa0a42-64ef-424f-809d-e4d9c34c7573 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:32.609529 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa0a42-64ef-424f-809d-e4d9c34c7573 service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:32.620742 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 911/1866] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:32 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:33.041273 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53317eaf-c07a-4e80-a1fa-1fa4c7873b4e service nova] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:33.044356 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-53317eaf-c07a-4e80-a1fa-1fa4c7873b4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:33.081023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53317eaf-c07a-4e80-a1fa-1fa4c7873b4e service nova] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:33.085979 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0ae49-0863-4f95-83ec-35a3a36484dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:33.087695 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0ae49-0863-4f95-83ec-35a3a36484dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:33.087695 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0ae49-0863-4f95-83ec-35a3a36484dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:33.091706 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0ae49-0863-4f95-83ec-35a3a36484dd admin admin] PATH_INFO: `/v3/projects/15528dcc6cf94fe7a16da96bf551680e` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:33.091706 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0ae49-0863-4f95-83ec-35a3a36484dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=15528dcc6cf94fe7a16da96bf551680e)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:33.102406 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0ae49-0863-4f95-83ec-35a3a36484dd admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:33.363993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9fb0ae49-0863-4f95-83ec-35a3a36484dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15528dcc6cf94fe7a16da96bf551680e', 'request_id': 'req-9fb0ae49-0863-4f95-83ec-35a3a36484dd'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:33.374644 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9fb0ae49-0863-4f95-83ec-35a3a36484dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15528dcc6cf94fe7a16da96bf551680e', 'request_id': 'req-9fb0ae49-0863-4f95-83ec-35a3a36484dd'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:33.385710 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9fb0ae49-0863-4f95-83ec-35a3a36484dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15528dcc6cf94fe7a16da96bf551680e', 'request_id': 'req-9fb0ae49-0863-4f95-83ec-35a3a36484dd'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:33.443554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa0a42-64ef-424f-809d-e4d9c34c7573 service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:33.459925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa0a42-64ef-424f-809d-e4d9c34c7573 service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:33.528881 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9fb0ae49-0863-4f95-83ec-35a3a36484dd admin admin] The token cache is being invalidate because project 15528dcc6cf94fe7a16da96bf551680e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:33.535513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26722de-6d20-4b7d-96f5-377e8434d6c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:33.536015 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9fb0ae49-0863-4f95-83ec-35a3a36484dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:33.536105 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26722de-6d20-4b7d-96f5-377e8434d6c8 service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:33.536105 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26722de-6d20-4b7d-96f5-377e8434d6c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:33.536244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9fb0ae49-0863-4f95-83ec-35a3a36484dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:33.536314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26722de-6d20-4b7d-96f5-377e8434d6c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:33.536314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-c26722de-6d20-4b7d-96f5-377e8434d6c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:33.536432 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 956/1867] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:33 2022] DELETE /identity/v3/projects/15528dcc6cf94fe7a16da96bf551680e => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:33.538863 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0ae49-0863-4f95-83ec-35a3a36484dd admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:33.541520 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-9fb0ae49-0863-4f95-83ec-35a3a36484dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:33.609862 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26722de-6d20-4b7d-96f5-377e8434d6c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:33.611859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26722de-6d20-4b7d-96f5-377e8434d6c8 service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:33.626379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 912/1868] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:33.643158 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0ae49-0863-4f95-83ec-35a3a36484dd admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:33.650366 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f83c5f-d9e9-4655-b3fc-1f927ab3677f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:33.651110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f83c5f-d9e9-4655-b3fc-1f927ab3677f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:33.651399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f83c5f-d9e9-4655-b3fc-1f927ab3677f admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:33.651675 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f83c5f-d9e9-4655-b3fc-1f927ab3677f admin admin] PATH_INFO: `/v3/users/03410ce370074aa68ab506409f2fb2f9` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:33.654661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f83c5f-d9e9-4655-b3fc-1f927ab3677f admin admin] RBAC: Authorizing `identity:delete_user(user_id=03410ce370074aa68ab506409f2fb2f9)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:33.656698 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f83c5f-d9e9-4655-b3fc-1f927ab3677f admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:33.924626 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-83f83c5f-d9e9-4655-b3fc-1f927ab3677f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03410ce370074aa68ab506409f2fb2f9'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:33.925651 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-83f83c5f-d9e9-4655-b3fc-1f927ab3677f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03410ce370074aa68ab506409f2fb2f9'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:33.940978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-83f83c5f-d9e9-4655-b3fc-1f927ab3677f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03410ce370074aa68ab506409f2fb2f9'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:33.948590 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-83f83c5f-d9e9-4655-b3fc-1f927ab3677f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03410ce370074aa68ab506409f2fb2f9'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:33.949426 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-83f83c5f-d9e9-4655-b3fc-1f927ab3677f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03410ce370074aa68ab506409f2fb2f9'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:34.077298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 957/1869] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:33 2022] DELETE /identity/v3/users/03410ce370074aa68ab506409f2fb2f9 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:34.409259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:34.917011 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26722de-6d20-4b7d-96f5-377e8434d6c8 service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:34.927676 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26722de-6d20-4b7d-96f5-377e8434d6c8 service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:35.010471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fff2a-ef10-4a6d-be2e-a9d2e36b1d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:35.011089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fff2a-ef10-4a6d-be2e-a9d2e36b1d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:35.011433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fff2a-ef10-4a6d-be2e-a9d2e36b1d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:35.011782 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fff2a-ef10-4a6d-be2e-a9d2e36b1d51 admin admin] PATH_INFO: `/v3/projects/1737f931891e4741b19f98893d96709a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:35.013081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84fff2a-ef10-4a6d-be2e-a9d2e36b1d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1737f931891e4741b19f98893d96709a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:35.015241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84fff2a-ef10-4a6d-be2e-a9d2e36b1d51 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:35.231774 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e84fff2a-ef10-4a6d-be2e-a9d2e36b1d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1737f931891e4741b19f98893d96709a', 'request_id': 'req-e84fff2a-ef10-4a6d-be2e-a9d2e36b1d51'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:35.240039 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e84fff2a-ef10-4a6d-be2e-a9d2e36b1d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1737f931891e4741b19f98893d96709a', 'request_id': 'req-e84fff2a-ef10-4a6d-be2e-a9d2e36b1d51'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:35.251733 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e84fff2a-ef10-4a6d-be2e-a9d2e36b1d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1737f931891e4741b19f98893d96709a', 'request_id': 'req-e84fff2a-ef10-4a6d-be2e-a9d2e36b1d51'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:35.386114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e84fff2a-ef10-4a6d-be2e-a9d2e36b1d51 admin admin] The token cache is being invalidate because project 1737f931891e4741b19f98893d96709a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:35.386553 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e84fff2a-ef10-4a6d-be2e-a9d2e36b1d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:35.388352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e84fff2a-ef10-4a6d-be2e-a9d2e36b1d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:35.393742 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 913/1870] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:34 2022] DELETE /identity/v3/projects/1737f931891e4741b19f98893d96709a => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:35.397220 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8d57c-87b0-40b9-b7ce-c70639e3d9d8 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:35.397763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8d57c-87b0-40b9-b7ce-c70639e3d9d8 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:35.397881 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8d57c-87b0-40b9-b7ce-c70639e3d9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:35.421893 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-11e8d57c-87b0-40b9-b7ce-c70639e3d9d8 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:35.423481 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-11e8d57c-87b0-40b9-b7ce-c70639e3d9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:35.492382 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 958/1871] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:35.501765 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8901314-4dc9-4127-b3dc-9f35d7fd0089 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:35.502274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8901314-4dc9-4127-b3dc-9f35d7fd0089 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:35.502731 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8901314-4dc9-4127-b3dc-9f35d7fd0089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:35.531839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-b8901314-4dc9-4127-b3dc-9f35d7fd0089 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:35.533995 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-b8901314-4dc9-4127-b3dc-9f35d7fd0089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:35.546035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 914/1872] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:35.550906 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8d57c-87b0-40b9-b7ce-c70639e3d9d8 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:35.563743 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8d57c-87b0-40b9-b7ce-c70639e3d9d8 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:35.569983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da43de-5ab2-429e-bee4-929c202763f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:35.570617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da43de-5ab2-429e-bee4-929c202763f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:35.570906 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da43de-5ab2-429e-bee4-929c202763f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:35.571189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da43de-5ab2-429e-bee4-929c202763f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:35.571863 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da43de-5ab2-429e-bee4-929c202763f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:23:35.572176 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da43de-5ab2-429e-bee4-929c202763f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:35.573844 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da43de-5ab2-429e-bee4-929c202763f9 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:35.587329 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 959/1873] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:23:35.591880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8901314-4dc9-4127-b3dc-9f35d7fd0089 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:35.601123 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8901314-4dc9-4127-b3dc-9f35d7fd0089 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:35.606680 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286f9bc-d36e-4c7d-a6b2-810c37827e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:35.607109 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286f9bc-d36e-4c7d-a6b2-810c37827e93 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:35.607389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286f9bc-d36e-4c7d-a6b2-810c37827e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:35.607668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286f9bc-d36e-4c7d-a6b2-810c37827e93 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:35.608323 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286f9bc-d36e-4c7d-a6b2-810c37827e93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:35.610344 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286f9bc-d36e-4c7d-a6b2-810c37827e93 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:35.805654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 915/1874] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:23:35 2022] POST /identity/v3/projects => generated 381 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:35.810757 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da43de-5ab2-429e-bee4-929c202763f9 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:35.829071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da43de-5ab2-429e-bee4-929c202763f9 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:35.925682 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b080f8-9b55-44dc-81ef-6aea117220f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:35.926375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b080f8-9b55-44dc-81ef-6aea117220f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:35.926662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b080f8-9b55-44dc-81ef-6aea117220f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:35.926962 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b080f8-9b55-44dc-81ef-6aea117220f4 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:35.927580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b080f8-9b55-44dc-81ef-6aea117220f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:35.930544 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b080f8-9b55-44dc-81ef-6aea117220f4 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:36.125746 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 960/1875] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:23:35 2022] POST /identity/v3/users => generated 291 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:36.139724 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286f9bc-d36e-4c7d-a6b2-810c37827e93 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:36.157344 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286f9bc-d36e-4c7d-a6b2-810c37827e93 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:36.164610 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bbcc9-2c88-47df-905a-e1d46b400b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:36.165260 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bbcc9-2c88-47df-905a-e1d46b400b1e admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:36.165557 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bbcc9-2c88-47df-905a-e1d46b400b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:36.165857 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bbcc9-2c88-47df-905a-e1d46b400b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:36.166528 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bbcc9-2c88-47df-905a-e1d46b400b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:36.168152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bbcc9-2c88-47df-905a-e1d46b400b1e admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:36.216063 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 916/1876] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:36.219801 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b080f8-9b55-44dc-81ef-6aea117220f4 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:36.232976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b080f8-9b55-44dc-81ef-6aea117220f4 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:36.238677 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9c57e-136a-4a08-a66f-072d1f7be297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:36.239188 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9c57e-136a-4a08-a66f-072d1f7be297 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:36.239546 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9c57e-136a-4a08-a66f-072d1f7be297 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:36.239830 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9c57e-136a-4a08-a66f-072d1f7be297 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:36.240490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9c57e-136a-4a08-a66f-072d1f7be297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:36.242473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9c57e-136a-4a08-a66f-072d1f7be297 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:36.266767 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 961/1877] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:36.271685 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9c57e-136a-4a08-a66f-072d1f7be297 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:36.272035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bbcc9-2c88-47df-905a-e1d46b400b1e admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:36.278450 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-61f9c57e-136a-4a08-a66f-072d1f7be297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:36.285130 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bbcc9-2c88-47df-905a-e1d46b400b1e admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:36.290382 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96b98c-45ac-4c9e-94e1-84d5599dab6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:36.291326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96b98c-45ac-4c9e-94e1-84d5599dab6a admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:36.291615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96b98c-45ac-4c9e-94e1-84d5599dab6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:36.291897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96b98c-45ac-4c9e-94e1-84d5599dab6a admin admin] PATH_INFO: `/v3/projects/dd42f9d52ec24c83aac2c947e33a3153/users/8d051f0a459b401cbb00c4a77bb327ef/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:36.312121 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96b98c-45ac-4c9e-94e1-84d5599dab6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd42f9d52ec24c83aac2c947e33a3153, user_id=8d051f0a459b401cbb00c4a77bb327ef, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:36.316348 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96b98c-45ac-4c9e-94e1-84d5599dab6a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:36.353235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9c57e-136a-4a08-a66f-072d1f7be297 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:36.358635 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336f96a-18ae-4d68-a62a-7ae4d307b921 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:36.359348 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336f96a-18ae-4d68-a62a-7ae4d307b921 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:36.360575 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336f96a-18ae-4d68-a62a-7ae4d307b921 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:36.360575 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336f96a-18ae-4d68-a62a-7ae4d307b921 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:36.364125 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-6336f96a-18ae-4d68-a62a-7ae4d307b921 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:36.462707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336f96a-18ae-4d68-a62a-7ae4d307b921 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:36.464186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336f96a-18ae-4d68-a62a-7ae4d307b921 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:36.475872 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 962/1878] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:36.478834 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 917/1879] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:36 2022] PUT /identity/v3/projects/dd42f9d52ec24c83aac2c947e33a3153/users/8d051f0a459b401cbb00c4a77bb327ef/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:36.492117 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62043e2-b5b2-49cd-8214-f2ec4b6cb660 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:36.492405 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62043e2-b5b2-49cd-8214-f2ec4b6cb660 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:36.492670 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62043e2-b5b2-49cd-8214-f2ec4b6cb660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:36.528688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-d62043e2-b5b2-49cd-8214-f2ec4b6cb660 None None] MFA Rules not processed for user `8d051f0a459b401cbb00c4a77bb327ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:36.529922 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-d62043e2-b5b2-49cd-8214-f2ec4b6cb660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:36.620035 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 963/1880] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:23:36.626320 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96b98c-45ac-4c9e-94e1-84d5599dab6a admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:36.723490 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96b98c-45ac-4c9e-94e1-84d5599dab6a admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:36.731834 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d94b5a-c3a4-42ca-b38f-718f35b586d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:36.732994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d94b5a-c3a4-42ca-b38f-718f35b586d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:36.733550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d94b5a-c3a4-42ca-b38f-718f35b586d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:36.734168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d94b5a-c3a4-42ca-b38f-718f35b586d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:36.735633 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d94b5a-c3a4-42ca-b38f-718f35b586d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:36.739544 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d94b5a-c3a4-42ca-b38f-718f35b586d9 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:37.009093 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 918/1881] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:23:36 2022] POST /identity/v3/projects => generated 379 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:37.014550 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62043e2-b5b2-49cd-8214-f2ec4b6cb660 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:37.027137 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62043e2-b5b2-49cd-8214-f2ec4b6cb660 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:37.095345 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1adf7-679d-4404-be5f-6d65354d7170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:37.095899 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1adf7-679d-4404-be5f-6d65354d7170 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:37.096177 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1adf7-679d-4404-be5f-6d65354d7170 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:37.096457 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1adf7-679d-4404-be5f-6d65354d7170 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:37.097132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c1adf7-679d-4404-be5f-6d65354d7170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:37.099395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c1adf7-679d-4404-be5f-6d65354d7170 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:37.302744 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 964/1882] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:23:37 2022] POST /identity/v3/users => generated 296 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:37.306895 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d94b5a-c3a4-42ca-b38f-718f35b586d9 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:37.330842 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d94b5a-c3a4-42ca-b38f-718f35b586d9 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:37.336243 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90e7a3-2a3b-448e-98e5-24c3e8860b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:37.337168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90e7a3-2a3b-448e-98e5-24c3e8860b10 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:37.337631 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90e7a3-2a3b-448e-98e5-24c3e8860b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:37.338157 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90e7a3-2a3b-448e-98e5-24c3e8860b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:37.339151 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90e7a3-2a3b-448e-98e5-24c3e8860b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:37.341834 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90e7a3-2a3b-448e-98e5-24c3e8860b10 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:37.369595 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 919/1883] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:37.376917 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1adf7-679d-4404-be5f-6d65354d7170 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:37.392402 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1adf7-679d-4404-be5f-6d65354d7170 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:37.400886 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493470a9-562d-40c3-a1f8-7450c183be1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:37.401929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493470a9-562d-40c3-a1f8-7450c183be1c admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:37.402218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493470a9-562d-40c3-a1f8-7450c183be1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:37.403119 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493470a9-562d-40c3-a1f8-7450c183be1c admin admin] PATH_INFO: `/v3/projects/a8e80aab285a42c5935cff84ef8c1f04/users/a4d1c5b20a52447ca7c078576bc2db18/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:37.423931 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493470a9-562d-40c3-a1f8-7450c183be1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e80aab285a42c5935cff84ef8c1f04, user_id=a4d1c5b20a52447ca7c078576bc2db18, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:37.427262 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493470a9-562d-40c3-a1f8-7450c183be1c admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:37.557680 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 965/1884] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:37 2022] PUT /identity/v3/projects/a8e80aab285a42c5935cff84ef8c1f04/users/a4d1c5b20a52447ca7c078576bc2db18/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:37.559023 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90e7a3-2a3b-448e-98e5-24c3e8860b10 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:37.569414 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90e7a3-2a3b-448e-98e5-24c3e8860b10 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:37.653959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fda99-650b-4917-8be0-cc53d2f916a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:37.654673 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fda99-650b-4917-8be0-cc53d2f916a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:37.662677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fda99-650b-4917-8be0-cc53d2f916a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:37.662677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fda99-650b-4917-8be0-cc53d2f916a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:37.662677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fda99-650b-4917-8be0-cc53d2f916a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:37.662677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fda99-650b-4917-8be0-cc53d2f916a8 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:37.683757 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 920/1885] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:37.685884 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493470a9-562d-40c3-a1f8-7450c183be1c admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:37.721845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493470a9-562d-40c3-a1f8-7450c183be1c admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:37.729138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ac522-3cf2-4aeb-bd9a-91658897ef0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:37.730013 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ac522-3cf2-4aeb-bd9a-91658897ef0e admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:37.730305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ac522-3cf2-4aeb-bd9a-91658897ef0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:37.730732 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ac522-3cf2-4aeb-bd9a-91658897ef0e admin admin] PATH_INFO: `/v3/projects/a8e80aab285a42c5935cff84ef8c1f04/users/a4d1c5b20a52447ca7c078576bc2db18/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:37.742531 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ac522-3cf2-4aeb-bd9a-91658897ef0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e80aab285a42c5935cff84ef8c1f04, user_id=a4d1c5b20a52447ca7c078576bc2db18, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:37.747448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ac522-3cf2-4aeb-bd9a-91658897ef0e admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:37.765606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 966/1886] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:37 2022] PUT /identity/v3/projects/a8e80aab285a42c5935cff84ef8c1f04/users/a4d1c5b20a52447ca7c078576bc2db18/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:37.783722 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b448e7-e701-43f5-a3b7-44e093370488 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:37.784019 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b448e7-e701-43f5-a3b7-44e093370488 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:37.784300 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b448e7-e701-43f5-a3b7-44e093370488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:37.825179 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-32b448e7-e701-43f5-a3b7-44e093370488 None None] MFA Rules not processed for user `a4d1c5b20a52447ca7c078576bc2db18`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:37.826683 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-32b448e7-e701-43f5-a3b7-44e093370488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:37.935628 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 921/1887] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:37 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:23:37.956780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ac522-3cf2-4aeb-bd9a-91658897ef0e admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:38.027327 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ac522-3cf2-4aeb-bd9a-91658897ef0e admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:38.031617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838ecea-09aa-49cc-a608-e5926bcf864c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:38.032263 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838ecea-09aa-49cc-a608-e5926bcf864c service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:38.032545 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838ecea-09aa-49cc-a608-e5926bcf864c service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:38.032821 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838ecea-09aa-49cc-a608-e5926bcf864c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:38.044374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838ecea-09aa-49cc-a608-e5926bcf864c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:38.046177 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838ecea-09aa-49cc-a608-e5926bcf864c service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:38.053030 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:38.057088 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 967/1888] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:23:38.815975 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b448e7-e701-43f5-a3b7-44e093370488 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:38.917533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b448e7-e701-43f5-a3b7-44e093370488 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:38.926335 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77238b-84d0-4cfb-a129-76874472baad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:38.927599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77238b-84d0-4cfb-a129-76874472baad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:38.928638 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77238b-84d0-4cfb-a129-76874472baad admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:38.928831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77238b-84d0-4cfb-a129-76874472baad admin admin] PATH_INFO: `/v3/users/8d051f0a459b401cbb00c4a77bb327ef` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:38.930974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77238b-84d0-4cfb-a129-76874472baad admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d051f0a459b401cbb00c4a77bb327ef)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:38.935334 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77238b-84d0-4cfb-a129-76874472baad admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:39.088359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:39.166221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-bc77238b-84d0-4cfb-a129-76874472baad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d051f0a459b401cbb00c4a77bb327ef'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:39.166890 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-bc77238b-84d0-4cfb-a129-76874472baad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d051f0a459b401cbb00c4a77bb327ef'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:39.175707 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-bc77238b-84d0-4cfb-a129-76874472baad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d051f0a459b401cbb00c4a77bb327ef'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:39.189120 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-bc77238b-84d0-4cfb-a129-76874472baad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d051f0a459b401cbb00c4a77bb327ef'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:39.189789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-bc77238b-84d0-4cfb-a129-76874472baad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d051f0a459b401cbb00c4a77bb327ef'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:39.289201 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 922/1889] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:38 2022] DELETE /identity/v3/users/8d051f0a459b401cbb00c4a77bb327ef => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:39.294653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e4760-3fc4-44ef-8046-52d1f8d805a3 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:39.294880 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e4760-3fc4-44ef-8046-52d1f8d805a3 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:39.295162 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e4760-3fc4-44ef-8046-52d1f8d805a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:39.316205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-bb5e4760-3fc4-44ef-8046-52d1f8d805a3 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:39.317442 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-bb5e4760-3fc4-44ef-8046-52d1f8d805a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:39.382207 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 968/1890] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:23:39.394600 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77238b-84d0-4cfb-a129-76874472baad admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:39.396054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-bc77238b-84d0-4cfb-a129-76874472baad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:39.462758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77238b-84d0-4cfb-a129-76874472baad admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:39.467342 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ed776-fc58-4738-b8fb-bcffbe5504c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:39.467992 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ed776-fc58-4738-b8fb-bcffbe5504c0 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:39.468281 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ed776-fc58-4738-b8fb-bcffbe5504c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:39.468562 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ed776-fc58-4738-b8fb-bcffbe5504c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:39.478911 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ed776-fc58-4738-b8fb-bcffbe5504c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:39.480398 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ed776-fc58-4738-b8fb-bcffbe5504c0 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:39.491752 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 923/1891] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:40.015456 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e4760-3fc4-44ef-8046-52d1f8d805a3 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:40.017147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-bb5e4760-3fc4-44ef-8046-52d1f8d805a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:40.036852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e4760-3fc4-44ef-8046-52d1f8d805a3 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:40.088426 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bec516-8290-4634-bcb9-06fb6606d2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:40.088426 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bec516-8290-4634-bcb9-06fb6606d2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:40.088426 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bec516-8290-4634-bcb9-06fb6606d2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:40.088426 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bec516-8290-4634-bcb9-06fb6606d2c5 admin admin] PATH_INFO: `/v3/projects/dd42f9d52ec24c83aac2c947e33a3153` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:40.091827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bec516-8290-4634-bcb9-06fb6606d2c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd42f9d52ec24c83aac2c947e33a3153)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:40.091827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bec516-8290-4634-bcb9-06fb6606d2c5 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:40.296212 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b2bec516-8290-4634-bcb9-06fb6606d2c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd42f9d52ec24c83aac2c947e33a3153', 'request_id': 'req-b2bec516-8290-4634-bcb9-06fb6606d2c5'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:40.310843 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b2bec516-8290-4634-bcb9-06fb6606d2c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd42f9d52ec24c83aac2c947e33a3153', 'request_id': 'req-b2bec516-8290-4634-bcb9-06fb6606d2c5'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:40.319085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b2bec516-8290-4634-bcb9-06fb6606d2c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd42f9d52ec24c83aac2c947e33a3153', 'request_id': 'req-b2bec516-8290-4634-bcb9-06fb6606d2c5'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:40.478055 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b2bec516-8290-4634-bcb9-06fb6606d2c5 admin admin] The token cache is being invalidate because project dd42f9d52ec24c83aac2c947e33a3153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:40.478507 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b2bec516-8290-4634-bcb9-06fb6606d2c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:40.480017 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b2bec516-8290-4634-bcb9-06fb6606d2c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:40.482253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 969/1892] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:40 2022] DELETE /identity/v3/projects/dd42f9d52ec24c83aac2c947e33a3153 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:40.487110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ed776-fc58-4738-b8fb-bcffbe5504c0 service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:40.516367 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ed776-fc58-4738-b8fb-bcffbe5504c0 service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:40.587658 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a2dc9-f71d-4d93-b072-81a463ca37f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:40.588656 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a2dc9-f71d-4d93-b072-81a463ca37f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:40.589094 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a2dc9-f71d-4d93-b072-81a463ca37f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:40.589530 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a2dc9-f71d-4d93-b072-81a463ca37f7 admin admin] PATH_INFO: `/v3/users/a4d1c5b20a52447ca7c078576bc2db18` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:40.591355 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a2dc9-f71d-4d93-b072-81a463ca37f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4d1c5b20a52447ca7c078576bc2db18)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:40.593358 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a2dc9-f71d-4d93-b072-81a463ca37f7 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:40.955254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-976a2dc9-f71d-4d93-b072-81a463ca37f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4d1c5b20a52447ca7c078576bc2db18'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:40.956014 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-976a2dc9-f71d-4d93-b072-81a463ca37f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4d1c5b20a52447ca7c078576bc2db18'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:40.963505 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-976a2dc9-f71d-4d93-b072-81a463ca37f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4d1c5b20a52447ca7c078576bc2db18'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:40.977012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-976a2dc9-f71d-4d93-b072-81a463ca37f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4d1c5b20a52447ca7c078576bc2db18'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:40.977992 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-976a2dc9-f71d-4d93-b072-81a463ca37f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4d1c5b20a52447ca7c078576bc2db18'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:41.058271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:41.109956 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 924/1893] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:40 2022] DELETE /identity/v3/users/a4d1c5b20a52447ca7c078576bc2db18 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:41.842723 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bec516-8290-4634-bcb9-06fb6606d2c5 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:41.844307 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b2bec516-8290-4634-bcb9-06fb6606d2c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:41.859114 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bec516-8290-4634-bcb9-06fb6606d2c5 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:41.924417 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1a714-4998-4def-a9a5-bae25023066a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:41.925002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1a714-4998-4def-a9a5-bae25023066a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:41.925292 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1a714-4998-4def-a9a5-bae25023066a admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:41.925573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1a714-4998-4def-a9a5-bae25023066a admin admin] PATH_INFO: `/v3/projects/a8e80aab285a42c5935cff84ef8c1f04` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:41.926783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1a714-4998-4def-a9a5-bae25023066a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8e80aab285a42c5935cff84ef8c1f04)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:41.928779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1a714-4998-4def-a9a5-bae25023066a admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:42.076262 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4dc1a714-4998-4def-a9a5-bae25023066a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8e80aab285a42c5935cff84ef8c1f04', 'request_id': 'req-4dc1a714-4998-4def-a9a5-bae25023066a'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:42.082998 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4dc1a714-4998-4def-a9a5-bae25023066a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8e80aab285a42c5935cff84ef8c1f04', 'request_id': 'req-4dc1a714-4998-4def-a9a5-bae25023066a'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:42.089551 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4dc1a714-4998-4def-a9a5-bae25023066a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8e80aab285a42c5935cff84ef8c1f04', 'request_id': 'req-4dc1a714-4998-4def-a9a5-bae25023066a'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:42.197090 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4dc1a714-4998-4def-a9a5-bae25023066a admin admin] The token cache is being invalidate because project a8e80aab285a42c5935cff84ef8c1f04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:42.197742 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4dc1a714-4998-4def-a9a5-bae25023066a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:42.198531 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4dc1a714-4998-4def-a9a5-bae25023066a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:42.207889 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 970/1894] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:41 2022] DELETE /identity/v3/projects/a8e80aab285a42c5935cff84ef8c1f04 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:42.207972 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48f2e6-d48d-45bc-88f5-aba74ee58097 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:42.207972 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48f2e6-d48d-45bc-88f5-aba74ee58097 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:42.207972 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48f2e6-d48d-45bc-88f5-aba74ee58097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:42.232735 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-bf48f2e6-d48d-45bc-88f5-aba74ee58097 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:42.234069 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-bf48f2e6-d48d-45bc-88f5-aba74ee58097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:42.304835 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 925/1895] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:42.314700 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b4e4a-e0f1-4c9f-946a-1bf339d6ac64 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:42.315003 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b4e4a-e0f1-4c9f-946a-1bf339d6ac64 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:42.315155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b4e4a-e0f1-4c9f-946a-1bf339d6ac64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:42.339441 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-e05b4e4a-e0f1-4c9f-946a-1bf339d6ac64 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:42.341089 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-e05b4e4a-e0f1-4c9f-946a-1bf339d6ac64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:42.356294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 971/1896] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:42.358384 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48f2e6-d48d-45bc-88f5-aba74ee58097 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:42.375317 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48f2e6-d48d-45bc-88f5-aba74ee58097 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:42.381799 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd69c0-e701-4a77-af42-73d4fd33b109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:42.382714 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd69c0-e701-4a77-af42-73d4fd33b109 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:42.383094 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd69c0-e701-4a77-af42-73d4fd33b109 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:42.383471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd69c0-e701-4a77-af42-73d4fd33b109 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:42.384536 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd69c0-e701-4a77-af42-73d4fd33b109 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:23:42.385266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd69c0-e701-4a77-af42-73d4fd33b109 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:42.391511 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd69c0-e701-4a77-af42-73d4fd33b109 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:42.411101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 926/1897] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:23:42.412345 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b4e4a-e0f1-4c9f-946a-1bf339d6ac64 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:42.422114 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b4e4a-e0f1-4c9f-946a-1bf339d6ac64 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:42.427557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d30ccd-dd64-44e1-a801-df576f9f530f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:42.428483 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d30ccd-dd64-44e1-a801-df576f9f530f admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:42.428737 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d30ccd-dd64-44e1-a801-df576f9f530f admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:42.429223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d30ccd-dd64-44e1-a801-df576f9f530f admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:42.429904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d30ccd-dd64-44e1-a801-df576f9f530f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:42.432369 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d30ccd-dd64-44e1-a801-df576f9f530f admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:42.438164 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:42.541193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 972/1898] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:23:42 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:42.545746 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd69c0-e701-4a77-af42-73d4fd33b109 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:42.557018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd69c0-e701-4a77-af42-73d4fd33b109 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:42.653293 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758846c-98b8-48af-a900-39d1b3403376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:42.653915 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758846c-98b8-48af-a900-39d1b3403376 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:42.654202 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758846c-98b8-48af-a900-39d1b3403376 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:42.654484 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758846c-98b8-48af-a900-39d1b3403376 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:42.655135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758846c-98b8-48af-a900-39d1b3403376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:42.657140 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758846c-98b8-48af-a900-39d1b3403376 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:42.871954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 927/1899] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:23:42 2022] POST /identity/v3/users => generated 291 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:23:42.876394 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d30ccd-dd64-44e1-a801-df576f9f530f admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:42.887530 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d30ccd-dd64-44e1-a801-df576f9f530f admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:42.892556 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcbc77-d87e-4485-90b9-ef534edecb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:42.893195 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcbc77-d87e-4485-90b9-ef534edecb48 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:42.893479 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcbc77-d87e-4485-90b9-ef534edecb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:42.893767 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcbc77-d87e-4485-90b9-ef534edecb48 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:42.894557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcbc77-d87e-4485-90b9-ef534edecb48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:42.896321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcbc77-d87e-4485-90b9-ef534edecb48 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:42.908221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 973/1900] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:42.912852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758846c-98b8-48af-a900-39d1b3403376 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:42.929087 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758846c-98b8-48af-a900-39d1b3403376 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:42.935166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db9d18-12ce-4e35-9b76-20fefa71fa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:42.935795 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db9d18-12ce-4e35-9b76-20fefa71fa35 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:42.936075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db9d18-12ce-4e35-9b76-20fefa71fa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:42.936387 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db9d18-12ce-4e35-9b76-20fefa71fa35 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:42.937162 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db9d18-12ce-4e35-9b76-20fefa71fa35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:42.938814 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db9d18-12ce-4e35-9b76-20fefa71fa35 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:42.952278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 928/1901] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:42.956211 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcbc77-d87e-4485-90b9-ef534edecb48 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:42.969522 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcbc77-d87e-4485-90b9-ef534edecb48 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:42.978138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808575f6-6e99-4bdf-a71e-6db5947b047c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:42.978920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808575f6-6e99-4bdf-a71e-6db5947b047c admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:42.979244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808575f6-6e99-4bdf-a71e-6db5947b047c admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:42.979535 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808575f6-6e99-4bdf-a71e-6db5947b047c admin admin] PATH_INFO: `/v3/projects/8b5fcb0eef3a4f9cb7b27ed2cdd404b8/users/e27802b624f8464f96a79b87b2de0a8f/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:43.004986 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808575f6-6e99-4bdf-a71e-6db5947b047c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5fcb0eef3a4f9cb7b27ed2cdd404b8, user_id=e27802b624f8464f96a79b87b2de0a8f, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:43.007345 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808575f6-6e99-4bdf-a71e-6db5947b047c admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:43.176118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 974/1902] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:42 2022] PUT /identity/v3/projects/8b5fcb0eef3a4f9cb7b27ed2cdd404b8/users/e27802b624f8464f96a79b87b2de0a8f/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:43.190409 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739aed0-bd10-4089-9652-0274e030002f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:43.190748 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739aed0-bd10-4089-9652-0274e030002f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:43.191074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739aed0-bd10-4089-9652-0274e030002f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:43.230712 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-8739aed0-bd10-4089-9652-0274e030002f None None] MFA Rules not processed for user `e27802b624f8464f96a79b87b2de0a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:43.232119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8739aed0-bd10-4089-9652-0274e030002f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:43.318234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 929/1903] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:43.323354 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808575f6-6e99-4bdf-a71e-6db5947b047c admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:43.408724 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808575f6-6e99-4bdf-a71e-6db5947b047c admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:43.414428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4b458-51a7-4a73-a6c8-6696c0b26108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:43.415051 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4b458-51a7-4a73-a6c8-6696c0b26108 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:43.415339 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4b458-51a7-4a73-a6c8-6696c0b26108 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:43.415617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4b458-51a7-4a73-a6c8-6696c0b26108 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:43.416262 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4b458-51a7-4a73-a6c8-6696c0b26108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:43.418324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4b458-51a7-4a73-a6c8-6696c0b26108 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:43.564690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 975/1904] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:23:43 2022] POST /identity/v3/projects => generated 381 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:43.569046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739aed0-bd10-4089-9652-0274e030002f None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:43.580810 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739aed0-bd10-4089-9652-0274e030002f None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:43.656784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3655fb-d3e8-4dd7-9fb1-87bd0135e069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:43.716188 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3655fb-d3e8-4dd7-9fb1-87bd0135e069 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:43.716188 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3655fb-d3e8-4dd7-9fb1-87bd0135e069 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:43.716188 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3655fb-d3e8-4dd7-9fb1-87bd0135e069 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:43.716188 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3655fb-d3e8-4dd7-9fb1-87bd0135e069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:43.716188 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3655fb-d3e8-4dd7-9fb1-87bd0135e069 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:43.834250 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 930/1905] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:23:43 2022] POST /identity/v3/users => generated 297 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:43.842732 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4b458-51a7-4a73-a6c8-6696c0b26108 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:43.858976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4b458-51a7-4a73-a6c8-6696c0b26108 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:43.866043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3b6b5-ba9d-4730-b199-39b6e6960871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:43.866697 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3b6b5-ba9d-4730-b199-39b6e6960871 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:43.866950 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3b6b5-ba9d-4730-b199-39b6e6960871 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:43.867236 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3b6b5-ba9d-4730-b199-39b6e6960871 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:43.867894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3b6b5-ba9d-4730-b199-39b6e6960871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:43.869542 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3b6b5-ba9d-4730-b199-39b6e6960871 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:43.882988 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 976/1906] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:43.888719 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3655fb-d3e8-4dd7-9fb1-87bd0135e069 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:43.908750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3655fb-d3e8-4dd7-9fb1-87bd0135e069 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:43.917699 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c27de4-4f7b-4dc4-8453-09bcf7ee1127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:43.930222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c27de4-4f7b-4dc4-8453-09bcf7ee1127 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:43.930719 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c27de4-4f7b-4dc4-8453-09bcf7ee1127 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:43.931212 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c27de4-4f7b-4dc4-8453-09bcf7ee1127 admin admin] PATH_INFO: `/v3/projects/26efe2e44514486580b1216cddb75b98/users/cae594104868432a84aece858091e024/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:43.964335 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c27de4-4f7b-4dc4-8453-09bcf7ee1127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26efe2e44514486580b1216cddb75b98, user_id=cae594104868432a84aece858091e024, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:43.968469 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c27de4-4f7b-4dc4-8453-09bcf7ee1127 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:44.188116 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 931/1907] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:43 2022] PUT /identity/v3/projects/26efe2e44514486580b1216cddb75b98/users/cae594104868432a84aece858091e024/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:44.189593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3b6b5-ba9d-4730-b199-39b6e6960871 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:44.212348 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3b6b5-ba9d-4730-b199-39b6e6960871 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:44.342628 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a2d32-e2cb-4441-9aeb-1e644116cd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:44.343772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a2d32-e2cb-4441-9aeb-1e644116cd77 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:44.344233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a2d32-e2cb-4441-9aeb-1e644116cd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:44.344579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a2d32-e2cb-4441-9aeb-1e644116cd77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:44.345450 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a2d32-e2cb-4441-9aeb-1e644116cd77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:44.347193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a2d32-e2cb-4441-9aeb-1e644116cd77 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:44.360943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 977/1908] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:44.379221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c27de4-4f7b-4dc4-8453-09bcf7ee1127 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:44.391263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c27de4-4f7b-4dc4-8453-09bcf7ee1127 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:44.409382 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8c6f1-69b0-48b2-b1eb-5c984fbe3af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:44.413452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8c6f1-69b0-48b2-b1eb-5c984fbe3af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:44.413452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8c6f1-69b0-48b2-b1eb-5c984fbe3af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:44.413452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8c6f1-69b0-48b2-b1eb-5c984fbe3af7 admin admin] PATH_INFO: `/v3/projects/26efe2e44514486580b1216cddb75b98/users/cae594104868432a84aece858091e024/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:44.416976 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8c6f1-69b0-48b2-b1eb-5c984fbe3af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26efe2e44514486580b1216cddb75b98, user_id=cae594104868432a84aece858091e024, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:44.423025 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8c6f1-69b0-48b2-b1eb-5c984fbe3af7 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:44.453493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 932/1909] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:44 2022] PUT /identity/v3/projects/26efe2e44514486580b1216cddb75b98/users/cae594104868432a84aece858091e024/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:44.470898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd639f-64d9-4ecc-a6ec-b44ab4a1d255 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:44.471411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd639f-64d9-4ecc-a6ec-b44ab4a1d255 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:44.471903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd639f-64d9-4ecc-a6ec-b44ab4a1d255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:44.545862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-c7dd639f-64d9-4ecc-a6ec-b44ab4a1d255 None None] MFA Rules not processed for user `cae594104868432a84aece858091e024`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:44.547416 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-c7dd639f-64d9-4ecc-a6ec-b44ab4a1d255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:44.720905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 978/1910] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:44.767048 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8c6f1-69b0-48b2-b1eb-5c984fbe3af7 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:44.768857 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8cf8c6f1-69b0-48b2-b1eb-5c984fbe3af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:44.896408 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8c6f1-69b0-48b2-b1eb-5c984fbe3af7 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:44.900483 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fd52b-6af9-45f5-9207-4dd96cc04488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:44.901377 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fd52b-6af9-45f5-9207-4dd96cc04488 service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:44.901834 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fd52b-6af9-45f5-9207-4dd96cc04488 service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:44.906054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fd52b-6af9-45f5-9207-4dd96cc04488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:44.918230 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fd52b-6af9-45f5-9207-4dd96cc04488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:44.920909 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fd52b-6af9-45f5-9207-4dd96cc04488 service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:44.933067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 933/1911] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:44.940301 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:45.529864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:45.584872 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd639f-64d9-4ecc-a6ec-b44ab4a1d255 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:45.595476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd639f-64d9-4ecc-a6ec-b44ab4a1d255 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:45.599815 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195daf9a-1f74-4da4-9eaf-5809da67f4f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:45.600452 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195daf9a-1f74-4da4-9eaf-5809da67f4f6 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:45.600974 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195daf9a-1f74-4da4-9eaf-5809da67f4f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:45.601321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195daf9a-1f74-4da4-9eaf-5809da67f4f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:45.684285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195daf9a-1f74-4da4-9eaf-5809da67f4f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:45.685757 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195daf9a-1f74-4da4-9eaf-5809da67f4f6 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:45.695630 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 979/1912] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:46.086186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fd52b-6af9-45f5-9207-4dd96cc04488 service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:46.088135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-7c9fd52b-6af9-45f5-9207-4dd96cc04488 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:46.106305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195daf9a-1f74-4da4-9eaf-5809da67f4f6 service cinder] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:46.108214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-195daf9a-1f74-4da4-9eaf-5809da67f4f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:46.210114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fd52b-6af9-45f5-9207-4dd96cc04488 service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:46.216760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5eb6de-a8f7-4acc-a9f2-9d1ca0426ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:46.217538 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5eb6de-a8f7-4acc-a9f2-9d1ca0426ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:46.217888 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5eb6de-a8f7-4acc-a9f2-9d1ca0426ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:46.218211 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5eb6de-a8f7-4acc-a9f2-9d1ca0426ecd admin admin] PATH_INFO: `/v3/users/0edc5fee591a4eafa2b9f82ac8ad8c3b` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:46.219571 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5eb6de-a8f7-4acc-a9f2-9d1ca0426ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0edc5fee591a4eafa2b9f82ac8ad8c3b)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:46.223962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5eb6de-a8f7-4acc-a9f2-9d1ca0426ecd admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:46.227510 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195daf9a-1f74-4da4-9eaf-5809da67f4f6 service cinder] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:46.234186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c16a00-0470-430e-a4f5-a93c431ebf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:46.235031 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c16a00-0470-430e-a4f5-a93c431ebf18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:46.235322 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c16a00-0470-430e-a4f5-a93c431ebf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:46.235614 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c16a00-0470-430e-a4f5-a93c431ebf18 admin admin] PATH_INFO: `/v3/users/2b25c48924524ff5a27be3cf8e736242` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:46.237006 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c16a00-0470-430e-a4f5-a93c431ebf18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b25c48924524ff5a27be3cf8e736242)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:46.239201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c16a00-0470-430e-a4f5-a93c431ebf18 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:46.509946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-6e5eb6de-a8f7-4acc-a9f2-9d1ca0426ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0edc5fee591a4eafa2b9f82ac8ad8c3b'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:46.510934 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-6e5eb6de-a8f7-4acc-a9f2-9d1ca0426ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0edc5fee591a4eafa2b9f82ac8ad8c3b'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:46.522607 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b4c16a00-0470-430e-a4f5-a93c431ebf18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b25c48924524ff5a27be3cf8e736242'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:46.523406 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b4c16a00-0470-430e-a4f5-a93c431ebf18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b25c48924524ff5a27be3cf8e736242'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:46.528690 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-6e5eb6de-a8f7-4acc-a9f2-9d1ca0426ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0edc5fee591a4eafa2b9f82ac8ad8c3b'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:46.540412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b4c16a00-0470-430e-a4f5-a93c431ebf18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b25c48924524ff5a27be3cf8e736242'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:46.546457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-6e5eb6de-a8f7-4acc-a9f2-9d1ca0426ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0edc5fee591a4eafa2b9f82ac8ad8c3b'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:46.547165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-6e5eb6de-a8f7-4acc-a9f2-9d1ca0426ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0edc5fee591a4eafa2b9f82ac8ad8c3b'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:46.550153 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b4c16a00-0470-430e-a4f5-a93c431ebf18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b25c48924524ff5a27be3cf8e736242'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:46.550993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b4c16a00-0470-430e-a4f5-a93c431ebf18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b25c48924524ff5a27be3cf8e736242'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:46.734647 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 934/1913] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:46 2022] DELETE /identity/v3/users/0edc5fee591a4eafa2b9f82ac8ad8c3b => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:46.735950 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5eb6de-a8f7-4acc-a9f2-9d1ca0426ecd admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:46.737400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-6e5eb6de-a8f7-4acc-a9f2-9d1ca0426ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:46.818204 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5eb6de-a8f7-4acc-a9f2-9d1ca0426ecd admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:46.823034 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f7ba9-8456-44c4-9210-2671f0b291bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:46.824316 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f7ba9-8456-44c4-9210-2671f0b291bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:46.824607 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f7ba9-8456-44c4-9210-2671f0b291bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:46.824888 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f7ba9-8456-44c4-9210-2671f0b291bf admin admin] PATH_INFO: `/v3/users/2a4fc98eabd44786ad9b796860d527d0` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:46.826303 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f7ba9-8456-44c4-9210-2671f0b291bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a4fc98eabd44786ad9b796860d527d0)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:46.828301 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f7ba9-8456-44c4-9210-2671f0b291bf admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:47.001910 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 980/1914] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:46 2022] DELETE /identity/v3/users/2b25c48924524ff5a27be3cf8e736242 => generated 0 bytes in 897 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:47.013204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4cc10-f05c-4c47-8a9a-182e9779b0e4 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:47.013204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4cc10-f05c-4c47-8a9a-182e9779b0e4 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:47.013204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4cc10-f05c-4c47-8a9a-182e9779b0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:47.031692 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-bdc4cc10-f05c-4c47-8a9a-182e9779b0e4 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:47.033312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-bdc4cc10-f05c-4c47-8a9a-182e9779b0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:47.098999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 981/1915] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:47.099803 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4cc10-f05c-4c47-8a9a-182e9779b0e4 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:47.101096 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-bdc4cc10-f05c-4c47-8a9a-182e9779b0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:47.115382 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4cc10-f05c-4c47-8a9a-182e9779b0e4 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:47.121775 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1a6fc-5f6b-49a9-af24-d348b833099b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:47.122464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1a6fc-5f6b-49a9-af24-d348b833099b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:47.122866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1a6fc-5f6b-49a9-af24-d348b833099b admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:47.123043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1a6fc-5f6b-49a9-af24-d348b833099b admin admin] PATH_INFO: `/v3/users/e27802b624f8464f96a79b87b2de0a8f` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:47.124269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1a6fc-5f6b-49a9-af24-d348b833099b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e27802b624f8464f96a79b87b2de0a8f)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:47.126385 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1a6fc-5f6b-49a9-af24-d348b833099b admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:47.452254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-c60f7ba9-8456-44c4-9210-2671f0b291bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a4fc98eabd44786ad9b796860d527d0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:47.453231 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-c60f7ba9-8456-44c4-9210-2671f0b291bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a4fc98eabd44786ad9b796860d527d0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:47.462352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-c60f7ba9-8456-44c4-9210-2671f0b291bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a4fc98eabd44786ad9b796860d527d0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:47.478634 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-c60f7ba9-8456-44c4-9210-2671f0b291bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a4fc98eabd44786ad9b796860d527d0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:47.479577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-c60f7ba9-8456-44c4-9210-2671f0b291bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a4fc98eabd44786ad9b796860d527d0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:47.699289 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 935/1916] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:46 2022] DELETE /identity/v3/users/2a4fc98eabd44786ad9b796860d527d0 => generated 0 bytes in 964 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:47.701224 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e728325-aa8e-4c9b-b27e-7338ba9ed41c None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:47.702096 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e728325-aa8e-4c9b-b27e-7338ba9ed41c None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:47.702382 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e728325-aa8e-4c9b-b27e-7338ba9ed41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:47.717487 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-bef1a6fc-5f6b-49a9-af24-d348b833099b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e27802b624f8464f96a79b87b2de0a8f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:47.718292 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-bef1a6fc-5f6b-49a9-af24-d348b833099b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e27802b624f8464f96a79b87b2de0a8f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:47.735665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-8e728325-aa8e-4c9b-b27e-7338ba9ed41c None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:47.737098 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8e728325-aa8e-4c9b-b27e-7338ba9ed41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:47.738335 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-bef1a6fc-5f6b-49a9-af24-d348b833099b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e27802b624f8464f96a79b87b2de0a8f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:47.757129 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-bef1a6fc-5f6b-49a9-af24-d348b833099b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e27802b624f8464f96a79b87b2de0a8f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:47.758240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-bef1a6fc-5f6b-49a9-af24-d348b833099b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e27802b624f8464f96a79b87b2de0a8f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:47.832374 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 936/1917] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:47.833270 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e728325-aa8e-4c9b-b27e-7338ba9ed41c None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:47.835197 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8e728325-aa8e-4c9b-b27e-7338ba9ed41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:47.911198 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e728325-aa8e-4c9b-b27e-7338ba9ed41c None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:47.912402 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 982/1918] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:47 2022] DELETE /identity/v3/users/e27802b624f8464f96a79b87b2de0a8f => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:47.914136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1f343-50b7-42e6-9949-de1f673e1858 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:47.915287 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1f343-50b7-42e6-9949-de1f673e1858 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:47.915763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1f343-50b7-42e6-9949-de1f673e1858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:47.940351 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-45e1f343-50b7-42e6-9949-de1f673e1858 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:47.941667 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-45e1f343-50b7-42e6-9949-de1f673e1858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:47.977144 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ad367-1387-4a8b-b42f-21e7c8677d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:47.978123 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ad367-1387-4a8b-b42f-21e7c8677d50 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:47.978372 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ad367-1387-4a8b-b42f-21e7c8677d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:47.978462 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ad367-1387-4a8b-b42f-21e7c8677d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:47.980711 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-162ad367-1387-4a8b-b42f-21e7c8677d50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:48.086043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 983/1919] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:48.088204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1f343-50b7-42e6-9949-de1f673e1858 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:48.105570 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-45e1f343-50b7-42e6-9949-de1f673e1858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:48.125490 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ad367-1387-4a8b-b42f-21e7c8677d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:48.129545 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ad367-1387-4a8b-b42f-21e7c8677d50 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:48.130146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1f343-50b7-42e6-9949-de1f673e1858 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:48.137404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fc708-2dc2-4376-8a3e-71089c33772c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:48.138683 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fc708-2dc2-4376-8a3e-71089c33772c service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:48.139391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fc708-2dc2-4376-8a3e-71089c33772c service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:48.139856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fc708-2dc2-4376-8a3e-71089c33772c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:48.160844 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 937/1920] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:48.164368 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a45c5-985b-45e1-9929-2eddb8f78ed8 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:48.164368 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a45c5-985b-45e1-9929-2eddb8f78ed8 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:48.164368 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a45c5-985b-45e1-9929-2eddb8f78ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:48.189568 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80fc708-2dc2-4376-8a3e-71089c33772c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:48.189568 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80fc708-2dc2-4376-8a3e-71089c33772c service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:48.210464 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-ce5a45c5-985b-45e1-9929-2eddb8f78ed8 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:48.213455 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ce5a45c5-985b-45e1-9929-2eddb8f78ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:48.219378 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 984/1921] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:48.220343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fc708-2dc2-4376-8a3e-71089c33772c service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:48.239538 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 938/1922] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:48.241482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fc708-2dc2-4376-8a3e-71089c33772c service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:48.248364 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5d4f4-7716-476a-a436-dc5438e4a2ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:48.249395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5d4f4-7716-476a-a436-dc5438e4a2ba service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:48.249641 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5d4f4-7716-476a-a436-dc5438e4a2ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:48.250003 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5d4f4-7716-476a-a436-dc5438e4a2ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:48.263926 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a45c5-985b-45e1-9929-2eddb8f78ed8 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:48.266715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5d4f4-7716-476a-a436-dc5438e4a2ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:48.268987 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5d4f4-7716-476a-a436-dc5438e4a2ba service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:48.287286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a45c5-985b-45e1-9929-2eddb8f78ed8 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:48.288960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 985/1923] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:48.294408 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d0457-bde0-4494-9a3b-570c8d711d11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:48.295841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d0457-bde0-4494-9a3b-570c8d711d11 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:48.296020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d0457-bde0-4494-9a3b-570c8d711d11 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:48.296603 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d0457-bde0-4494-9a3b-570c8d711d11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:48.313351 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d0457-bde0-4494-9a3b-570c8d711d11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:48.315578 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d0457-bde0-4494-9a3b-570c8d711d11 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:48.334631 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 939/1924] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:23:48.963515 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:49.171522 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5d4f4-7716-476a-a436-dc5438e4a2ba service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:49.175722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b6b5d4f4-7716-476a-a436-dc5438e4a2ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:49.217573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5d4f4-7716-476a-a436-dc5438e4a2ba service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:49.247044 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ed6d5-df0f-4024-93aa-cb18dd93500c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:49.248112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ed6d5-df0f-4024-93aa-cb18dd93500c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:49.248715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ed6d5-df0f-4024-93aa-cb18dd93500c admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:49.249196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ed6d5-df0f-4024-93aa-cb18dd93500c admin admin] PATH_INFO: `/v3/projects/07e10374404d4ef7bdfc3331fca3d493` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:49.251541 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ed6d5-df0f-4024-93aa-cb18dd93500c admin admin] RBAC: Authorizing `identity:delete_project(project_id=07e10374404d4ef7bdfc3331fca3d493)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:49.259641 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ed6d5-df0f-4024-93aa-cb18dd93500c admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:49.344440 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d0457-bde0-4494-9a3b-570c8d711d11 service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:49.348743 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-1c7d0457-bde0-4494-9a3b-570c8d711d11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:49.376885 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d0457-bde0-4494-9a3b-570c8d711d11 service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:49.389204 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58124c9d-e8b9-40cf-8954-a17d6bf5e1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:49.390961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58124c9d-e8b9-40cf-8954-a17d6bf5e1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:49.391852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58124c9d-e8b9-40cf-8954-a17d6bf5e1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:49.392648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58124c9d-e8b9-40cf-8954-a17d6bf5e1ad admin admin] PATH_INFO: `/v3/projects/bfb3ed97632d4fa086f76d0cfc45f0d7` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:49.394346 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58124c9d-e8b9-40cf-8954-a17d6bf5e1ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb3ed97632d4fa086f76d0cfc45f0d7)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:49.397314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58124c9d-e8b9-40cf-8954-a17d6bf5e1ad admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:49.483654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-5b8ed6d5-df0f-4024-93aa-cb18dd93500c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07e10374404d4ef7bdfc3331fca3d493', 'request_id': 'req-5b8ed6d5-df0f-4024-93aa-cb18dd93500c'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:49.492730 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-5b8ed6d5-df0f-4024-93aa-cb18dd93500c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07e10374404d4ef7bdfc3331fca3d493', 'request_id': 'req-5b8ed6d5-df0f-4024-93aa-cb18dd93500c'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:49.502007 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-5b8ed6d5-df0f-4024-93aa-cb18dd93500c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07e10374404d4ef7bdfc3331fca3d493', 'request_id': 'req-5b8ed6d5-df0f-4024-93aa-cb18dd93500c'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:49.557524 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-58124c9d-e8b9-40cf-8954-a17d6bf5e1ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb3ed97632d4fa086f76d0cfc45f0d7', 'request_id': 'req-58124c9d-e8b9-40cf-8954-a17d6bf5e1ad'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:49.574954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-58124c9d-e8b9-40cf-8954-a17d6bf5e1ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb3ed97632d4fa086f76d0cfc45f0d7', 'request_id': 'req-58124c9d-e8b9-40cf-8954-a17d6bf5e1ad'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:49.596390 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-58124c9d-e8b9-40cf-8954-a17d6bf5e1ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb3ed97632d4fa086f76d0cfc45f0d7', 'request_id': 'req-58124c9d-e8b9-40cf-8954-a17d6bf5e1ad'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:49.745507 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-5b8ed6d5-df0f-4024-93aa-cb18dd93500c admin admin] The token cache is being invalidate because project 07e10374404d4ef7bdfc3331fca3d493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:49.745837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-5b8ed6d5-df0f-4024-93aa-cb18dd93500c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:49.746536 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-5b8ed6d5-df0f-4024-93aa-cb18dd93500c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:49.748155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 986/1925] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:49 2022] DELETE /identity/v3/projects/07e10374404d4ef7bdfc3331fca3d493 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:49.752300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ed6d5-df0f-4024-93aa-cb18dd93500c admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:49.753792 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-5b8ed6d5-df0f-4024-93aa-cb18dd93500c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:49.852999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ed6d5-df0f-4024-93aa-cb18dd93500c admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:49.872306 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-58124c9d-e8b9-40cf-8954-a17d6bf5e1ad admin admin] The token cache is being invalidate because project bfb3ed97632d4fa086f76d0cfc45f0d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:49.872869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-58124c9d-e8b9-40cf-8954-a17d6bf5e1ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:49.873795 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-58124c9d-e8b9-40cf-8954-a17d6bf5e1ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:49.875650 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 940/1926] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:49 2022] DELETE /identity/v3/projects/bfb3ed97632d4fa086f76d0cfc45f0d7 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:49.876686 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58124c9d-e8b9-40cf-8954-a17d6bf5e1ad admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:49.878197 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-58124c9d-e8b9-40cf-8954-a17d6bf5e1ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:49.931013 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcff6eb-25d8-4703-83d6-fc8bc5b0beda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:49.931763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcff6eb-25d8-4703-83d6-fc8bc5b0beda admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:49.932050 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcff6eb-25d8-4703-83d6-fc8bc5b0beda admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:49.932341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcff6eb-25d8-4703-83d6-fc8bc5b0beda admin admin] PATH_INFO: `/v3/users/18cb32144d664c428692caf8e6cf29b8` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:49.934691 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcff6eb-25d8-4703-83d6-fc8bc5b0beda admin admin] RBAC: Authorizing `identity:delete_user(user_id=18cb32144d664c428692caf8e6cf29b8)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:49.943261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:49.943482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcff6eb-25d8-4703-83d6-fc8bc5b0beda admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:49.958378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58124c9d-e8b9-40cf-8954-a17d6bf5e1ad admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:49.968167 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f102d1-b918-4a13-adfd-372bebfe15b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:49.969297 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f102d1-b918-4a13-adfd-372bebfe15b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:49.969831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f102d1-b918-4a13-adfd-372bebfe15b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:49.970345 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f102d1-b918-4a13-adfd-372bebfe15b4 admin admin] PATH_INFO: `/v3/projects/8b5fcb0eef3a4f9cb7b27ed2cdd404b8` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:49.987996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f102d1-b918-4a13-adfd-372bebfe15b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5fcb0eef3a4f9cb7b27ed2cdd404b8)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:49.987996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f102d1-b918-4a13-adfd-372bebfe15b4 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:50.270960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2fcff6eb-25d8-4703-83d6-fc8bc5b0beda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18cb32144d664c428692caf8e6cf29b8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:50.271823 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2fcff6eb-25d8-4703-83d6-fc8bc5b0beda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18cb32144d664c428692caf8e6cf29b8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:50.286408 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f1f102d1-b918-4a13-adfd-372bebfe15b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5fcb0eef3a4f9cb7b27ed2cdd404b8', 'request_id': 'req-f1f102d1-b918-4a13-adfd-372bebfe15b4'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:50.296522 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2fcff6eb-25d8-4703-83d6-fc8bc5b0beda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18cb32144d664c428692caf8e6cf29b8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:50.298126 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f1f102d1-b918-4a13-adfd-372bebfe15b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5fcb0eef3a4f9cb7b27ed2cdd404b8', 'request_id': 'req-f1f102d1-b918-4a13-adfd-372bebfe15b4'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:50.305627 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2fcff6eb-25d8-4703-83d6-fc8bc5b0beda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18cb32144d664c428692caf8e6cf29b8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:50.306505 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2fcff6eb-25d8-4703-83d6-fc8bc5b0beda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18cb32144d664c428692caf8e6cf29b8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:50.307589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f1f102d1-b918-4a13-adfd-372bebfe15b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5fcb0eef3a4f9cb7b27ed2cdd404b8', 'request_id': 'req-f1f102d1-b918-4a13-adfd-372bebfe15b4'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:50.393898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 987/1927] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:49 2022] DELETE /identity/v3/users/18cb32144d664c428692caf8e6cf29b8 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:23:50.395602 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcff6eb-25d8-4703-83d6-fc8bc5b0beda admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:50.398503 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-2fcff6eb-25d8-4703-83d6-fc8bc5b0beda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:50.463223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f1f102d1-b918-4a13-adfd-372bebfe15b4 admin admin] The token cache is being invalidate because project 8b5fcb0eef3a4f9cb7b27ed2cdd404b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:50.464040 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f1f102d1-b918-4a13-adfd-372bebfe15b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:50.465411 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f1f102d1-b918-4a13-adfd-372bebfe15b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:50.472314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 941/1928] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:49 2022] DELETE /identity/v3/projects/8b5fcb0eef3a4f9cb7b27ed2cdd404b8 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:50.476834 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f102d1-b918-4a13-adfd-372bebfe15b4 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:50.482148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f1f102d1-b918-4a13-adfd-372bebfe15b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:50.533846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcff6eb-25d8-4703-83d6-fc8bc5b0beda admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:50.559060 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1905b5-a011-4d58-af83-d5a6a3ffb8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:50.560772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1905b5-a011-4d58-af83-d5a6a3ffb8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:50.561156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1905b5-a011-4d58-af83-d5a6a3ffb8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:50.561446 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1905b5-a011-4d58-af83-d5a6a3ffb8f9 admin admin] PATH_INFO: `/v3/projects/a7d3aba8e5d5452b88cbb355462a8f22` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:50.562869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1905b5-a011-4d58-af83-d5a6a3ffb8f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7d3aba8e5d5452b88cbb355462a8f22)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:50.565692 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1905b5-a011-4d58-af83-d5a6a3ffb8f9 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:50.638020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f102d1-b918-4a13-adfd-372bebfe15b4 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:50.653118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459514d-3ed4-4720-a5d7-aae72430f473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:50.654700 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459514d-3ed4-4720-a5d7-aae72430f473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:50.655517 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459514d-3ed4-4720-a5d7-aae72430f473 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:50.656055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459514d-3ed4-4720-a5d7-aae72430f473 admin admin] PATH_INFO: `/v3/users/d3fecefda89b42a88af3da52d61770a3` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:50.658115 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459514d-3ed4-4720-a5d7-aae72430f473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3fecefda89b42a88af3da52d61770a3)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:50.660507 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459514d-3ed4-4720-a5d7-aae72430f473 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:50.852088 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-ea1905b5-a011-4d58-af83-d5a6a3ffb8f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7d3aba8e5d5452b88cbb355462a8f22', 'request_id': 'req-ea1905b5-a011-4d58-af83-d5a6a3ffb8f9'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:50.866136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-ea1905b5-a011-4d58-af83-d5a6a3ffb8f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7d3aba8e5d5452b88cbb355462a8f22', 'request_id': 'req-ea1905b5-a011-4d58-af83-d5a6a3ffb8f9'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:50.882221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-ea1905b5-a011-4d58-af83-d5a6a3ffb8f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7d3aba8e5d5452b88cbb355462a8f22', 'request_id': 'req-ea1905b5-a011-4d58-af83-d5a6a3ffb8f9'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:51.090426 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-ea1905b5-a011-4d58-af83-d5a6a3ffb8f9 admin admin] The token cache is being invalidate because project a7d3aba8e5d5452b88cbb355462a8f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:51.090959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-ea1905b5-a011-4d58-af83-d5a6a3ffb8f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:51.092521 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-ea1905b5-a011-4d58-af83-d5a6a3ffb8f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:51.100829 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 988/1929] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:50 2022] DELETE /identity/v3/projects/a7d3aba8e5d5452b88cbb355462a8f22 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:51.102647 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1905b5-a011-4d58-af83-d5a6a3ffb8f9 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:51.105929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ea1905b5-a011-4d58-af83-d5a6a3ffb8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:51.114462 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-5459514d-3ed4-4720-a5d7-aae72430f473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3fecefda89b42a88af3da52d61770a3'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:51.117034 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-5459514d-3ed4-4720-a5d7-aae72430f473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3fecefda89b42a88af3da52d61770a3'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:51.133636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-5459514d-3ed4-4720-a5d7-aae72430f473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3fecefda89b42a88af3da52d61770a3'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:51.159585 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-5459514d-3ed4-4720-a5d7-aae72430f473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3fecefda89b42a88af3da52d61770a3'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:51.160640 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-5459514d-3ed4-4720-a5d7-aae72430f473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3fecefda89b42a88af3da52d61770a3'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:51.252374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1905b5-a011-4d58-af83-d5a6a3ffb8f9 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:51.260687 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad577ff-1b5c-441c-af23-775d21575577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:51.263060 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad577ff-1b5c-441c-af23-775d21575577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:51.263551 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad577ff-1b5c-441c-af23-775d21575577 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:51.264196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad577ff-1b5c-441c-af23-775d21575577 admin admin] PATH_INFO: `/v3/users/cae594104868432a84aece858091e024` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:51.265952 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad577ff-1b5c-441c-af23-775d21575577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cae594104868432a84aece858091e024)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:51.268961 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad577ff-1b5c-441c-af23-775d21575577 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:51.327522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 942/1930] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:50 2022] DELETE /identity/v3/users/d3fecefda89b42a88af3da52d61770a3 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:51.334419 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459514d-3ed4-4720-a5d7-aae72430f473 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:51.339008 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-5459514d-3ed4-4720-a5d7-aae72430f473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:51.500905 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459514d-3ed4-4720-a5d7-aae72430f473 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:51.523726 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55449c2-942b-476b-9a3e-bb9a242b2f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:51.524865 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55449c2-942b-476b-9a3e-bb9a242b2f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:51.525372 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55449c2-942b-476b-9a3e-bb9a242b2f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:51.526397 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55449c2-942b-476b-9a3e-bb9a242b2f87 admin admin] PATH_INFO: `/v3/users/9142b795625d431ca602606ace2c8ff2` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:51.529156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55449c2-942b-476b-9a3e-bb9a242b2f87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9142b795625d431ca602606ace2c8ff2)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:51.533834 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55449c2-942b-476b-9a3e-bb9a242b2f87 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:51.588432 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6ad577ff-1b5c-441c-af23-775d21575577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cae594104868432a84aece858091e024'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:51.590975 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6ad577ff-1b5c-441c-af23-775d21575577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cae594104868432a84aece858091e024'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:51.612220 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6ad577ff-1b5c-441c-af23-775d21575577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cae594104868432a84aece858091e024'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:51.624625 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6ad577ff-1b5c-441c-af23-775d21575577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cae594104868432a84aece858091e024'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:51.626608 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6ad577ff-1b5c-441c-af23-775d21575577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cae594104868432a84aece858091e024'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:51.754323 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:51.766602 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 989/1931] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:51 2022] DELETE /identity/v3/users/cae594104868432a84aece858091e024 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:51.892452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d55449c2-942b-476b-9a3e-bb9a242b2f87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9142b795625d431ca602606ace2c8ff2'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:51.896075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d55449c2-942b-476b-9a3e-bb9a242b2f87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9142b795625d431ca602606ace2c8ff2'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:51.931570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d55449c2-942b-476b-9a3e-bb9a242b2f87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9142b795625d431ca602606ace2c8ff2'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:51.972018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d55449c2-942b-476b-9a3e-bb9a242b2f87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9142b795625d431ca602606ace2c8ff2'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:51.975928 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d55449c2-942b-476b-9a3e-bb9a242b2f87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9142b795625d431ca602606ace2c8ff2'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:52.171272 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 943/1932] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:51 2022] DELETE /identity/v3/users/9142b795625d431ca602606ace2c8ff2 => generated 0 bytes in 837 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:52.224380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad577ff-1b5c-441c-af23-775d21575577 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:52.227150 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-6ad577ff-1b5c-441c-af23-775d21575577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:52.426055 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad577ff-1b5c-441c-af23-775d21575577 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:52.559155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc327a-2c24-4ac0-a2b4-512d054f1414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:52.560179 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc327a-2c24-4ac0-a2b4-512d054f1414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:52.560475 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc327a-2c24-4ac0-a2b4-512d054f1414 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:52.561035 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc327a-2c24-4ac0-a2b4-512d054f1414 admin admin] PATH_INFO: `/v3/projects/1460362c1ca94a79bb9a0f2eb92b7b0f` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:52.562454 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc327a-2c24-4ac0-a2b4-512d054f1414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1460362c1ca94a79bb9a0f2eb92b7b0f)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:52.565061 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc327a-2c24-4ac0-a2b4-512d054f1414 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:52.790906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55449c2-942b-476b-9a3e-bb9a242b2f87 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:52.794091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d55449c2-942b-476b-9a3e-bb9a242b2f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:52.817697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55449c2-942b-476b-9a3e-bb9a242b2f87 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:52.838673 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e3e4a-9d62-4633-a386-5b9cb53ff7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:52.840248 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e3e4a-9d62-4633-a386-5b9cb53ff7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:52.840776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e3e4a-9d62-4633-a386-5b9cb53ff7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:52.841394 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e3e4a-9d62-4633-a386-5b9cb53ff7b1 admin admin] PATH_INFO: `/v3/projects/26efe2e44514486580b1216cddb75b98` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:52.843241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e3e4a-9d62-4633-a386-5b9cb53ff7b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26efe2e44514486580b1216cddb75b98)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:52.847876 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e3e4a-9d62-4633-a386-5b9cb53ff7b1 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:52.927236 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7fcc327a-2c24-4ac0-a2b4-512d054f1414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1460362c1ca94a79bb9a0f2eb92b7b0f', 'request_id': 'req-7fcc327a-2c24-4ac0-a2b4-512d054f1414'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:52.947420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7fcc327a-2c24-4ac0-a2b4-512d054f1414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1460362c1ca94a79bb9a0f2eb92b7b0f', 'request_id': 'req-7fcc327a-2c24-4ac0-a2b4-512d054f1414'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:52.967730 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7fcc327a-2c24-4ac0-a2b4-512d054f1414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1460362c1ca94a79bb9a0f2eb92b7b0f', 'request_id': 'req-7fcc327a-2c24-4ac0-a2b4-512d054f1414'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:53.083818 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-232e3e4a-9d62-4633-a386-5b9cb53ff7b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26efe2e44514486580b1216cddb75b98', 'request_id': 'req-232e3e4a-9d62-4633-a386-5b9cb53ff7b1'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:53.095732 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7fcc327a-2c24-4ac0-a2b4-512d054f1414 admin admin] The token cache is being invalidate because project 1460362c1ca94a79bb9a0f2eb92b7b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:53.096332 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7fcc327a-2c24-4ac0-a2b4-512d054f1414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:53.097154 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7fcc327a-2c24-4ac0-a2b4-512d054f1414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:53.102650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 990/1933] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:52 2022] DELETE /identity/v3/projects/1460362c1ca94a79bb9a0f2eb92b7b0f => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:53.103940 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-232e3e4a-9d62-4633-a386-5b9cb53ff7b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26efe2e44514486580b1216cddb75b98', 'request_id': 'req-232e3e4a-9d62-4633-a386-5b9cb53ff7b1'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:53.104067 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc327a-2c24-4ac0-a2b4-512d054f1414 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:53.107115 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-7fcc327a-2c24-4ac0-a2b4-512d054f1414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:53.116909 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-232e3e4a-9d62-4633-a386-5b9cb53ff7b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26efe2e44514486580b1216cddb75b98', 'request_id': 'req-232e3e4a-9d62-4633-a386-5b9cb53ff7b1'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:53.220082 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc327a-2c24-4ac0-a2b4-512d054f1414 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:53.283220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-232e3e4a-9d62-4633-a386-5b9cb53ff7b1 admin admin] The token cache is being invalidate because project 26efe2e44514486580b1216cddb75b98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:53.283847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-232e3e4a-9d62-4633-a386-5b9cb53ff7b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:53.285608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-232e3e4a-9d62-4633-a386-5b9cb53ff7b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:53.289835 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 944/1934] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:52 2022] DELETE /identity/v3/projects/26efe2e44514486580b1216cddb75b98 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:23:53.291449 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c2143-753f-4177-9dd6-779e111917dc None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:53.293609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c2143-753f-4177-9dd6-779e111917dc None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:53.294894 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c2143-753f-4177-9dd6-779e111917dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:53.326644 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-fe3c2143-753f-4177-9dd6-779e111917dc None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:53.328883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-fe3c2143-753f-4177-9dd6-779e111917dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:53.334430 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4238c-7f3d-46c4-85ad-04503baec020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:53.335563 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4238c-7f3d-46c4-85ad-04503baec020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:53.336079 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4238c-7f3d-46c4-85ad-04503baec020 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:53.336584 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4238c-7f3d-46c4-85ad-04503baec020 admin admin] PATH_INFO: `/v3/projects/af20c8267a0640f88d19f4f413010ba1` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:53.338679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4238c-7f3d-46c4-85ad-04503baec020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af20c8267a0640f88d19f4f413010ba1)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:53.343497 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4238c-7f3d-46c4-85ad-04503baec020 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:53.344339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 945/1935] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:53.345540 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c2143-753f-4177-9dd6-779e111917dc None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:53.347376 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-fe3c2143-753f-4177-9dd6-779e111917dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:53.370195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c2143-753f-4177-9dd6-779e111917dc None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:53.385135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef707c1-7b74-4353-a421-306c7fc897a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:53.385135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef707c1-7b74-4353-a421-306c7fc897a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:53.385135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef707c1-7b74-4353-a421-306c7fc897a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:53.385135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef707c1-7b74-4353-a421-306c7fc897a1 admin admin] PATH_INFO: `/v3/projects/9d4fc05819d4418c957c7c8974db34cf` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:53.385505 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef707c1-7b74-4353-a421-306c7fc897a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d4fc05819d4418c957c7c8974db34cf)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:53.385505 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef707c1-7b74-4353-a421-306c7fc897a1 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:53.547695 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-71d4238c-7f3d-46c4-85ad-04503baec020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af20c8267a0640f88d19f4f413010ba1', 'request_id': 'req-71d4238c-7f3d-46c4-85ad-04503baec020'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:53.554432 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-71d4238c-7f3d-46c4-85ad-04503baec020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af20c8267a0640f88d19f4f413010ba1', 'request_id': 'req-71d4238c-7f3d-46c4-85ad-04503baec020'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:53.560968 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-71d4238c-7f3d-46c4-85ad-04503baec020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af20c8267a0640f88d19f4f413010ba1', 'request_id': 'req-71d4238c-7f3d-46c4-85ad-04503baec020'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:53.605760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-eef707c1-7b74-4353-a421-306c7fc897a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d4fc05819d4418c957c7c8974db34cf', 'request_id': 'req-eef707c1-7b74-4353-a421-306c7fc897a1'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:53.617907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-eef707c1-7b74-4353-a421-306c7fc897a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d4fc05819d4418c957c7c8974db34cf', 'request_id': 'req-eef707c1-7b74-4353-a421-306c7fc897a1'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:53.628603 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-eef707c1-7b74-4353-a421-306c7fc897a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d4fc05819d4418c957c7c8974db34cf', 'request_id': 'req-eef707c1-7b74-4353-a421-306c7fc897a1'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:53.922793 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:53.937165 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-71d4238c-7f3d-46c4-85ad-04503baec020 admin admin] The token cache is being invalidate because project af20c8267a0640f88d19f4f413010ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:53.939523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-71d4238c-7f3d-46c4-85ad-04503baec020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:53.940852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-71d4238c-7f3d-46c4-85ad-04503baec020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:53.945302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 991/1936] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:53 2022] DELETE /identity/v3/projects/af20c8267a0640f88d19f4f413010ba1 => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:53.947800 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd665707-ab03-49de-9e12-ba8d4ef2b8b5 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:53.948860 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd665707-ab03-49de-9e12-ba8d4ef2b8b5 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:53.950146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd665707-ab03-49de-9e12-ba8d4ef2b8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:53.973992 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-cd665707-ab03-49de-9e12-ba8d4ef2b8b5 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:53.975351 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-cd665707-ab03-49de-9e12-ba8d4ef2b8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:54.069132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 992/1937] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:54.070995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1e090-b582-4f6d-9f97-b0e18bd8b659 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:54.071351 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1e090-b582-4f6d-9f97-b0e18bd8b659 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:54.072775 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1e090-b582-4f6d-9f97-b0e18bd8b659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:54.105137 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-86f1e090-b582-4f6d-9f97-b0e18bd8b659 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:54.107673 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-86f1e090-b582-4f6d-9f97-b0e18bd8b659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:54.127794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 993/1938] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:54.131018 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe0894-fd1d-4a9f-bff1-fd9896aaa90e None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:54.131018 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe0894-fd1d-4a9f-bff1-fd9896aaa90e None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:54.131018 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe0894-fd1d-4a9f-bff1-fd9896aaa90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:54.154495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-0efe0894-fd1d-4a9f-bff1-fd9896aaa90e None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:54.156004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-0efe0894-fd1d-4a9f-bff1-fd9896aaa90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:54.164611 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 994/1939] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:54.166204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c385d57-ead1-458f-8185-47d2ed189df8 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:54.166496 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c385d57-ead1-458f-8185-47d2ed189df8 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:54.166811 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c385d57-ead1-458f-8185-47d2ed189df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:54.198697 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-5c385d57-ead1-458f-8185-47d2ed189df8 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:54.201659 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-5c385d57-ead1-458f-8185-47d2ed189df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:54.222335 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 995/1940] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:54.223514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c385d57-ead1-458f-8185-47d2ed189df8 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:54.236600 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c385d57-ead1-458f-8185-47d2ed189df8 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:54.241547 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d23a68-55f8-49c7-a51e-878419bac91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:54.242199 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d23a68-55f8-49c7-a51e-878419bac91a admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:54.242485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d23a68-55f8-49c7-a51e-878419bac91a admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:54.242763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d23a68-55f8-49c7-a51e-878419bac91a admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:54.243416 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d23a68-55f8-49c7-a51e-878419bac91a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:23:54.243718 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d23a68-55f8-49c7-a51e-878419bac91a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:54.246070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d23a68-55f8-49c7-a51e-878419bac91a admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:54.260813 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 996/1941] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:23:54.262324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084ea41-6834-4ab0-b6e4-e01edeacc54d None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:54.262616 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084ea41-6834-4ab0-b6e4-e01edeacc54d None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:54.262896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084ea41-6834-4ab0-b6e4-e01edeacc54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:54.283797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-eef707c1-7b74-4353-a421-306c7fc897a1 admin admin] The token cache is being invalidate because project 9d4fc05819d4418c957c7c8974db34cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:54.287430 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-eef707c1-7b74-4353-a421-306c7fc897a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:54.287430 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-eef707c1-7b74-4353-a421-306c7fc897a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:54.287748 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-5084ea41-6834-4ab0-b6e4-e01edeacc54d None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:54.288820 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 946/1942] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:53 2022] DELETE /identity/v3/projects/9d4fc05819d4418c957c7c8974db34cf => generated 0 bytes in 944 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:54.289979 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef707c1-7b74-4353-a421-306c7fc897a1 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:54.293277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-eef707c1-7b74-4353-a421-306c7fc897a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:54.293537 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-5084ea41-6834-4ab0-b6e4-e01edeacc54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:54.306367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 997/1943] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:54.308933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084ea41-6834-4ab0-b6e4-e01edeacc54d None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:54.311093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-5084ea41-6834-4ab0-b6e4-e01edeacc54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:54.312739 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef707c1-7b74-4353-a421-306c7fc897a1 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:54.318401 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504f0c1-4704-4df9-8788-cf28eb995c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:54.319310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504f0c1-4704-4df9-8788-cf28eb995c05 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:54.319771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504f0c1-4704-4df9-8788-cf28eb995c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:54.320333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504f0c1-4704-4df9-8788-cf28eb995c05 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:54.321182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504f0c1-4704-4df9-8788-cf28eb995c05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:23:54.321671 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504f0c1-4704-4df9-8788-cf28eb995c05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:54.323797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504f0c1-4704-4df9-8788-cf28eb995c05 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:54.330164 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084ea41-6834-4ab0-b6e4-e01edeacc54d None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:54.338568 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399c202-76c7-4eb6-b814-15377ef2da1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:54.339954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399c202-76c7-4eb6-b814-15377ef2da1e admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:54.340320 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399c202-76c7-4eb6-b814-15377ef2da1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:54.340611 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399c202-76c7-4eb6-b814-15377ef2da1e admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:54.341432 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399c202-76c7-4eb6-b814-15377ef2da1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:54.342923 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 947/1944] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:23:54.344580 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504f0c1-4704-4df9-8788-cf28eb995c05 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:54.345425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399c202-76c7-4eb6-b814-15377ef2da1e admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:54.349010 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-1504f0c1-4704-4df9-8788-cf28eb995c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:54.369758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504f0c1-4704-4df9-8788-cf28eb995c05 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:54.376167 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1c6a3-669f-489e-9e0b-3c3db8847c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:54.376984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1c6a3-669f-489e-9e0b-3c3db8847c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:54.381705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1c6a3-669f-489e-9e0b-3c3db8847c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:54.381705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1c6a3-669f-489e-9e0b-3c3db8847c1d admin admin] PATH_INFO: `/v3/users/d0a836d4d814449fa68cc49654cfa3de` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:54.381705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1c6a3-669f-489e-9e0b-3c3db8847c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0a836d4d814449fa68cc49654cfa3de)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:54.381705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1c6a3-669f-489e-9e0b-3c3db8847c1d admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:54.518755 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 998/1945] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:23:54 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:54.520089 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399c202-76c7-4eb6-b814-15377ef2da1e admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:54.590181 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:54.608094 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399c202-76c7-4eb6-b814-15377ef2da1e admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:54.613398 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289736f-660a-49b9-9398-bd9407be82a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:54.614133 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289736f-660a-49b9-9398-bd9407be82a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:54.614415 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289736f-660a-49b9-9398-bd9407be82a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:54.614695 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289736f-660a-49b9-9398-bd9407be82a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:54.615362 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289736f-660a-49b9-9398-bd9407be82a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:23:54.615674 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289736f-660a-49b9-9398-bd9407be82a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:54.617597 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289736f-660a-49b9-9398-bd9407be82a2 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:54.634093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 999/1946] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:23:54.634928 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289736f-660a-49b9-9398-bd9407be82a2 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:54.649045 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289736f-660a-49b9-9398-bd9407be82a2 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:54.654820 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0403e06-e61d-431f-9da2-60df96cb993d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:54.655444 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0403e06-e61d-431f-9da2-60df96cb993d admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:54.655729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0403e06-e61d-431f-9da2-60df96cb993d admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:54.656061 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0403e06-e61d-431f-9da2-60df96cb993d admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:54.656800 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0403e06-e61d-431f-9da2-60df96cb993d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:54.659163 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0403e06-e61d-431f-9da2-60df96cb993d admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:54.738469 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2be1c6a3-669f-489e-9e0b-3c3db8847c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0a836d4d814449fa68cc49654cfa3de'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:54.738469 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2be1c6a3-669f-489e-9e0b-3c3db8847c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0a836d4d814449fa68cc49654cfa3de'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:54.745104 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2be1c6a3-669f-489e-9e0b-3c3db8847c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0a836d4d814449fa68cc49654cfa3de'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:54.757714 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2be1c6a3-669f-489e-9e0b-3c3db8847c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0a836d4d814449fa68cc49654cfa3de'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:54.758516 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2be1c6a3-669f-489e-9e0b-3c3db8847c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0a836d4d814449fa68cc49654cfa3de'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:54.907532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1000/1947] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:23:54 2022] POST /identity/v3/projects => generated 373 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:54.908856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0403e06-e61d-431f-9da2-60df96cb993d admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:54.915664 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-c0403e06-e61d-431f-9da2-60df96cb993d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:54.936221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 948/1948] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:54 2022] DELETE /identity/v3/users/d0a836d4d814449fa68cc49654cfa3de => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:54.937932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1c6a3-669f-489e-9e0b-3c3db8847c1d admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:54.939960 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-2be1c6a3-669f-489e-9e0b-3c3db8847c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:55.020389 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0403e06-e61d-431f-9da2-60df96cb993d admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:55.047805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1c6a3-669f-489e-9e0b-3c3db8847c1d admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:55.054520 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044193dd-d223-4b3a-8a33-fa08f807e457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:55.055798 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044193dd-d223-4b3a-8a33-fa08f807e457 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:55.056360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044193dd-d223-4b3a-8a33-fa08f807e457 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:55.056996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044193dd-d223-4b3a-8a33-fa08f807e457 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:55.058801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044193dd-d223-4b3a-8a33-fa08f807e457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:55.077077 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044193dd-d223-4b3a-8a33-fa08f807e457 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:55.117452 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36932623-7713-4392-86b8-ae4c7eacca98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:55.127889 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36932623-7713-4392-86b8-ae4c7eacca98 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:55.127889 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36932623-7713-4392-86b8-ae4c7eacca98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:55.127889 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36932623-7713-4392-86b8-ae4c7eacca98 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:55.127889 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36932623-7713-4392-86b8-ae4c7eacca98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:55.127889 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36932623-7713-4392-86b8-ae4c7eacca98 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:55.250755 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 949/1949] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:23:54 2022] POST /identity/v3/projects => generated 363 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:55.251778 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044193dd-d223-4b3a-8a33-fa08f807e457 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:55.255805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-044193dd-d223-4b3a-8a33-fa08f807e457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:55.332112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1001/1950] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:23:54 2022] POST /identity/v3/users => generated 292 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:55.345690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36932623-7713-4392-86b8-ae4c7eacca98 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:55.358188 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36932623-7713-4392-86b8-ae4c7eacca98 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:55.404771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044193dd-d223-4b3a-8a33-fa08f807e457 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:55.410732 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400bcf1-1a58-44b7-bb00-adb659f879f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:55.411380 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400bcf1-1a58-44b7-bb00-adb659f879f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:55.411662 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400bcf1-1a58-44b7-bb00-adb659f879f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:55.411982 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400bcf1-1a58-44b7-bb00-adb659f879f5 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:55.412641 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400bcf1-1a58-44b7-bb00-adb659f879f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:55.416298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400bcf1-1a58-44b7-bb00-adb659f879f5 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:55.446135 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f75076-4308-4713-b5db-f0097d55b798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:55.447083 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f75076-4308-4713-b5db-f0097d55b798 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:55.447488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f75076-4308-4713-b5db-f0097d55b798 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:55.447771 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f75076-4308-4713-b5db-f0097d55b798 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:55.449111 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f75076-4308-4713-b5db-f0097d55b798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:55.452321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f75076-4308-4713-b5db-f0097d55b798 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:55.482668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:55.579803 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 950/1951] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:23:55 2022] POST /identity/v3/users => generated 287 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:55.580677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400bcf1-1a58-44b7-bb00-adb659f879f5 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:55.591538 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400bcf1-1a58-44b7-bb00-adb659f879f5 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:55.596707 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092698c-2493-41e5-a434-62945cb5d000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:55.597315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092698c-2493-41e5-a434-62945cb5d000 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:55.597634 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092698c-2493-41e5-a434-62945cb5d000 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:55.597990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092698c-2493-41e5-a434-62945cb5d000 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:55.598979 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092698c-2493-41e5-a434-62945cb5d000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:55.600799 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092698c-2493-41e5-a434-62945cb5d000 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:55.615696 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 951/1952] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:55.623954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092698c-2493-41e5-a434-62945cb5d000 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:55.624155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1002/1953] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:23:55 2022] POST /identity/v3/users => generated 282 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:55.625960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f75076-4308-4713-b5db-f0097d55b798 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:55.628037 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-85f75076-4308-4713-b5db-f0097d55b798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:55.630647 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092698c-2493-41e5-a434-62945cb5d000 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:55.638556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e8ccc-34a0-4a86-bf9e-5ef681762af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:55.639605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e8ccc-34a0-4a86-bf9e-5ef681762af8 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:55.639605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e8ccc-34a0-4a86-bf9e-5ef681762af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:55.639951 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e8ccc-34a0-4a86-bf9e-5ef681762af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:55.643540 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f75076-4308-4713-b5db-f0097d55b798 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:55.648211 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e8ccc-34a0-4a86-bf9e-5ef681762af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:55.652312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396f65a-4146-4e63-9e67-f12ed3edb54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:55.653132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396f65a-4146-4e63-9e67-f12ed3edb54d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:55.653556 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396f65a-4146-4e63-9e67-f12ed3edb54d admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:55.654008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396f65a-4146-4e63-9e67-f12ed3edb54d admin admin] PATH_INFO: `/v3/projects/16589708a7144f578841698f36e12d8a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:55.655569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e8ccc-34a0-4a86-bf9e-5ef681762af8 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:55.655711 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396f65a-4146-4e63-9e67-f12ed3edb54d admin admin] RBAC: Authorizing `identity:delete_project(project_id=16589708a7144f578841698f36e12d8a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:55.660141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396f65a-4146-4e63-9e67-f12ed3edb54d admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:55.672973 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 952/1954] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:55.672973 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e8ccc-34a0-4a86-bf9e-5ef681762af8 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:55.680206 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e8ccc-34a0-4a86-bf9e-5ef681762af8 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:55.686134 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc0c3d-a19f-432f-8788-901582cbb912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:55.686758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc0c3d-a19f-432f-8788-901582cbb912 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:55.687172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc0c3d-a19f-432f-8788-901582cbb912 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:55.687339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc0c3d-a19f-432f-8788-901582cbb912 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:55.687942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc0c3d-a19f-432f-8788-901582cbb912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:55.689659 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc0c3d-a19f-432f-8788-901582cbb912 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:55.704291 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 953/1955] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:55.712853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc0c3d-a19f-432f-8788-901582cbb912 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:55.718968 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc0c3d-a19f-432f-8788-901582cbb912 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:55.727698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bb796-9454-43b8-bea5-ab5800700a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:55.728464 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bb796-9454-43b8-bea5-ab5800700a9e admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:55.728823 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bb796-9454-43b8-bea5-ab5800700a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:55.730433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bb796-9454-43b8-bea5-ab5800700a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:55.731269 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bb796-9454-43b8-bea5-ab5800700a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:55.732968 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bb796-9454-43b8-bea5-ab5800700a9e admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:55.744680 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 954/1956] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:55.746453 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bb796-9454-43b8-bea5-ab5800700a9e admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:55.759652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bb796-9454-43b8-bea5-ab5800700a9e admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:55.764780 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e90bb0-3613-4e7e-8a4d-ab362ad8a298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:55.765418 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e90bb0-3613-4e7e-8a4d-ab362ad8a298 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:55.765700 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e90bb0-3613-4e7e-8a4d-ab362ad8a298 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:55.766023 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e90bb0-3613-4e7e-8a4d-ab362ad8a298 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:55.766689 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e90bb0-3613-4e7e-8a4d-ab362ad8a298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:55.768348 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e90bb0-3613-4e7e-8a4d-ab362ad8a298 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:55.787599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 955/1957] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:55.787599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e90bb0-3613-4e7e-8a4d-ab362ad8a298 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:55.796596 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e90bb0-3613-4e7e-8a4d-ab362ad8a298 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:55.804296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5a5ab-12dc-43f5-a8eb-8fa4974098fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:55.804296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5a5ab-12dc-43f5-a8eb-8fa4974098fd admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:55.804296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5a5ab-12dc-43f5-a8eb-8fa4974098fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:55.804296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5a5ab-12dc-43f5-a8eb-8fa4974098fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:55.804959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5a5ab-12dc-43f5-a8eb-8fa4974098fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:55.804959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5a5ab-12dc-43f5-a8eb-8fa4974098fd admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:55.818855 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 956/1958] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:55.820368 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5a5ab-12dc-43f5-a8eb-8fa4974098fd admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:55.833833 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5a5ab-12dc-43f5-a8eb-8fa4974098fd admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:55.839501 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a577d4-a93b-4859-8dde-3f7ed61e2db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:55.840236 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a577d4-a93b-4859-8dde-3f7ed61e2db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:55.840578 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a577d4-a93b-4859-8dde-3f7ed61e2db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:55.840807 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a577d4-a93b-4859-8dde-3f7ed61e2db5 admin admin] PATH_INFO: `/v3/projects/e369c528dc5c4fb4805a90e1603eaa36/users/11bd1a12688e4c7289b1fa440f320129/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:55.858282 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a577d4-a93b-4859-8dde-3f7ed61e2db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e369c528dc5c4fb4805a90e1603eaa36, user_id=11bd1a12688e4c7289b1fa440f320129, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:55.861340 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a577d4-a93b-4859-8dde-3f7ed61e2db5 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:56.036640 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 957/1959] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:55 2022] PUT /identity/v3/projects/e369c528dc5c4fb4805a90e1603eaa36/users/11bd1a12688e4c7289b1fa440f320129/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:56.038506 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a577d4-a93b-4859-8dde-3f7ed61e2db5 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:56.052834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-f396f65a-4146-4e63-9e67-f12ed3edb54d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16589708a7144f578841698f36e12d8a', 'request_id': 'req-f396f65a-4146-4e63-9e67-f12ed3edb54d'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:56.061524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-f396f65a-4146-4e63-9e67-f12ed3edb54d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16589708a7144f578841698f36e12d8a', 'request_id': 'req-f396f65a-4146-4e63-9e67-f12ed3edb54d'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:56.069372 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-f396f65a-4146-4e63-9e67-f12ed3edb54d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16589708a7144f578841698f36e12d8a', 'request_id': 'req-f396f65a-4146-4e63-9e67-f12ed3edb54d'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:56.130569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a577d4-a93b-4859-8dde-3f7ed61e2db5 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:56.199455 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650b62e-66e4-4af8-a00a-9e12d13b09dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:56.200047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650b62e-66e4-4af8-a00a-9e12d13b09dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:56.200334 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650b62e-66e4-4af8-a00a-9e12d13b09dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:56.200616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650b62e-66e4-4af8-a00a-9e12d13b09dd admin admin] PATH_INFO: `/v3/projects/6b94ed501dcf4e2fb3440f1fb5eea047/users/33d5dbaa18044a0e9e8724c0084d7a57/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:56.201664 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-f396f65a-4146-4e63-9e67-f12ed3edb54d admin admin] The token cache is being invalidate because project 16589708a7144f578841698f36e12d8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:56.202861 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-f396f65a-4146-4e63-9e67-f12ed3edb54d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:56.203047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-f396f65a-4146-4e63-9e67-f12ed3edb54d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:56.204607 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1003/1960] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:55 2022] DELETE /identity/v3/projects/16589708a7144f578841698f36e12d8a => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:56.205586 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396f65a-4146-4e63-9e67-f12ed3edb54d admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:56.206947 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f396f65a-4146-4e63-9e67-f12ed3edb54d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:56.221145 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396f65a-4146-4e63-9e67-f12ed3edb54d admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:56.225629 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650b62e-66e4-4af8-a00a-9e12d13b09dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b94ed501dcf4e2fb3440f1fb5eea047, user_id=33d5dbaa18044a0e9e8724c0084d7a57, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:56.225937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c2e29-9f19-4b0d-83cf-b4bde5e97479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:56.226847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c2e29-9f19-4b0d-83cf-b4bde5e97479 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:56.227082 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c2e29-9f19-4b0d-83cf-b4bde5e97479 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:56.227359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c2e29-9f19-4b0d-83cf-b4bde5e97479 admin admin] PATH_INFO: `/v3/projects/e43f0a0ef84e47799bfc95e2cbca5b24/users/d2295752945b440787e7c8c226347d49/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:56.228339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650b62e-66e4-4af8-a00a-9e12d13b09dd admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:56.245048 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c2e29-9f19-4b0d-83cf-b4bde5e97479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e43f0a0ef84e47799bfc95e2cbca5b24, user_id=d2295752945b440787e7c8c226347d49, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:56.248581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c2e29-9f19-4b0d-83cf-b4bde5e97479 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:56.402774 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 958/1961] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:56 2022] PUT /identity/v3/projects/6b94ed501dcf4e2fb3440f1fb5eea047/users/33d5dbaa18044a0e9e8724c0084d7a57/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:56.407527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1004/1962] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:56 2022] PUT /identity/v3/projects/e43f0a0ef84e47799bfc95e2cbca5b24/users/d2295752945b440787e7c8c226347d49/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:56.408227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729c111-9299-43df-adfa-ca7a26a0d851 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:56.408716 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729c111-9299-43df-adfa-ca7a26a0d851 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:56.409107 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06039202-d174-46a6-86a3-2f8affca498e None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:56.409436 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06039202-d174-46a6-86a3-2f8affca498e None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:56.409727 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06039202-d174-46a6-86a3-2f8affca498e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:56.409949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729c111-9299-43df-adfa-ca7a26a0d851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:56.437424 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-06039202-d174-46a6-86a3-2f8affca498e None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:56.439813 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-06039202-d174-46a6-86a3-2f8affca498e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:56.453100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-c729c111-9299-43df-adfa-ca7a26a0d851 None None] MFA Rules not processed for user `11bd1a12688e4c7289b1fa440f320129`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:56.454380 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-c729c111-9299-43df-adfa-ca7a26a0d851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:56.516922 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1005/1963] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:56.520030 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15488a8-8467-4646-ae9f-767c664b00ea None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:56.520718 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15488a8-8467-4646-ae9f-767c664b00ea None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:56.521119 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15488a8-8467-4646-ae9f-767c664b00ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:56.561799 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 959/1964] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:56.562101 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-b15488a8-8467-4646-ae9f-767c664b00ea None None] MFA Rules not processed for user `33d5dbaa18044a0e9e8724c0084d7a57`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:56.563003 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b15488a8-8467-4646-ae9f-767c664b00ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:56.566949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a8e94-f325-4a1a-8ced-9f2fc872e0bd None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:56.567441 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a8e94-f325-4a1a-8ced-9f2fc872e0bd None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:56.567795 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a8e94-f325-4a1a-8ced-9f2fc872e0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:56.611874 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-d85a8e94-f325-4a1a-8ced-9f2fc872e0bd None None] MFA Rules not processed for user `d2295752945b440787e7c8c226347d49`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:56.614100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d85a8e94-f325-4a1a-8ced-9f2fc872e0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:56.649971 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1006/1965] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:56.651838 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b7266-7b9a-4bc7-a83c-dcaa3095e383 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:56.652415 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b7266-7b9a-4bc7-a83c-dcaa3095e383 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:56.652611 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b7266-7b9a-4bc7-a83c-dcaa3095e383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:56.676681 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-4d5b7266-7b9a-4bc7-a83c-dcaa3095e383 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:56.677964 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-4d5b7266-7b9a-4bc7-a83c-dcaa3095e383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:56.687862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1007/1966] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:56.688085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b7266-7b9a-4bc7-a83c-dcaa3095e383 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:56.690621 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-4d5b7266-7b9a-4bc7-a83c-dcaa3095e383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:56.702667 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b7266-7b9a-4bc7-a83c-dcaa3095e383 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:56.707570 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38e757-3fd0-4531-9a74-07bd3f34e9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:56.708132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38e757-3fd0-4531-9a74-07bd3f34e9ff admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:56.708416 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38e757-3fd0-4531-9a74-07bd3f34e9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:56.708694 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38e757-3fd0-4531-9a74-07bd3f34e9ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:56.709736 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38e757-3fd0-4531-9a74-07bd3f34e9ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:56.711293 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38e757-3fd0-4531-9a74-07bd3f34e9ff admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:56.719251 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 960/1967] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:56.720115 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a8e94-f325-4a1a-8ced-9f2fc872e0bd None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:56.721494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d85a8e94-f325-4a1a-8ced-9f2fc872e0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:56.794043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a8e94-f325-4a1a-8ced-9f2fc872e0bd None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:56.797934 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59ad88-cc64-4d78-a427-f523ecf1f106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:56.798560 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59ad88-cc64-4d78-a427-f523ecf1f106 service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:56.798839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59ad88-cc64-4d78-a427-f523ecf1f106 service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:56.799115 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59ad88-cc64-4d78-a427-f523ecf1f106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:56.809296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59ad88-cc64-4d78-a427-f523ecf1f106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:56.810815 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59ad88-cc64-4d78-a427-f523ecf1f106 service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:56.820240 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 961/1968] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:56.821049 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59ad88-cc64-4d78-a427-f523ecf1f106 service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:56.834134 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59ad88-cc64-4d78-a427-f523ecf1f106 service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:56.839857 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f61d9-f9c8-4574-98fd-32c10d5a27e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:56.846221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f61d9-f9c8-4574-98fd-32c10d5a27e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:56.846221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f61d9-f9c8-4574-98fd-32c10d5a27e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:56.846221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f61d9-f9c8-4574-98fd-32c10d5a27e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:56.846221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f61d9-f9c8-4574-98fd-32c10d5a27e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:23:56.846221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f61d9-f9c8-4574-98fd-32c10d5a27e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:56.846221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f61d9-f9c8-4574-98fd-32c10d5a27e0 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:56.847235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1008/1969] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:23:56 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:56.847235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38e757-3fd0-4531-9a74-07bd3f34e9ff admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:56.858423 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 962/1970] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:23:56.859266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f61d9-f9c8-4574-98fd-32c10d5a27e0 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:56.870652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f61d9-f9c8-4574-98fd-32c10d5a27e0 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:56.921294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38e757-3fd0-4531-9a74-07bd3f34e9ff admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:56.926472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c77af-47c0-43e8-9203-871233ffd456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:56.927196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c77af-47c0-43e8-9203-871233ffd456 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:56.927555 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c77af-47c0-43e8-9203-871233ffd456 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:56.927893 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c77af-47c0-43e8-9203-871233ffd456 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:56.928590 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c77af-47c0-43e8-9203-871233ffd456 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:56.930621 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c77af-47c0-43e8-9203-871233ffd456 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:56.949164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556d6e1-8628-4004-bfc5-9956f7ba2760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:56.949786 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556d6e1-8628-4004-bfc5-9956f7ba2760 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:56.950103 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556d6e1-8628-4004-bfc5-9956f7ba2760 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:56.950381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556d6e1-8628-4004-bfc5-9956f7ba2760 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:56.951024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556d6e1-8628-4004-bfc5-9956f7ba2760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:56.952960 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556d6e1-8628-4004-bfc5-9956f7ba2760 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:57.037828 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1009/1971] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:23:56 2022] POST /identity/v3/projects => generated 363 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:57.038868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c77af-47c0-43e8-9203-871233ffd456 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:57.040713 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-d16c77af-47c0-43e8-9203-871233ffd456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:57.067268 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 963/1972] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:23:56 2022] POST /identity/v3/users => generated 299 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:57.067268 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556d6e1-8628-4004-bfc5-9956f7ba2760 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:57.078439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556d6e1-8628-4004-bfc5-9956f7ba2760 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:57.125971 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c77af-47c0-43e8-9203-871233ffd456 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:57.131136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4222b-c319-4055-b9b3-a9a582713170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:57.131837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4222b-c319-4055-b9b3-a9a582713170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:57.132105 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4222b-c319-4055-b9b3-a9a582713170 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:57.132379 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4222b-c319-4055-b9b3-a9a582713170 admin admin] PATH_INFO: `/v3/users/33d5dbaa18044a0e9e8724c0084d7a57` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:57.133573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4222b-c319-4055-b9b3-a9a582713170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d5dbaa18044a0e9e8724c0084d7a57)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:57.135625 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4222b-c319-4055-b9b3-a9a582713170 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:57.145368 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2c360-38b8-4afb-8932-b414865d4a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:57.146032 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2c360-38b8-4afb-8932-b414865d4a1b admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:57.146326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2c360-38b8-4afb-8932-b414865d4a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:57.146610 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2c360-38b8-4afb-8932-b414865d4a1b admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:57.147259 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2c360-38b8-4afb-8932-b414865d4a1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:57.149336 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2c360-38b8-4afb-8932-b414865d4a1b admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:57.223962 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:57.261295 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 964/1973] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:23:57 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:57.262456 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2c360-38b8-4afb-8932-b414865d4a1b admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:57.328006 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2c360-38b8-4afb-8932-b414865d4a1b admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:57.332838 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558ebb7-d03f-45b6-9609-c65fa3ac0c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:57.333453 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558ebb7-d03f-45b6-9609-c65fa3ac0c75 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:57.333734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558ebb7-d03f-45b6-9609-c65fa3ac0c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:57.334041 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558ebb7-d03f-45b6-9609-c65fa3ac0c75 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:57.334688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558ebb7-d03f-45b6-9609-c65fa3ac0c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:57.336745 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558ebb7-d03f-45b6-9609-c65fa3ac0c75 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:57.389637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-11a4222b-c319-4055-b9b3-a9a582713170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d5dbaa18044a0e9e8724c0084d7a57'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:57.390740 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-11a4222b-c319-4055-b9b3-a9a582713170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d5dbaa18044a0e9e8724c0084d7a57'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:57.405332 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-11a4222b-c319-4055-b9b3-a9a582713170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d5dbaa18044a0e9e8724c0084d7a57'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:57.417371 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-11a4222b-c319-4055-b9b3-a9a582713170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d5dbaa18044a0e9e8724c0084d7a57'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:57.418513 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-11a4222b-c319-4055-b9b3-a9a582713170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d5dbaa18044a0e9e8724c0084d7a57'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:57.465286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 965/1974] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:23:57 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:57.473712 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558ebb7-d03f-45b6-9609-c65fa3ac0c75 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:57.473712 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-7558ebb7-d03f-45b6-9609-c65fa3ac0c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:57.481072 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558ebb7-d03f-45b6-9609-c65fa3ac0c75 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:57.485886 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b504ec7-192f-4bee-9632-27c75d1b259d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:57.486498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b504ec7-192f-4bee-9632-27c75d1b259d admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:57.486787 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b504ec7-192f-4bee-9632-27c75d1b259d admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:57.487416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b504ec7-192f-4bee-9632-27c75d1b259d admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:57.488121 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b504ec7-192f-4bee-9632-27c75d1b259d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:57.489725 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b504ec7-192f-4bee-9632-27c75d1b259d admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:57.502441 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 966/1975] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:57.503171 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b504ec7-192f-4bee-9632-27c75d1b259d admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:57.505323 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-7b504ec7-192f-4bee-9632-27c75d1b259d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:57.519666 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b504ec7-192f-4bee-9632-27c75d1b259d admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:57.524616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770af79-b91e-4e53-8a14-f7e257c25aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:57.525485 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770af79-b91e-4e53-8a14-f7e257c25aaa admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:57.525790 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770af79-b91e-4e53-8a14-f7e257c25aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:57.526622 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770af79-b91e-4e53-8a14-f7e257c25aaa admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:57.527267 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770af79-b91e-4e53-8a14-f7e257c25aaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:57.529382 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770af79-b91e-4e53-8a14-f7e257c25aaa admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:57.607584 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1010/1976] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:23:57 2022] DELETE /identity/v3/users/33d5dbaa18044a0e9e8724c0084d7a57 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:57.608655 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4222b-c319-4055-b9b3-a9a582713170 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:57.610037 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-11a4222b-c319-4055-b9b3-a9a582713170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:57.684753 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4222b-c319-4055-b9b3-a9a582713170 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:57.694380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd5f9d-29b1-4915-a1cd-19327fcec0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:57.696468 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd5f9d-29b1-4915-a1cd-19327fcec0df admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:57.696663 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd5f9d-29b1-4915-a1cd-19327fcec0df admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:57.697043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd5f9d-29b1-4915-a1cd-19327fcec0df admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:57.698466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd5f9d-29b1-4915-a1cd-19327fcec0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:57.700422 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd5f9d-29b1-4915-a1cd-19327fcec0df admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:57.711745 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 967/1977] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:23:57 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:23:57.712773 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770af79-b91e-4e53-8a14-f7e257c25aaa admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:57.719207 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1011/1978] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:57.719207 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc09127-5c8f-48e1-8aa4-edbbd9bf6240 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:57.719207 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc09127-5c8f-48e1-8aa4-edbbd9bf6240 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:57.719207 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc09127-5c8f-48e1-8aa4-edbbd9bf6240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:57.734389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770af79-b91e-4e53-8a14-f7e257c25aaa admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:57.740146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbb122-a3de-46d9-ac55-6b9b11d2203d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:57.741176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbb122-a3de-46d9-ac55-6b9b11d2203d admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:57.741647 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbb122-a3de-46d9-ac55-6b9b11d2203d admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:57.742074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbb122-a3de-46d9-ac55-6b9b11d2203d admin admin] PATH_INFO: `/v3/projects/be51082ee43c40dcb7f32c50e2e961e1/users/9941f364e67e4e1fab387916389b5028/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:57.749305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-5bc09127-5c8f-48e1-8aa4-edbbd9bf6240 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:57.751230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-5bc09127-5c8f-48e1-8aa4-edbbd9bf6240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:57.759765 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1012/1979] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:57.760969 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc09127-5c8f-48e1-8aa4-edbbd9bf6240 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:57.770853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbb122-a3de-46d9-ac55-6b9b11d2203d admin admin] RBAC: Authorizing `identity:create_grant(project_id=be51082ee43c40dcb7f32c50e2e961e1, user_id=9941f364e67e4e1fab387916389b5028, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:57.774576 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc09127-5c8f-48e1-8aa4-edbbd9bf6240 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:57.777251 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbb122-a3de-46d9-ac55-6b9b11d2203d admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:57.785201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6f325-f320-4f9a-a084-82acc353de45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:57.786140 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6f325-f320-4f9a-a084-82acc353de45 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:57.786976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6f325-f320-4f9a-a084-82acc353de45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:57.787167 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6f325-f320-4f9a-a084-82acc353de45 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:57.788114 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6f325-f320-4f9a-a084-82acc353de45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:57.790660 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6f325-f320-4f9a-a084-82acc353de45 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:57.805381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1013/1980] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:57.805381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6f325-f320-4f9a-a084-82acc353de45 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:57.820256 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6f325-f320-4f9a-a084-82acc353de45 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:57.825223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6dc4f3-5715-4f48-9ab4-ec980db4d229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:57.825954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dc4f3-5715-4f48-9ab4-ec980db4d229 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:57.826245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dc4f3-5715-4f48-9ab4-ec980db4d229 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:57.826572 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6dc4f3-5715-4f48-9ab4-ec980db4d229 admin admin] PATH_INFO: `/v3/projects/78dca602c0b64a94ab4d65a798538da6/users/193490af62044c5bb94b5b958ac58ddb/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:57.846825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6dc4f3-5715-4f48-9ab4-ec980db4d229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78dca602c0b64a94ab4d65a798538da6, user_id=193490af62044c5bb94b5b958ac58ddb, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:57.849559 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6dc4f3-5715-4f48-9ab4-ec980db4d229 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:57.881306 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 968/1981] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:57 2022] PUT /identity/v3/projects/be51082ee43c40dcb7f32c50e2e961e1/users/9941f364e67e4e1fab387916389b5028/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:57.884479 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbb122-a3de-46d9-ac55-6b9b11d2203d admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:57.884479 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-28fbb122-a3de-46d9-ac55-6b9b11d2203d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:57.950189 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbb122-a3de-46d9-ac55-6b9b11d2203d admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:57.954373 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f3132-5895-4d22-8dab-10d05707a585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:57.955001 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f3132-5895-4d22-8dab-10d05707a585 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:57.955287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f3132-5895-4d22-8dab-10d05707a585 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:57.955558 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f3132-5895-4d22-8dab-10d05707a585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:57.998895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1014/1982] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:57 2022] PUT /identity/v3/projects/78dca602c0b64a94ab4d65a798538da6/users/193490af62044c5bb94b5b958ac58ddb/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:57.999837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6dc4f3-5715-4f48-9ab4-ec980db4d229 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:58.044868 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f3132-5895-4d22-8dab-10d05707a585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:58.046227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f3132-5895-4d22-8dab-10d05707a585 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:58.060471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 969/1983] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:58.062419 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f3132-5895-4d22-8dab-10d05707a585 service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:58.074698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f3132-5895-4d22-8dab-10d05707a585 service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:58.086601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6dc4f3-5715-4f48-9ab4-ec980db4d229 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:58.086994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0568bc-ce07-4099-ac0b-8e21b3591cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:58.087876 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0568bc-ce07-4099-ac0b-8e21b3591cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:58.088194 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0568bc-ce07-4099-ac0b-8e21b3591cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:58.088992 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0568bc-ce07-4099-ac0b-8e21b3591cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:58.089753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0568bc-ce07-4099-ac0b-8e21b3591cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:58.091997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0568bc-ce07-4099-ac0b-8e21b3591cf8 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:58.097151 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c6073-84c0-4d11-8862-89cf89b98cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:58.098274 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c6073-84c0-4d11-8862-89cf89b98cfc admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:58.098798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c6073-84c0-4d11-8862-89cf89b98cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:58.099306 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c6073-84c0-4d11-8862-89cf89b98cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:58.100399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c6073-84c0-4d11-8862-89cf89b98cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:58.102588 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c6073-84c0-4d11-8862-89cf89b98cfc admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:58.112686 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 970/1984] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:58.113890 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0568bc-ce07-4099-ac0b-8e21b3591cf8 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:58.122048 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1015/1985] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:58.124300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c6073-84c0-4d11-8862-89cf89b98cfc admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:58.131113 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0568bc-ce07-4099-ac0b-8e21b3591cf8 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:58.139001 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1234fb7-8e81-4933-a415-5ea761e8a299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:58.139654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1234fb7-8e81-4933-a415-5ea761e8a299 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:58.140029 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1234fb7-8e81-4933-a415-5ea761e8a299 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:58.140385 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1234fb7-8e81-4933-a415-5ea761e8a299 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:58.141198 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1234fb7-8e81-4933-a415-5ea761e8a299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:58.143238 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1234fb7-8e81-4933-a415-5ea761e8a299 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:58.144897 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c6073-84c0-4d11-8862-89cf89b98cfc admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:58.164306 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 971/1986] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:23:58.164306 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1234fb7-8e81-4933-a415-5ea761e8a299 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:58.182113 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57c6f9-d2c8-46a0-9751-b40d68e7bf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:58.183387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57c6f9-d2c8-46a0-9751-b40d68e7bf3e admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:58.184128 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1234fb7-8e81-4933-a415-5ea761e8a299 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:58.187713 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57c6f9-d2c8-46a0-9751-b40d68e7bf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:58.188680 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57c6f9-d2c8-46a0-9751-b40d68e7bf3e admin admin] PATH_INFO: `/v3/projects/be51082ee43c40dcb7f32c50e2e961e1/users/9941f364e67e4e1fab387916389b5028/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:58.192423 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57c6f9-d2c8-46a0-9751-b40d68e7bf3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=be51082ee43c40dcb7f32c50e2e961e1, user_id=9941f364e67e4e1fab387916389b5028, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:58.192997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dd58f-7a09-4386-9b64-5afafc8a3df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:58.194577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dd58f-7a09-4386-9b64-5afafc8a3df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:58.195108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dd58f-7a09-4386-9b64-5afafc8a3df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:58.195644 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dd58f-7a09-4386-9b64-5afafc8a3df0 admin admin] PATH_INFO: `/v3/projects/5f6a7d90bafa459f8a24d89a10132b78/users/7431e8c106ba4e2689c0aa1001bbafe7/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:58.210674 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57c6f9-d2c8-46a0-9751-b40d68e7bf3e admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:58.221377 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7dd58f-7a09-4386-9b64-5afafc8a3df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f6a7d90bafa459f8a24d89a10132b78, user_id=7431e8c106ba4e2689c0aa1001bbafe7, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:58.225658 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7dd58f-7a09-4386-9b64-5afafc8a3df0 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:58.247924 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1016/1987] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:58 2022] PUT /identity/v3/projects/be51082ee43c40dcb7f32c50e2e961e1/users/9941f364e67e4e1fab387916389b5028/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:58.249499 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57c6f9-d2c8-46a0-9751-b40d68e7bf3e admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:58.313581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:58.369826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57c6f9-d2c8-46a0-9751-b40d68e7bf3e admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:58.377528 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f665548-ff4c-437d-a8f2-faababcc661c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:58.381108 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f665548-ff4c-437d-a8f2-faababcc661c admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:58.381108 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f665548-ff4c-437d-a8f2-faababcc661c admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:58.381108 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f665548-ff4c-437d-a8f2-faababcc661c admin admin] PATH_INFO: `/v3/projects/78dca602c0b64a94ab4d65a798538da6/users/193490af62044c5bb94b5b958ac58ddb/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:58.381108 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f665548-ff4c-437d-a8f2-faababcc661c admin admin] RBAC: Authorizing `identity:create_grant(project_id=78dca602c0b64a94ab4d65a798538da6, user_id=193490af62044c5bb94b5b958ac58ddb, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:58.383733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f665548-ff4c-437d-a8f2-faababcc661c admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:58.396250 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1017/1988] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:58 2022] PUT /identity/v3/projects/78dca602c0b64a94ab4d65a798538da6/users/193490af62044c5bb94b5b958ac58ddb/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:58.397727 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de021937-8dcd-451f-9075-70e6e384495a None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:58.398087 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de021937-8dcd-451f-9075-70e6e384495a None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:58.398395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de021937-8dcd-451f-9075-70e6e384495a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:58.425501 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 972/1989] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:23:58 2022] PUT /identity/v3/projects/5f6a7d90bafa459f8a24d89a10132b78/users/7431e8c106ba4e2689c0aa1001bbafe7/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:58.426866 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b8acd-8b6e-4611-bfec-ce6918841f35 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:58.427191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b8acd-8b6e-4611-bfec-ce6918841f35 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:58.427471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b8acd-8b6e-4611-bfec-ce6918841f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:58.434300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-de021937-8dcd-451f-9075-70e6e384495a None None] MFA Rules not processed for user `9941f364e67e4e1fab387916389b5028`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:58.436457 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-de021937-8dcd-451f-9075-70e6e384495a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:58.474604 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-b11b8acd-8b6e-4611-bfec-ce6918841f35 None None] MFA Rules not processed for user `193490af62044c5bb94b5b958ac58ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:58.476293 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-b11b8acd-8b6e-4611-bfec-ce6918841f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:58.539210 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1018/1990] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:58.540471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92438e-e644-412e-b151-f2f05ea02717 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:58.540766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92438e-e644-412e-b151-f2f05ea02717 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:58.541048 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92438e-e644-412e-b151-f2f05ea02717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:58.571608 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-5c92438e-e644-412e-b151-f2f05ea02717 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:58.576200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-5c92438e-e644-412e-b151-f2f05ea02717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:58.591267 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 973/1991] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:58.592297 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b8acd-8b6e-4611-bfec-ce6918841f35 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:58.593715 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-b11b8acd-8b6e-4611-bfec-ce6918841f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:58.678125 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1019/1992] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:58.679158 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92438e-e644-412e-b151-f2f05ea02717 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:58.680551 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-5c92438e-e644-412e-b151-f2f05ea02717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:58.702642 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b8acd-8b6e-4611-bfec-ce6918841f35 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:58.706144 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92438e-e644-412e-b151-f2f05ea02717 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:58.712349 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ed994-0744-42b0-be01-d8bb6e5a657d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:58.713060 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ed994-0744-42b0-be01-d8bb6e5a657d service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:58.719450 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ed994-0744-42b0-be01-d8bb6e5a657d service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:58.720179 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8823e0-e24e-4146-a5f0-142c6f11db47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:58.720321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ed994-0744-42b0-be01-d8bb6e5a657d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:58.720405 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8823e0-e24e-4146-a5f0-142c6f11db47 service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:58.720405 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8823e0-e24e-4146-a5f0-142c6f11db47 service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:58.720405 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8823e0-e24e-4146-a5f0-142c6f11db47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:58.724548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ed994-0744-42b0-be01-d8bb6e5a657d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:58.726064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ed994-0744-42b0-be01-d8bb6e5a657d service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:58.727417 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8823e0-e24e-4146-a5f0-142c6f11db47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:58.728895 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8823e0-e24e-4146-a5f0-142c6f11db47 service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:58.737670 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1020/1993] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:58.738777 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ed994-0744-42b0-be01-d8bb6e5a657d service cinder] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:58.759290 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 974/1994] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:58.819648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ed994-0744-42b0-be01-d8bb6e5a657d service cinder] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:58.824522 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6c7e8-9d35-4983-b0d1-adc0a2e56529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:58.825279 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6c7e8-9d35-4983-b0d1-adc0a2e56529 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:58.825643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6c7e8-9d35-4983-b0d1-adc0a2e56529 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:58.826060 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6c7e8-9d35-4983-b0d1-adc0a2e56529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:58.836742 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6c7e8-9d35-4983-b0d1-adc0a2e56529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:58.838273 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6c7e8-9d35-4983-b0d1-adc0a2e56529 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:58.851802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1021/1995] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:58.979621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8823e0-e24e-4146-a5f0-142c6f11db47 service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:58.981971 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-2e8823e0-e24e-4146-a5f0-142c6f11db47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:59.000179 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8823e0-e24e-4146-a5f0-142c6f11db47 service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:59.016288 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3f74e-635a-411e-bec4-247513ed7abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:59.017104 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3f74e-635a-411e-bec4-247513ed7abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:59.017460 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3f74e-635a-411e-bec4-247513ed7abe admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:59.017798 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3f74e-635a-411e-bec4-247513ed7abe admin admin] PATH_INFO: `/v3/projects/6b94ed501dcf4e2fb3440f1fb5eea047` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:59.019330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3f74e-635a-411e-bec4-247513ed7abe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b94ed501dcf4e2fb3440f1fb5eea047)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:59.022750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3f74e-635a-411e-bec4-247513ed7abe admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:59.239496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-14e3f74e-635a-411e-bec4-247513ed7abe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b94ed501dcf4e2fb3440f1fb5eea047', 'request_id': 'req-14e3f74e-635a-411e-bec4-247513ed7abe'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:59.253829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-14e3f74e-635a-411e-bec4-247513ed7abe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b94ed501dcf4e2fb3440f1fb5eea047', 'request_id': 'req-14e3f74e-635a-411e-bec4-247513ed7abe'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:59.259945 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-14e3f74e-635a-411e-bec4-247513ed7abe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b94ed501dcf4e2fb3440f1fb5eea047', 'request_id': 'req-14e3f74e-635a-411e-bec4-247513ed7abe'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:59.261487 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6c7e8-9d35-4983-b0d1-adc0a2e56529 service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:59.276576 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6c7e8-9d35-4983-b0d1-adc0a2e56529 service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:59.333761 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f19cf-12c1-4760-83b2-fc02acfeff74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:59.334329 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f19cf-12c1-4760-83b2-fc02acfeff74 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:59.334610 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f19cf-12c1-4760-83b2-fc02acfeff74 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:59.334884 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f19cf-12c1-4760-83b2-fc02acfeff74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:59.336699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-8e0f19cf-12c1-4760-83b2-fc02acfeff74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:59.419665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-14e3f74e-635a-411e-bec4-247513ed7abe admin admin] The token cache is being invalidate because project 6b94ed501dcf4e2fb3440f1fb5eea047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:23:59.420213 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-14e3f74e-635a-411e-bec4-247513ed7abe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:59.421287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-14e3f74e-635a-411e-bec4-247513ed7abe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:23:59.424356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 975/1996] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:23:58 2022] DELETE /identity/v3/projects/6b94ed501dcf4e2fb3440f1fb5eea047 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:23:59.430796 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22eb80-50c3-4721-83c6-7e5da1ea79ce None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:59.431328 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22eb80-50c3-4721-83c6-7e5da1ea79ce None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:59.431808 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22eb80-50c3-4721-83c6-7e5da1ea79ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:59.436609 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f19cf-12c1-4760-83b2-fc02acfeff74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:59.440207 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f19cf-12c1-4760-83b2-fc02acfeff74 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:59.456631 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1022/1997] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:23:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:23:59.460869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-5f22eb80-50c3-4721-83c6-7e5da1ea79ce None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:59.462125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-5f22eb80-50c3-4721-83c6-7e5da1ea79ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:59.533306 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 976/1998] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:59.541681 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f446c-8fb5-4530-99d0-1865695c097e None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:59.542534 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f446c-8fb5-4530-99d0-1865695c097e None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:59.542534 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f446c-8fb5-4530-99d0-1865695c097e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:59.574259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-a31f446c-8fb5-4530-99d0-1865695c097e None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:23:59.583035 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-a31f446c-8fb5-4530-99d0-1865695c097e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:23:59.590025 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1023/1999] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:23:59.591239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22eb80-50c3-4721-83c6-7e5da1ea79ce None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:59.603455 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22eb80-50c3-4721-83c6-7e5da1ea79ce None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:59.609569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d9f28-57f3-47a3-a1b2-70abfb2130cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:59.610595 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d9f28-57f3-47a3-a1b2-70abfb2130cf admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:59.610978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d9f28-57f3-47a3-a1b2-70abfb2130cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:59.611293 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d9f28-57f3-47a3-a1b2-70abfb2130cf admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:59.612133 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d9f28-57f3-47a3-a1b2-70abfb2130cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:23:59.612465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d9f28-57f3-47a3-a1b2-70abfb2130cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:59.625226 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d9f28-57f3-47a3-a1b2-70abfb2130cf admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:59.644545 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 977/2000] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:23:59.647349 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f446c-8fb5-4530-99d0-1865695c097e None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:23:59.663080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f446c-8fb5-4530-99d0-1865695c097e None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:23:59.669290 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dbdfa-3bf3-4b39-9fcc-fff0e017df0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:23:59.669995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dbdfa-3bf3-4b39-9fcc-fff0e017df0b admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:23:59.670248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dbdfa-3bf3-4b39-9fcc-fff0e017df0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:23:59.670526 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dbdfa-3bf3-4b39-9fcc-fff0e017df0b admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:23:59.671185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751dbdfa-3bf3-4b39-9fcc-fff0e017df0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:23:59.673315 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751dbdfa-3bf3-4b39-9fcc-fff0e017df0b admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:23:59.991011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1024/2001] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:23:59 2022] POST /identity/v3/projects => generated 389 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:24:00.001042 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d9f28-57f3-47a3-a1b2-70abfb2130cf admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:00.011521 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d9f28-57f3-47a3-a1b2-70abfb2130cf admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:00.093756 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefaa70-c3a7-441a-918d-b36bdb962317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:00.094843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefaa70-c3a7-441a-918d-b36bdb962317 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:00.100650 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefaa70-c3a7-441a-918d-b36bdb962317 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:00.100936 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefaa70-c3a7-441a-918d-b36bdb962317 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:00.101694 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefaa70-c3a7-441a-918d-b36bdb962317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:00.105621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefaa70-c3a7-441a-918d-b36bdb962317 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:00.416729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 978/2002] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:23:59 2022] POST /identity/v3/users => generated 295 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:24:00.420705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dbdfa-3bf3-4b39-9fcc-fff0e017df0b admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:00.438786 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dbdfa-3bf3-4b39-9fcc-fff0e017df0b admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:00.454477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355e934-0670-47a7-9ef2-0a3d29d052e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:00.455527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355e934-0670-47a7-9ef2-0a3d29d052e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:00.456146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355e934-0670-47a7-9ef2-0a3d29d052e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:00.456634 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355e934-0670-47a7-9ef2-0a3d29d052e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:00.457508 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355e934-0670-47a7-9ef2-0a3d29d052e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:00.459410 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355e934-0670-47a7-9ef2-0a3d29d052e2 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:00.484675 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1025/2003] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:24:00.487444 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefaa70-c3a7-441a-918d-b36bdb962317 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:00.502104 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefaa70-c3a7-441a-918d-b36bdb962317 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:00.510357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:00.516410 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5049c-74c6-447e-b958-45b9ed11daa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:00.520783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5049c-74c6-447e-b958-45b9ed11daa1 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:00.520783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5049c-74c6-447e-b958-45b9ed11daa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:00.520783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5049c-74c6-447e-b958-45b9ed11daa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:00.520783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5049c-74c6-447e-b958-45b9ed11daa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:00.520783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5049c-74c6-447e-b958-45b9ed11daa1 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:00.532546 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 979/2004] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:24:00.536870 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355e934-0670-47a7-9ef2-0a3d29d052e2 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:00.547381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355e934-0670-47a7-9ef2-0a3d29d052e2 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:00.552383 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6622a-a532-4ee3-89ab-239e8bdd04dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:00.553045 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6622a-a532-4ee3-89ab-239e8bdd04dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:00.553328 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6622a-a532-4ee3-89ab-239e8bdd04dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:00.553606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6622a-a532-4ee3-89ab-239e8bdd04dd admin admin] PATH_INFO: `/v3/projects/5e882ad5c7504557844491fab2ee4444/users/d5c0123ca64b4ee1af791b5bc70cadd9/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:00.572432 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6622a-a532-4ee3-89ab-239e8bdd04dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e882ad5c7504557844491fab2ee4444, user_id=d5c0123ca64b4ee1af791b5bc70cadd9, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:00.575758 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6622a-a532-4ee3-89ab-239e8bdd04dd admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:00.725682 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1026/2005] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:24:00 2022] PUT /identity/v3/projects/5e882ad5c7504557844491fab2ee4444/users/d5c0123ca64b4ee1af791b5bc70cadd9/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:00.741144 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352d2f1-4a1a-460d-b956-6904d63274b4 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:00.741619 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352d2f1-4a1a-460d-b956-6904d63274b4 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:00.741724 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352d2f1-4a1a-460d-b956-6904d63274b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:00.777059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-f352d2f1-4a1a-460d-b956-6904d63274b4 None None] MFA Rules not processed for user `d5c0123ca64b4ee1af791b5bc70cadd9`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:00.781735 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f352d2f1-4a1a-460d-b956-6904d63274b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:00.888919 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 980/2006] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:00.907143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6622a-a532-4ee3-89ab-239e8bdd04dd admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:00.910097 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-6ed6622a-a532-4ee3-89ab-239e8bdd04dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:00.978464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6622a-a532-4ee3-89ab-239e8bdd04dd admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:00.985713 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede6517-34ff-45ce-9b0e-f425a59afef6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:00.987314 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede6517-34ff-45ce-9b0e-f425a59afef6 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:00.987974 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede6517-34ff-45ce-9b0e-f425a59afef6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:00.988329 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede6517-34ff-45ce-9b0e-f425a59afef6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:01.001325 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede6517-34ff-45ce-9b0e-f425a59afef6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:01.003660 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede6517-34ff-45ce-9b0e-f425a59afef6 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:01.020464 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4525c51-966e-4d53-ad67-d3496642174a None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:01.020870 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4525c51-966e-4d53-ad67-d3496642174a None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:01.021246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4525c51-966e-4d53-ad67-d3496642174a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:01.041170 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1027/2007] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:24:01.066167 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-e4525c51-966e-4d53-ad67-d3496642174a None None] MFA Rules not processed for user `7431e8c106ba4e2689c0aa1001bbafe7`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:01.068075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e4525c51-966e-4d53-ad67-d3496642174a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:01.162375 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 981/2008] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:01.244201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede6517-34ff-45ce-9b0e-f425a59afef6 service cinder] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:01.244201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-eede6517-34ff-45ce-9b0e-f425a59afef6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:01.251303 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede6517-34ff-45ce-9b0e-f425a59afef6 service cinder] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:01.255830 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc7f24-6826-4ec9-8133-490f89e84b40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:01.256476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc7f24-6826-4ec9-8133-490f89e84b40 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:01.256762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc7f24-6826-4ec9-8133-490f89e84b40 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:01.257041 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc7f24-6826-4ec9-8133-490f89e84b40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:01.265363 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:01.267353 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc7f24-6826-4ec9-8133-490f89e84b40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:01.269035 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc7f24-6826-4ec9-8133-490f89e84b40 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:01.281582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1028/2009] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:24:02.751873 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4525c51-966e-4d53-ad67-d3496642174a None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:02.753976 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e4525c51-966e-4d53-ad67-d3496642174a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:02.882954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4525c51-966e-4d53-ad67-d3496642174a None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:02.893660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b799c7-d626-4498-964f-a530c2370a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:02.894415 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b799c7-d626-4498-964f-a530c2370a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:02.894698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b799c7-d626-4498-964f-a530c2370a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:02.894973 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b799c7-d626-4498-964f-a530c2370a2d admin admin] PATH_INFO: `/v3/users/11bd1a12688e4c7289b1fa440f320129` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:02.896187 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b799c7-d626-4498-964f-a530c2370a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=11bd1a12688e4c7289b1fa440f320129)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:02.898235 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b799c7-d626-4498-964f-a530c2370a2d admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:03.208536 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f4b799c7-d626-4498-964f-a530c2370a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11bd1a12688e4c7289b1fa440f320129'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:03.209620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f4b799c7-d626-4498-964f-a530c2370a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11bd1a12688e4c7289b1fa440f320129'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:03.224104 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f4b799c7-d626-4498-964f-a530c2370a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11bd1a12688e4c7289b1fa440f320129'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:03.240725 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f4b799c7-d626-4498-964f-a530c2370a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11bd1a12688e4c7289b1fa440f320129'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:03.241833 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f4b799c7-d626-4498-964f-a530c2370a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11bd1a12688e4c7289b1fa440f320129'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:03.377461 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 982/2010] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:24:02 2022] DELETE /identity/v3/users/11bd1a12688e4c7289b1fa440f320129 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:03.386705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451b1c6-e8b2-40e3-b29c-0aa8067ed0f2 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:03.388488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451b1c6-e8b2-40e3-b29c-0aa8067ed0f2 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:03.389071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451b1c6-e8b2-40e3-b29c-0aa8067ed0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:03.426711 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-1451b1c6-e8b2-40e3-b29c-0aa8067ed0f2 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:03.429551 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-1451b1c6-e8b2-40e3-b29c-0aa8067ed0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:03.610350 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1029/2011] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:03.629902 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b799c7-d626-4498-964f-a530c2370a2d admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:03.633385 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f4b799c7-d626-4498-964f-a530c2370a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:03.753914 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b799c7-d626-4498-964f-a530c2370a2d admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:03.759214 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa8b98-804c-4b9e-bf64-1e926def1a48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:03.776611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa8b98-804c-4b9e-bf64-1e926def1a48 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:03.776611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa8b98-804c-4b9e-bf64-1e926def1a48 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:03.776611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa8b98-804c-4b9e-bf64-1e926def1a48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:03.776611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa8b98-804c-4b9e-bf64-1e926def1a48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:03.776611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa8b98-804c-4b9e-bf64-1e926def1a48 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:03.796471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 983/2012] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:24:04.052803 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:04.725269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451b1c6-e8b2-40e3-b29c-0aa8067ed0f2 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:04.727998 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-1451b1c6-e8b2-40e3-b29c-0aa8067ed0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:04.753853 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451b1c6-e8b2-40e3-b29c-0aa8067ed0f2 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:04.763495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f1ed1-98d6-424c-8541-ca74db4629b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:04.765104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f1ed1-98d6-424c-8541-ca74db4629b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:04.765623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f1ed1-98d6-424c-8541-ca74db4629b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:04.766162 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f1ed1-98d6-424c-8541-ca74db4629b1 admin admin] PATH_INFO: `/v3/projects/e369c528dc5c4fb4805a90e1603eaa36` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:04.770267 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f1ed1-98d6-424c-8541-ca74db4629b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e369c528dc5c4fb4805a90e1603eaa36)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:04.774483 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f1ed1-98d6-424c-8541-ca74db4629b1 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:04.952451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4b2f1ed1-98d6-424c-8541-ca74db4629b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e369c528dc5c4fb4805a90e1603eaa36', 'request_id': 'req-4b2f1ed1-98d6-424c-8541-ca74db4629b1'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:04.966959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4b2f1ed1-98d6-424c-8541-ca74db4629b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e369c528dc5c4fb4805a90e1603eaa36', 'request_id': 'req-4b2f1ed1-98d6-424c-8541-ca74db4629b1'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:04.975613 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4b2f1ed1-98d6-424c-8541-ca74db4629b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e369c528dc5c4fb4805a90e1603eaa36', 'request_id': 'req-4b2f1ed1-98d6-424c-8541-ca74db4629b1'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:05.038022 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cf54e-a3b3-47b3-ad71-550d23771d15 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:05.038022 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cf54e-a3b3-47b3-ad71-550d23771d15 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:05.038022 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cf54e-a3b3-47b3-ad71-550d23771d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:05.067790 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:05.088687 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-1e6cf54e-a3b3-47b3-ad71-550d23771d15 None None] MFA Rules not processed for user `7431e8c106ba4e2689c0aa1001bbafe7`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:05.091422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-1e6cf54e-a3b3-47b3-ad71-550d23771d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:05.155688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4b2f1ed1-98d6-424c-8541-ca74db4629b1 admin admin] The token cache is being invalidate because project e369c528dc5c4fb4805a90e1603eaa36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:24:05.156520 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4b2f1ed1-98d6-424c-8541-ca74db4629b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:05.160188 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4b2f1ed1-98d6-424c-8541-ca74db4629b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:05.163677 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1030/2013] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:24:04 2022] DELETE /identity/v3/projects/e369c528dc5c4fb4805a90e1603eaa36 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:24:05.175883 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f1ed1-98d6-424c-8541-ca74db4629b1 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:05.178721 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-4b2f1ed1-98d6-424c-8541-ca74db4629b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:05.221864 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 984/2014] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:24:05.300368 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f1ed1-98d6-424c-8541-ca74db4629b1 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:05.310580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d0b90-9431-41af-9a8c-aee19b2f7dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:05.312285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d0b90-9431-41af-9a8c-aee19b2f7dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:05.313213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d0b90-9431-41af-9a8c-aee19b2f7dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:05.313937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d0b90-9431-41af-9a8c-aee19b2f7dfa admin admin] PATH_INFO: `/v3/users/9941f364e67e4e1fab387916389b5028` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:05.317252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d0b90-9431-41af-9a8c-aee19b2f7dfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9941f364e67e4e1fab387916389b5028)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:05.324742 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d0b90-9431-41af-9a8c-aee19b2f7dfa admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:05.676125 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-1d6d0b90-9431-41af-9a8c-aee19b2f7dfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9941f364e67e4e1fab387916389b5028'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:05.677395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-1d6d0b90-9431-41af-9a8c-aee19b2f7dfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9941f364e67e4e1fab387916389b5028'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:05.711304 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-1d6d0b90-9431-41af-9a8c-aee19b2f7dfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9941f364e67e4e1fab387916389b5028'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:05.721918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-1d6d0b90-9431-41af-9a8c-aee19b2f7dfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9941f364e67e4e1fab387916389b5028'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:05.722709 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-1d6d0b90-9431-41af-9a8c-aee19b2f7dfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9941f364e67e4e1fab387916389b5028'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:05.913742 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1031/2015] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:24:05 2022] DELETE /identity/v3/users/9941f364e67e4e1fab387916389b5028 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:06.538764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:06.730283 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6cf54e-a3b3-47b3-ad71-550d23771d15 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:06.745306 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6cf54e-a3b3-47b3-ad71-550d23771d15 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:06.840780 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcac511-a9f8-4445-bff4-033fb1db2745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:06.842035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcac511-a9f8-4445-bff4-033fb1db2745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:06.842668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcac511-a9f8-4445-bff4-033fb1db2745 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:06.843240 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcac511-a9f8-4445-bff4-033fb1db2745 admin admin] PATH_INFO: `/v3/projects/be51082ee43c40dcb7f32c50e2e961e1` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:06.845786 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcac511-a9f8-4445-bff4-033fb1db2745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be51082ee43c40dcb7f32c50e2e961e1)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:06.849967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcac511-a9f8-4445-bff4-033fb1db2745 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:07.190733 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-1dcac511-a9f8-4445-bff4-033fb1db2745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be51082ee43c40dcb7f32c50e2e961e1', 'request_id': 'req-1dcac511-a9f8-4445-bff4-033fb1db2745'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:07.202131 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-1dcac511-a9f8-4445-bff4-033fb1db2745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be51082ee43c40dcb7f32c50e2e961e1', 'request_id': 'req-1dcac511-a9f8-4445-bff4-033fb1db2745'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:07.215172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-1dcac511-a9f8-4445-bff4-033fb1db2745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be51082ee43c40dcb7f32c50e2e961e1', 'request_id': 'req-1dcac511-a9f8-4445-bff4-033fb1db2745'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:07.378668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-1dcac511-a9f8-4445-bff4-033fb1db2745 admin admin] The token cache is being invalidate because project be51082ee43c40dcb7f32c50e2e961e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:24:07.379001 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-1dcac511-a9f8-4445-bff4-033fb1db2745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:07.379581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-1dcac511-a9f8-4445-bff4-033fb1db2745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:07.381859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 985/2016] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:24:06 2022] DELETE /identity/v3/projects/be51082ee43c40dcb7f32c50e2e961e1 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:07.390486 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82a676-395b-4813-89d7-df4814a42193 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:07.391034 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82a676-395b-4813-89d7-df4814a42193 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:07.391155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82a676-395b-4813-89d7-df4814a42193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:07.420524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-9b82a676-395b-4813-89d7-df4814a42193 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:07.421909 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-9b82a676-395b-4813-89d7-df4814a42193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:07.520140 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1032/2017] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:07.532390 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52adfab-9f87-4075-b193-3eb677a95fb7 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:07.532912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52adfab-9f87-4075-b193-3eb677a95fb7 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:07.533357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52adfab-9f87-4075-b193-3eb677a95fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:07.567553 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-f52adfab-9f87-4075-b193-3eb677a95fb7 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:07.569628 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f52adfab-9f87-4075-b193-3eb677a95fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:07.583478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 986/2018] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:07.589221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82a676-395b-4813-89d7-df4814a42193 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:07.617462 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82a676-395b-4813-89d7-df4814a42193 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:07.625234 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa99255-56c1-4b73-8386-1bf11ab95724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:07.626821 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa99255-56c1-4b73-8386-1bf11ab95724 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:07.626821 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa99255-56c1-4b73-8386-1bf11ab95724 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:07.626821 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa99255-56c1-4b73-8386-1bf11ab95724 admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:07.627327 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa99255-56c1-4b73-8386-1bf11ab95724 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:24:07.627634 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa99255-56c1-4b73-8386-1bf11ab95724 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:07.629338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa99255-56c1-4b73-8386-1bf11ab95724 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:07.642381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1033/2019] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:24:07.649970 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52adfab-9f87-4075-b193-3eb677a95fb7 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:07.661393 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52adfab-9f87-4075-b193-3eb677a95fb7 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:07.676621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01b216-b1d3-4111-9d20-52cac41776af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:07.676621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01b216-b1d3-4111-9d20-52cac41776af admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:07.676621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01b216-b1d3-4111-9d20-52cac41776af admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:07.676621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01b216-b1d3-4111-9d20-52cac41776af admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:07.677029 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01b216-b1d3-4111-9d20-52cac41776af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:07.677029 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01b216-b1d3-4111-9d20-52cac41776af admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:07.793796 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 987/2020] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:24:07 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:24:07.799812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa99255-56c1-4b73-8386-1bf11ab95724 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:07.818143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa99255-56c1-4b73-8386-1bf11ab95724 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:07.894633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44f3c9-712b-47d9-bae3-60b523cf56b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:07.895175 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44f3c9-712b-47d9-bae3-60b523cf56b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:07.895469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44f3c9-712b-47d9-bae3-60b523cf56b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:07.895771 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44f3c9-712b-47d9-bae3-60b523cf56b2 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:07.896419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44f3c9-712b-47d9-bae3-60b523cf56b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:07.898441 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44f3c9-712b-47d9-bae3-60b523cf56b2 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:08.139442 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1034/2021] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:24:07 2022] POST /identity/v3/users => generated 287 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:24:08.145316 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01b216-b1d3-4111-9d20-52cac41776af admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:08.162166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01b216-b1d3-4111-9d20-52cac41776af admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:08.172685 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d30eae-af2b-44c7-9579-d6a5dbfa3e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:08.173304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d30eae-af2b-44c7-9579-d6a5dbfa3e1a admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:08.173588 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d30eae-af2b-44c7-9579-d6a5dbfa3e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:08.173909 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d30eae-af2b-44c7-9579-d6a5dbfa3e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:08.174578 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d30eae-af2b-44c7-9579-d6a5dbfa3e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:08.176207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d30eae-af2b-44c7-9579-d6a5dbfa3e1a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:08.194340 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 988/2022] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:24:08.206130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44f3c9-712b-47d9-bae3-60b523cf56b2 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:08.218902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44f3c9-712b-47d9-bae3-60b523cf56b2 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:08.224166 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599db2b1-2baf-4b2b-ac8f-4b4ac99d2f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:08.224890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599db2b1-2baf-4b2b-ac8f-4b4ac99d2f0b admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:08.225243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599db2b1-2baf-4b2b-ac8f-4b4ac99d2f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:08.225619 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599db2b1-2baf-4b2b-ac8f-4b4ac99d2f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:08.226386 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599db2b1-2baf-4b2b-ac8f-4b4ac99d2f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:08.228948 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599db2b1-2baf-4b2b-ac8f-4b4ac99d2f0b admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:08.242611 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1035/2023] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:24:08.249038 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d30eae-af2b-44c7-9579-d6a5dbfa3e1a admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:08.262459 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d30eae-af2b-44c7-9579-d6a5dbfa3e1a admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:08.269464 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f19c9-350b-4a9c-b89d-c49c3d9ce8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:08.270330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f19c9-350b-4a9c-b89d-c49c3d9ce8c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:08.270765 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f19c9-350b-4a9c-b89d-c49c3d9ce8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:08.271139 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f19c9-350b-4a9c-b89d-c49c3d9ce8c7 admin admin] PATH_INFO: `/v3/projects/e6df86b2b713438ab6050195b4a682ac/users/d49c8a05edd5400eb46734675fbc40fb/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:08.302112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f19c9-350b-4a9c-b89d-c49c3d9ce8c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6df86b2b713438ab6050195b4a682ac, user_id=d49c8a05edd5400eb46734675fbc40fb, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:08.305616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f19c9-350b-4a9c-b89d-c49c3d9ce8c7 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:08.487882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 989/2024] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:24:08 2022] PUT /identity/v3/projects/e6df86b2b713438ab6050195b4a682ac/users/d49c8a05edd5400eb46734675fbc40fb/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:24:08.493597 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c7106-9c91-463f-bc9c-6fc6fd847d2b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:08.494276 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c7106-9c91-463f-bc9c-6fc6fd847d2b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:08.494276 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c7106-9c91-463f-bc9c-6fc6fd847d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:08.517483 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-807c7106-9c91-463f-bc9c-6fc6fd847d2b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:08.518925 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-807c7106-9c91-463f-bc9c-6fc6fd847d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:08.600554 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1036/2025] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:08.611809 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f19c9-350b-4a9c-b89d-c49c3d9ce8c7 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:08.613858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-864f19c9-350b-4a9c-b89d-c49c3d9ce8c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:08.676842 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f19c9-350b-4a9c-b89d-c49c3d9ce8c7 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:08.680596 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4de2d6-09a7-4fbd-a2e8-3090d924e7cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:08.681213 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4de2d6-09a7-4fbd-a2e8-3090d924e7cb service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:08.681496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4de2d6-09a7-4fbd-a2e8-3090d924e7cb service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:08.684554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4de2d6-09a7-4fbd-a2e8-3090d924e7cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:08.693370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4de2d6-09a7-4fbd-a2e8-3090d924e7cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:08.696176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4de2d6-09a7-4fbd-a2e8-3090d924e7cb service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:08.716704 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 990/2026] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:24:08.834897 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:10.351153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:10.799197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ec892-05d3-46c7-9cfd-ec9a14872ad2 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:10.800531 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ec892-05d3-46c7-9cfd-ec9a14872ad2 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:10.801254 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ec892-05d3-46c7-9cfd-ec9a14872ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:10.880833 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-561ec892-05d3-46c7-9cfd-ec9a14872ad2 None None] MFA Rules not processed for user `d49c8a05edd5400eb46734675fbc40fb`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:10.883451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-561ec892-05d3-46c7-9cfd-ec9a14872ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:10.995465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:11.108532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1037/2027] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:11.115715 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4de2d6-09a7-4fbd-a2e8-3090d924e7cb service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:11.128316 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4de2d6-09a7-4fbd-a2e8-3090d924e7cb service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:11.133175 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189845dd-049e-4f03-ba3b-52843520e62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:11.133884 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189845dd-049e-4f03-ba3b-52843520e62e admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:11.134168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189845dd-049e-4f03-ba3b-52843520e62e admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:11.135029 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189845dd-049e-4f03-ba3b-52843520e62e admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:11.135800 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189845dd-049e-4f03-ba3b-52843520e62e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:11.137786 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189845dd-049e-4f03-ba3b-52843520e62e admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:11.160168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:11.293397 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 991/2028] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:24:11 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:24:11.298655 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ec892-05d3-46c7-9cfd-ec9a14872ad2 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:11.311181 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ec892-05d3-46c7-9cfd-ec9a14872ad2 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:11.387384 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8deeef-013a-42b2-85c2-195970b6649d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:11.388017 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8deeef-013a-42b2-85c2-195970b6649d admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:11.388311 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8deeef-013a-42b2-85c2-195970b6649d admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:11.388583 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8deeef-013a-42b2-85c2-195970b6649d admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:11.389432 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8deeef-013a-42b2-85c2-195970b6649d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:11.392147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8deeef-013a-42b2-85c2-195970b6649d admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:11.550009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1038/2029] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:24:11 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:24:11.554743 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189845dd-049e-4f03-ba3b-52843520e62e admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:11.581185 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189845dd-049e-4f03-ba3b-52843520e62e admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:11.587962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850479f-83b9-42a6-a2fe-ea7abe426a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:11.588741 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850479f-83b9-42a6-a2fe-ea7abe426a44 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:11.589127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850479f-83b9-42a6-a2fe-ea7abe426a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:11.589450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850479f-83b9-42a6-a2fe-ea7abe426a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:11.590495 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850479f-83b9-42a6-a2fe-ea7abe426a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:11.592167 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850479f-83b9-42a6-a2fe-ea7abe426a44 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:11.617466 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 992/2030] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:24:11.623176 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8deeef-013a-42b2-85c2-195970b6649d admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:11.633848 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8deeef-013a-42b2-85c2-195970b6649d admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:11.641196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b21c1-e0be-434a-8100-04e316e6bc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:11.642356 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b21c1-e0be-434a-8100-04e316e6bc7b admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:11.642819 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b21c1-e0be-434a-8100-04e316e6bc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:11.643232 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b21c1-e0be-434a-8100-04e316e6bc7b admin admin] PATH_INFO: `/v3/projects/1d98ae47ac95450c800d1fd771f99cd8/users/80211d54d67b45afb4368e8c2a0c49df/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:11.664822 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b21c1-e0be-434a-8100-04e316e6bc7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d98ae47ac95450c800d1fd771f99cd8, user_id=80211d54d67b45afb4368e8c2a0c49df, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:11.668115 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b21c1-e0be-434a-8100-04e316e6bc7b admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:11.824485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1039/2031] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:24:11 2022] PUT /identity/v3/projects/1d98ae47ac95450c800d1fd771f99cd8/users/80211d54d67b45afb4368e8c2a0c49df/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:24:11.828966 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850479f-83b9-42a6-a2fe-ea7abe426a44 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:11.841339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850479f-83b9-42a6-a2fe-ea7abe426a44 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:11.933177 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ab40f-8921-45b4-b2e7-4eac58e82fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:11.933817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ab40f-8921-45b4-b2e7-4eac58e82fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:11.934118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ab40f-8921-45b4-b2e7-4eac58e82fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:11.934403 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ab40f-8921-45b4-b2e7-4eac58e82fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:11.935053 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ab40f-8921-45b4-b2e7-4eac58e82fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:11.936709 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ab40f-8921-45b4-b2e7-4eac58e82fb8 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:11.953300 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 993/2032] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:24:11.954675 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b21c1-e0be-434a-8100-04e316e6bc7b admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:11.967701 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b21c1-e0be-434a-8100-04e316e6bc7b admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:11.975221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbad83b-ebcd-48b0-86ba-102156b11c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:11.977202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbad83b-ebcd-48b0-86ba-102156b11c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:11.977202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbad83b-ebcd-48b0-86ba-102156b11c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:11.977202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbad83b-ebcd-48b0-86ba-102156b11c93 admin admin] PATH_INFO: `/v3/projects/1d98ae47ac95450c800d1fd771f99cd8/users/80211d54d67b45afb4368e8c2a0c49df/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:11.981008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbad83b-ebcd-48b0-86ba-102156b11c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d98ae47ac95450c800d1fd771f99cd8, user_id=80211d54d67b45afb4368e8c2a0c49df, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:11.985925 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbad83b-ebcd-48b0-86ba-102156b11c93 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:12.071253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1040/2033] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:24:11 2022] PUT /identity/v3/projects/1d98ae47ac95450c800d1fd771f99cd8/users/80211d54d67b45afb4368e8c2a0c49df/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:12.247668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:13.160060 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:14.095389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc315-a2b2-42e2-9bc6-1ce4d44dba44 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:14.096034 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc315-a2b2-42e2-9bc6-1ce4d44dba44 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:14.096213 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc315-a2b2-42e2-9bc6-1ce4d44dba44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:14.150431 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-afafc315-a2b2-42e2-9bc6-1ce4d44dba44 None None] MFA Rules not processed for user `80211d54d67b45afb4368e8c2a0c49df`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:14.152466 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-afafc315-a2b2-42e2-9bc6-1ce4d44dba44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:14.330181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 994/2034] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:14.344211 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbad83b-ebcd-48b0-86ba-102156b11c93 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:14.348904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-7bbad83b-ebcd-48b0-86ba-102156b11c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:14.444609 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbad83b-ebcd-48b0-86ba-102156b11c93 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:14.449307 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa05c2-013e-432c-915b-2a4889784e70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:14.449955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa05c2-013e-432c-915b-2a4889784e70 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:14.450243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa05c2-013e-432c-915b-2a4889784e70 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:14.450518 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa05c2-013e-432c-915b-2a4889784e70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:14.533800 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa05c2-013e-432c-915b-2a4889784e70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:14.536071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa05c2-013e-432c-915b-2a4889784e70 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:14.551408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1041/2035] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:24:14.600035 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:15.166247 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:17.472468 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafc315-a2b2-42e2-9bc6-1ce4d44dba44 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:17.474968 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-afafc315-a2b2-42e2-9bc6-1ce4d44dba44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:17.490925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafc315-a2b2-42e2-9bc6-1ce4d44dba44 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:17.495214 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b210a93-cc92-41e0-a163-5b460895abad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:17.495849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b210a93-cc92-41e0-a163-5b460895abad service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:17.496135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b210a93-cc92-41e0-a163-5b460895abad service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:17.496428 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b210a93-cc92-41e0-a163-5b460895abad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:17.506273 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b210a93-cc92-41e0-a163-5b460895abad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:17.507715 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b210a93-cc92-41e0-a163-5b460895abad service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:17.518282 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 995/2036] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:24:17.664271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:18.457663 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:19.867869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:20.052482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:20.631736 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:20.862223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:21.927256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:22.205968 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:24.011841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:24.292792 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:26.107921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:26.199243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa05c2-013e-432c-915b-2a4889784e70 service cinder] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:26.200799 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-abfa05c2-013e-432c-915b-2a4889784e70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:26.309999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa05c2-013e-432c-915b-2a4889784e70 service cinder] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:26.317526 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb482f8f-455f-4163-b79b-1a8e2d816fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:26.318655 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb482f8f-455f-4163-b79b-1a8e2d816fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:26.319307 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb482f8f-455f-4163-b79b-1a8e2d816fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:26.319812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb482f8f-455f-4163-b79b-1a8e2d816fd2 admin admin] PATH_INFO: `/v3/users/d2295752945b440787e7c8c226347d49` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:26.323186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb482f8f-455f-4163-b79b-1a8e2d816fd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2295752945b440787e7c8c226347d49)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:26.327762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb482f8f-455f-4163-b79b-1a8e2d816fd2 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:26.666040 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-cb482f8f-455f-4163-b79b-1a8e2d816fd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2295752945b440787e7c8c226347d49'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:26.667149 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-cb482f8f-455f-4163-b79b-1a8e2d816fd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2295752945b440787e7c8c226347d49'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:26.715719 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-cb482f8f-455f-4163-b79b-1a8e2d816fd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2295752945b440787e7c8c226347d49'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:26.740800 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-cb482f8f-455f-4163-b79b-1a8e2d816fd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2295752945b440787e7c8c226347d49'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:26.742733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-cb482f8f-455f-4163-b79b-1a8e2d816fd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2295752945b440787e7c8c226347d49'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:26.923037 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1042/2037] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:24:26 2022] DELETE /identity/v3/users/d2295752945b440787e7c8c226347d49 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:26.930949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288aab3-0790-43bc-b17a-347db2911915 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:26.932069 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288aab3-0790-43bc-b17a-347db2911915 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:26.932643 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288aab3-0790-43bc-b17a-347db2911915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:26.967476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:26.996332 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-b288aab3-0790-43bc-b17a-347db2911915 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:26.999059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-b288aab3-0790-43bc-b17a-347db2911915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:27.123401 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 996/2038] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:27.137039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb482f8f-455f-4163-b79b-1a8e2d816fd2 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:27.140422 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-cb482f8f-455f-4163-b79b-1a8e2d816fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:27.269070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb482f8f-455f-4163-b79b-1a8e2d816fd2 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:27.279674 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d8738-a586-4a7b-b7bd-14a6e511a64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:27.283947 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d8738-a586-4a7b-b7bd-14a6e511a64f service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:27.286145 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d8738-a586-4a7b-b7bd-14a6e511a64f service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:27.287511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d8738-a586-4a7b-b7bd-14a6e511a64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:27.317614 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d8738-a586-4a7b-b7bd-14a6e511a64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:27.322321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d8738-a586-4a7b-b7bd-14a6e511a64f service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:27.349728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1043/2039] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:24:28.486615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288aab3-0790-43bc-b17a-347db2911915 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:28.489133 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-b288aab3-0790-43bc-b17a-347db2911915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:28.530516 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288aab3-0790-43bc-b17a-347db2911915 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:28.538794 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae328e0-7e0c-4e27-aefc-8424f554cef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:28.540116 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae328e0-7e0c-4e27-aefc-8424f554cef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:28.540713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae328e0-7e0c-4e27-aefc-8424f554cef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:28.541490 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae328e0-7e0c-4e27-aefc-8424f554cef9 admin admin] PATH_INFO: `/v3/projects/e43f0a0ef84e47799bfc95e2cbca5b24` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:28.544695 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae328e0-7e0c-4e27-aefc-8424f554cef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e43f0a0ef84e47799bfc95e2cbca5b24)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:28.550849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae328e0-7e0c-4e27-aefc-8424f554cef9 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:28.837207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-aae328e0-7e0c-4e27-aefc-8424f554cef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e43f0a0ef84e47799bfc95e2cbca5b24', 'request_id': 'req-aae328e0-7e0c-4e27-aefc-8424f554cef9'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:28.848727 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-aae328e0-7e0c-4e27-aefc-8424f554cef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e43f0a0ef84e47799bfc95e2cbca5b24', 'request_id': 'req-aae328e0-7e0c-4e27-aefc-8424f554cef9'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:28.863647 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-aae328e0-7e0c-4e27-aefc-8424f554cef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e43f0a0ef84e47799bfc95e2cbca5b24', 'request_id': 'req-aae328e0-7e0c-4e27-aefc-8424f554cef9'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:29.038149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-aae328e0-7e0c-4e27-aefc-8424f554cef9 admin admin] The token cache is being invalidate because project e43f0a0ef84e47799bfc95e2cbca5b24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:24:29.038978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-aae328e0-7e0c-4e27-aefc-8424f554cef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:29.040342 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-aae328e0-7e0c-4e27-aefc-8424f554cef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:29.045871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 997/2040] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:24:28 2022] DELETE /identity/v3/projects/e43f0a0ef84e47799bfc95e2cbca5b24 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:29.048024 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d8738-a586-4a7b-b7bd-14a6e511a64f service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:29.061150 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d8738-a586-4a7b-b7bd-14a6e511a64f service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:29.156832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988c503-2106-4e82-850d-21f28fd774fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:29.157531 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988c503-2106-4e82-850d-21f28fd774fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:29.157859 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988c503-2106-4e82-850d-21f28fd774fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:29.158119 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988c503-2106-4e82-850d-21f28fd774fb admin admin] PATH_INFO: `/v3/users/193490af62044c5bb94b5b958ac58ddb` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:29.160100 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988c503-2106-4e82-850d-21f28fd774fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=193490af62044c5bb94b5b958ac58ddb)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:29.162529 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988c503-2106-4e82-850d-21f28fd774fb admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:29.802826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-3988c503-2106-4e82-850d-21f28fd774fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '193490af62044c5bb94b5b958ac58ddb'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:29.803740 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-3988c503-2106-4e82-850d-21f28fd774fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '193490af62044c5bb94b5b958ac58ddb'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:29.821497 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-3988c503-2106-4e82-850d-21f28fd774fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '193490af62044c5bb94b5b958ac58ddb'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:29.832276 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-3988c503-2106-4e82-850d-21f28fd774fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '193490af62044c5bb94b5b958ac58ddb'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:29.834590 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-3988c503-2106-4e82-850d-21f28fd774fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '193490af62044c5bb94b5b958ac58ddb'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:30.073069 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1044/2041] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:24:29 2022] DELETE /identity/v3/users/193490af62044c5bb94b5b958ac58ddb => generated 0 bytes in 1022 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:30.574534 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae328e0-7e0c-4e27-aefc-8424f554cef9 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:30.577681 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-aae328e0-7e0c-4e27-aefc-8424f554cef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:30.597194 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae328e0-7e0c-4e27-aefc-8424f554cef9 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:30.687633 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b575b-dc4b-4bb4-af25-9668ab8ef12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:30.688897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b575b-dc4b-4bb4-af25-9668ab8ef12d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:30.689400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b575b-dc4b-4bb4-af25-9668ab8ef12d admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:30.690038 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b575b-dc4b-4bb4-af25-9668ab8ef12d admin admin] PATH_INFO: `/v3/users/d5c0123ca64b4ee1af791b5bc70cadd9` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:30.692182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b575b-dc4b-4bb4-af25-9668ab8ef12d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5c0123ca64b4ee1af791b5bc70cadd9)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:30.694773 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b575b-dc4b-4bb4-af25-9668ab8ef12d admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:30.987375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988c503-2106-4e82-850d-21f28fd774fb admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:30.989743 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-3988c503-2106-4e82-850d-21f28fd774fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:31.013776 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988c503-2106-4e82-850d-21f28fd774fb admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:31.023382 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0c36c-5121-44db-b7a1-c4536962c6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:31.024354 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0c36c-5121-44db-b7a1-c4536962c6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:31.029676 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0c36c-5121-44db-b7a1-c4536962c6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:31.029676 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0c36c-5121-44db-b7a1-c4536962c6c5 admin admin] PATH_INFO: `/v3/users/02bf6738503a44b0908ecd38116842d2` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:31.029676 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0c36c-5121-44db-b7a1-c4536962c6c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02bf6738503a44b0908ecd38116842d2)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:31.029676 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0c36c-5121-44db-b7a1-c4536962c6c5 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:31.090268 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-1c0b575b-dc4b-4bb4-af25-9668ab8ef12d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5c0123ca64b4ee1af791b5bc70cadd9'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:31.091402 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-1c0b575b-dc4b-4bb4-af25-9668ab8ef12d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5c0123ca64b4ee1af791b5bc70cadd9'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:31.099294 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-1c0b575b-dc4b-4bb4-af25-9668ab8ef12d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5c0123ca64b4ee1af791b5bc70cadd9'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:31.120848 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-1c0b575b-dc4b-4bb4-af25-9668ab8ef12d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5c0123ca64b4ee1af791b5bc70cadd9'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:31.122628 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-1c0b575b-dc4b-4bb4-af25-9668ab8ef12d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5c0123ca64b4ee1af791b5bc70cadd9'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:31.225707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:31.231333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 998/2042] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:24:30 2022] DELETE /identity/v3/users/d5c0123ca64b4ee1af791b5bc70cadd9 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:31.232221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b575b-dc4b-4bb4-af25-9668ab8ef12d admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:31.233691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-1c0b575b-dc4b-4bb4-af25-9668ab8ef12d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:31.345200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b575b-dc4b-4bb4-af25-9668ab8ef12d admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:31.353110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732afe1-10e5-4ee9-a4c1-d5e1ce357f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:31.354263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732afe1-10e5-4ee9-a4c1-d5e1ce357f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:31.355002 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732afe1-10e5-4ee9-a4c1-d5e1ce357f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:31.355494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732afe1-10e5-4ee9-a4c1-d5e1ce357f7d admin admin] PATH_INFO: `/v3/projects/78dca602c0b64a94ab4d65a798538da6` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:31.357515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732afe1-10e5-4ee9-a4c1-d5e1ce357f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=78dca602c0b64a94ab4d65a798538da6)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:31.360743 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732afe1-10e5-4ee9-a4c1-d5e1ce357f7d admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:31.418695 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-40d0c36c-5121-44db-b7a1-c4536962c6c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02bf6738503a44b0908ecd38116842d2'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:31.419676 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-40d0c36c-5121-44db-b7a1-c4536962c6c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02bf6738503a44b0908ecd38116842d2'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:31.441798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-40d0c36c-5121-44db-b7a1-c4536962c6c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02bf6738503a44b0908ecd38116842d2'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:31.454039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-40d0c36c-5121-44db-b7a1-c4536962c6c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02bf6738503a44b0908ecd38116842d2'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:31.455486 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-40d0c36c-5121-44db-b7a1-c4536962c6c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02bf6738503a44b0908ecd38116842d2'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:31.578114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-0732afe1-10e5-4ee9-a4c1-d5e1ce357f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78dca602c0b64a94ab4d65a798538da6', 'request_id': 'req-0732afe1-10e5-4ee9-a4c1-d5e1ce357f7d'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:31.593137 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-0732afe1-10e5-4ee9-a4c1-d5e1ce357f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78dca602c0b64a94ab4d65a798538da6', 'request_id': 'req-0732afe1-10e5-4ee9-a4c1-d5e1ce357f7d'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:31.600213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1045/2043] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:24:30 2022] DELETE /identity/v3/users/02bf6738503a44b0908ecd38116842d2 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:31.600213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9b281-9c15-435b-b60b-6f3dbf020a48 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:31.600213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9b281-9c15-435b-b60b-6f3dbf020a48 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:31.603669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-0732afe1-10e5-4ee9-a4c1-d5e1ce357f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78dca602c0b64a94ab4d65a798538da6', 'request_id': 'req-0732afe1-10e5-4ee9-a4c1-d5e1ce357f7d'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:31.608093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9b281-9c15-435b-b60b-6f3dbf020a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:31.638807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-b6c9b281-9c15-435b-b60b-6f3dbf020a48 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:31.640961 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b6c9b281-9c15-435b-b60b-6f3dbf020a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:31.739037 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1046/2044] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:31.752281 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9b281-9c15-435b-b60b-6f3dbf020a48 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:31.759480 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b6c9b281-9c15-435b-b60b-6f3dbf020a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:31.776514 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-0732afe1-10e5-4ee9-a4c1-d5e1ce357f7d admin admin] The token cache is being invalidate because project 78dca602c0b64a94ab4d65a798538da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:24:31.777298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-0732afe1-10e5-4ee9-a4c1-d5e1ce357f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:31.778502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-0732afe1-10e5-4ee9-a4c1-d5e1ce357f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:31.780891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 999/2045] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:24:31 2022] DELETE /identity/v3/projects/78dca602c0b64a94ab4d65a798538da6 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:31.787689 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ad9a0-fd88-41c4-be70-037ed8bba7c7 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:31.788325 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ad9a0-fd88-41c4-be70-037ed8bba7c7 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:31.788818 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ad9a0-fd88-41c4-be70-037ed8bba7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:31.827628 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-456ad9a0-fd88-41c4-be70-037ed8bba7c7 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:31.829454 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-456ad9a0-fd88-41c4-be70-037ed8bba7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:31.845164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1000/2046] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:31.858869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8deed4-ce2d-4f7e-b376-865e92370d71 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:31.859286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8deed4-ce2d-4f7e-b376-865e92370d71 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:31.859966 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8deed4-ce2d-4f7e-b376-865e92370d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:31.865539 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9b281-9c15-435b-b60b-6f3dbf020a48 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:31.871745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d544df-5a60-4b29-b80c-fec8a1d3cc7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:31.872852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d544df-5a60-4b29-b80c-fec8a1d3cc7c service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:31.873261 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d544df-5a60-4b29-b80c-fec8a1d3cc7c service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:31.873733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d544df-5a60-4b29-b80c-fec8a1d3cc7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:31.876551 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b5d544df-5a60-4b29-b80c-fec8a1d3cc7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:31.893254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-2c8deed4-ce2d-4f7e-b376-865e92370d71 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:31.893254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-2c8deed4-ce2d-4f7e-b376-865e92370d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:31.899292 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d544df-5a60-4b29-b80c-fec8a1d3cc7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:31.900527 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1001/2047] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:24:31.904233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d544df-5a60-4b29-b80c-fec8a1d3cc7c service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:31.905941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8deed4-ce2d-4f7e-b376-865e92370d71 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:31.919215 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1047/2048] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:24:31.923675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8deed4-ce2d-4f7e-b376-865e92370d71 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:31.933043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8de69e-3d3d-4e62-b588-ef3a1fd97189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:31.933697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8de69e-3d3d-4e62-b588-ef3a1fd97189 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:31.934084 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8de69e-3d3d-4e62-b588-ef3a1fd97189 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:31.934398 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8de69e-3d3d-4e62-b588-ef3a1fd97189 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:31.935219 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8de69e-3d3d-4e62-b588-ef3a1fd97189 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:24:31.935612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8de69e-3d3d-4e62-b588-ef3a1fd97189 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:31.937295 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8de69e-3d3d-4e62-b588-ef3a1fd97189 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:31.961609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1002/2049] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:24:31.966304 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d544df-5a60-4b29-b80c-fec8a1d3cc7c service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:31.979903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d544df-5a60-4b29-b80c-fec8a1d3cc7c service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:31.985440 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfbc7c-a8c4-45a4-b09e-b3037c61af19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:31.986199 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfbc7c-a8c4-45a4-b09e-b3037c61af19 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:31.986502 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfbc7c-a8c4-45a4-b09e-b3037c61af19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:31.986779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfbc7c-a8c4-45a4-b09e-b3037c61af19 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:31.987518 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfbc7c-a8c4-45a4-b09e-b3037c61af19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:31.989491 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfbc7c-a8c4-45a4-b09e-b3037c61af19 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:32.144179 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8de69e-3d3d-4e62-b588-ef3a1fd97189 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:32.147093 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-4d8de69e-3d3d-4e62-b588-ef3a1fd97189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:32.185640 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8de69e-3d3d-4e62-b588-ef3a1fd97189 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:32.199124 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4b31d-4701-43b6-88ae-74e952862aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:32.200214 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4b31d-4701-43b6-88ae-74e952862aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:32.200862 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4b31d-4701-43b6-88ae-74e952862aae admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:32.201213 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4b31d-4701-43b6-88ae-74e952862aae admin admin] PATH_INFO: `/v3/projects/90aa668555c54d508063d931dba2d751` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:32.210466 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4b31d-4701-43b6-88ae-74e952862aae admin admin] RBAC: Authorizing `identity:delete_project(project_id=90aa668555c54d508063d931dba2d751)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:32.215738 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4b31d-4701-43b6-88ae-74e952862aae admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:32.283920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1048/2050] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:24:31 2022] POST /identity/v3/projects => generated 377 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:24:32.286488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfbc7c-a8c4-45a4-b09e-b3037c61af19 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:32.418428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfbc7c-a8c4-45a4-b09e-b3037c61af19 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:32.428040 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc863209-1d7b-4a6d-8484-34d9097703a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:32.429107 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc863209-1d7b-4a6d-8484-34d9097703a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:32.429642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc863209-1d7b-4a6d-8484-34d9097703a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:32.430193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc863209-1d7b-4a6d-8484-34d9097703a8 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:32.431382 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc863209-1d7b-4a6d-8484-34d9097703a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:32.435208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc863209-1d7b-4a6d-8484-34d9097703a8 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:32.484592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2bf4b31d-4701-43b6-88ae-74e952862aae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90aa668555c54d508063d931dba2d751', 'request_id': 'req-2bf4b31d-4701-43b6-88ae-74e952862aae'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:32.497618 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2bf4b31d-4701-43b6-88ae-74e952862aae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90aa668555c54d508063d931dba2d751', 'request_id': 'req-2bf4b31d-4701-43b6-88ae-74e952862aae'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:32.510354 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2bf4b31d-4701-43b6-88ae-74e952862aae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90aa668555c54d508063d931dba2d751', 'request_id': 'req-2bf4b31d-4701-43b6-88ae-74e952862aae'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:32.685910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2bf4b31d-4701-43b6-88ae-74e952862aae admin admin] The token cache is being invalidate because project 90aa668555c54d508063d931dba2d751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:24:32.687512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1049/2051] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:24:32 2022] POST /identity/v3/users => generated 289 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:24:32.694982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc863209-1d7b-4a6d-8484-34d9097703a8 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:32.702648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2bf4b31d-4701-43b6-88ae-74e952862aae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:32.703659 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2bf4b31d-4701-43b6-88ae-74e952862aae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:32.719176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1003/2052] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:24:32 2022] DELETE /identity/v3/projects/90aa668555c54d508063d931dba2d751 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:32.721150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90c04d-a709-43ee-b210-4d1336d5aff9 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:32.722220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90c04d-a709-43ee-b210-4d1336d5aff9 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:32.723607 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90c04d-a709-43ee-b210-4d1336d5aff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:32.745638 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc863209-1d7b-4a6d-8484-34d9097703a8 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:32.760984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-fe90c04d-a709-43ee-b210-4d1336d5aff9 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:32.763983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-fe90c04d-a709-43ee-b210-4d1336d5aff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:32.907758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1004/2053] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:32.917325 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90c04d-a709-43ee-b210-4d1336d5aff9 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:32.917325 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-fe90c04d-a709-43ee-b210-4d1336d5aff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:32.917626 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb61deb-fe9a-4b84-8274-ecbb695516f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:32.917626 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb61deb-fe9a-4b84-8274-ecbb695516f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:32.917626 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb61deb-fe9a-4b84-8274-ecbb695516f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:32.917626 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb61deb-fe9a-4b84-8274-ecbb695516f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:32.918128 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb61deb-fe9a-4b84-8274-ecbb695516f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:32.923784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb61deb-fe9a-4b84-8274-ecbb695516f3 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:32.925401 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90c04d-a709-43ee-b210-4d1336d5aff9 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:32.933109 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e449c3e-62e4-42eb-b949-bea8af05e29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:32.934059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e449c3e-62e4-42eb-b949-bea8af05e29a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:32.934694 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e449c3e-62e4-42eb-b949-bea8af05e29a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:32.935734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e449c3e-62e4-42eb-b949-bea8af05e29a admin admin] PATH_INFO: `/v3/projects/5e882ad5c7504557844491fab2ee4444` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:32.938637 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e449c3e-62e4-42eb-b949-bea8af05e29a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e882ad5c7504557844491fab2ee4444)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:32.943494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:32.951148 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1050/2054] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:24:32.951148 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddadb3-fad1-48f1-acfb-21a4761c3283 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:32.951304 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e449c3e-62e4-42eb-b949-bea8af05e29a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:32.951379 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddadb3-fad1-48f1-acfb-21a4761c3283 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:32.951379 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddadb3-fad1-48f1-acfb-21a4761c3283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:32.987905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-cfddadb3-fad1-48f1-acfb-21a4761c3283 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:32.990249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-cfddadb3-fad1-48f1-acfb-21a4761c3283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:33.003639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1051/2055] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:33.005147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddadb3-fad1-48f1-acfb-21a4761c3283 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:33.007527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-cfddadb3-fad1-48f1-acfb-21a4761c3283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:33.025080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddadb3-fad1-48f1-acfb-21a4761c3283 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:33.034132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a62a3-25a0-4c10-8c4a-c994e382ce36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:33.035218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a62a3-25a0-4c10-8c4a-c994e382ce36 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:33.035713 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a62a3-25a0-4c10-8c4a-c994e382ce36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:33.036215 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a62a3-25a0-4c10-8c4a-c994e382ce36 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:33.037651 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a62a3-25a0-4c10-8c4a-c994e382ce36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:33.041798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a62a3-25a0-4c10-8c4a-c994e382ce36 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:33.065129 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1052/2056] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:24:33.067676 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a62a3-25a0-4c10-8c4a-c994e382ce36 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:33.090357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a62a3-25a0-4c10-8c4a-c994e382ce36 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:33.098078 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b7cc3-fb2b-4f04-b40d-8c27c1a9f273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:33.098734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b7cc3-fb2b-4f04-b40d-8c27c1a9f273 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:33.099020 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b7cc3-fb2b-4f04-b40d-8c27c1a9f273 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:33.099338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b7cc3-fb2b-4f04-b40d-8c27c1a9f273 admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:33.100263 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b7cc3-fb2b-4f04-b40d-8c27c1a9f273 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:24:33.100583 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b7cc3-fb2b-4f04-b40d-8c27c1a9f273 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:33.104136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b7cc3-fb2b-4f04-b40d-8c27c1a9f273 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:33.129218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1053/2057] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:24:33.130221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b7cc3-fb2b-4f04-b40d-8c27c1a9f273 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:33.146455 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b7cc3-fb2b-4f04-b40d-8c27c1a9f273 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:33.152500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abd0bf-94fd-40c8-b438-5eae2448ca49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:33.153227 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abd0bf-94fd-40c8-b438-5eae2448ca49 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:33.153729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abd0bf-94fd-40c8-b438-5eae2448ca49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:33.154036 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abd0bf-94fd-40c8-b438-5eae2448ca49 admin admin] PATH_INFO: `/v3/projects/66288fdaf8504842a91cf26e197693da/users/ed5b3792ab6c49988f6cf13d07c3cb6b/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:33.182218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abd0bf-94fd-40c8-b438-5eae2448ca49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66288fdaf8504842a91cf26e197693da, user_id=ed5b3792ab6c49988f6cf13d07c3cb6b, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:33.185090 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abd0bf-94fd-40c8-b438-5eae2448ca49 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:33.404328 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1054/2058] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:24:33 2022] PUT /identity/v3/projects/66288fdaf8504842a91cf26e197693da/users/ed5b3792ab6c49988f6cf13d07c3cb6b/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:33.406379 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abd0bf-94fd-40c8-b438-5eae2448ca49 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:33.422580 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-8e449c3e-62e4-42eb-b949-bea8af05e29a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e882ad5c7504557844491fab2ee4444', 'request_id': 'req-8e449c3e-62e4-42eb-b949-bea8af05e29a'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:33.449893 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-8e449c3e-62e4-42eb-b949-bea8af05e29a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e882ad5c7504557844491fab2ee4444', 'request_id': 'req-8e449c3e-62e4-42eb-b949-bea8af05e29a'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:33.462568 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-8e449c3e-62e4-42eb-b949-bea8af05e29a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e882ad5c7504557844491fab2ee4444', 'request_id': 'req-8e449c3e-62e4-42eb-b949-bea8af05e29a'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:33.527940 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abd0bf-94fd-40c8-b438-5eae2448ca49 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:33.580277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-8e449c3e-62e4-42eb-b949-bea8af05e29a admin admin] The token cache is being invalidate because project 5e882ad5c7504557844491fab2ee4444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:24:33.580765 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-8e449c3e-62e4-42eb-b949-bea8af05e29a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:33.581953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-8e449c3e-62e4-42eb-b949-bea8af05e29a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:33.584617 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1005/2059] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:24:32 2022] DELETE /identity/v3/projects/5e882ad5c7504557844491fab2ee4444 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:33.586599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414b8c0-6a33-42b9-9da5-0e86277275ef None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:33.587405 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414b8c0-6a33-42b9-9da5-0e86277275ef None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:33.587912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414b8c0-6a33-42b9-9da5-0e86277275ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:33.615517 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea91147-9682-4cdf-a6de-8b4829c4fbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:33.616151 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea91147-9682-4cdf-a6de-8b4829c4fbe2 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:33.616528 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea91147-9682-4cdf-a6de-8b4829c4fbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:33.616804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea91147-9682-4cdf-a6de-8b4829c4fbe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:33.618451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea91147-9682-4cdf-a6de-8b4829c4fbe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:33.621348 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea91147-9682-4cdf-a6de-8b4829c4fbe2 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:33.635871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-e414b8c0-6a33-42b9-9da5-0e86277275ef None None] MFA Rules not processed for user `ed5b3792ab6c49988f6cf13d07c3cb6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:33.637264 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e414b8c0-6a33-42b9-9da5-0e86277275ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:33.757172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1006/2060] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:33.759128 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be9b13-f933-449c-879b-5d22943f5826 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:33.759423 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be9b13-f933-449c-879b-5d22943f5826 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:33.760444 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be9b13-f933-449c-879b-5d22943f5826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:33.786350 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-11be9b13-f933-449c-879b-5d22943f5826 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:33.787954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-11be9b13-f933-449c-879b-5d22943f5826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:33.799616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1007/2061] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:33.800656 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be9b13-f933-449c-879b-5d22943f5826 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:33.807125 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1055/2062] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:24:33 2022] POST /identity/v3/projects => generated 373 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:24:33.810629 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-11be9b13-f933-449c-879b-5d22943f5826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:33.812028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e404727-9cb0-49d6-9c2d-a91398970b3f None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:33.812502 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e404727-9cb0-49d6-9c2d-a91398970b3f None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:33.812966 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e404727-9cb0-49d6-9c2d-a91398970b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:33.827210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be9b13-f933-449c-879b-5d22943f5826 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:33.839600 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-4e404727-9cb0-49d6-9c2d-a91398970b3f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:33.841090 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-4e404727-9cb0-49d6-9c2d-a91398970b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:33.927549 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee3bf4-5989-4b1f-afe1-12bc76efd38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:33.928168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee3bf4-5989-4b1f-afe1-12bc76efd38e admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:33.928715 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee3bf4-5989-4b1f-afe1-12bc76efd38e admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:33.929057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee3bf4-5989-4b1f-afe1-12bc76efd38e admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:33.932036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee3bf4-5989-4b1f-afe1-12bc76efd38e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:33.933179 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee3bf4-5989-4b1f-afe1-12bc76efd38e admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:33.948437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1056/2063] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:24:33.949495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e404727-9cb0-49d6-9c2d-a91398970b3f None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:33.954087 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-4e404727-9cb0-49d6-9c2d-a91398970b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:33.968050 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e404727-9cb0-49d6-9c2d-a91398970b3f None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:33.973049 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f48b33-8b2a-4840-abc2-b7ffb0c674e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:33.973721 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f48b33-8b2a-4840-abc2-b7ffb0c674e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:33.974064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f48b33-8b2a-4840-abc2-b7ffb0c674e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:33.974350 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f48b33-8b2a-4840-abc2-b7ffb0c674e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:33.975007 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f48b33-8b2a-4840-abc2-b7ffb0c674e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:33.977603 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f48b33-8b2a-4840-abc2-b7ffb0c674e7 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:34.272197 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1008/2064] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:24:33 2022] POST /identity/v3/projects => generated 377 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:24:34.273880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee3bf4-5989-4b1f-afe1-12bc76efd38e admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:34.313908 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1057/2065] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:24:33 2022] POST /identity/v3/users => generated 287 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:24:34.314672 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f48b33-8b2a-4840-abc2-b7ffb0c674e7 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:34.328820 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f48b33-8b2a-4840-abc2-b7ffb0c674e7 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:34.420644 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2234e-1fc0-40f6-b01c-6d26f7b6e146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:34.421630 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2234e-1fc0-40f6-b01c-6d26f7b6e146 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:34.421942 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2234e-1fc0-40f6-b01c-6d26f7b6e146 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:34.422657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2234e-1fc0-40f6-b01c-6d26f7b6e146 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:34.423493 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2234e-1fc0-40f6-b01c-6d26f7b6e146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:34.425774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2234e-1fc0-40f6-b01c-6d26f7b6e146 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:34.478983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee3bf4-5989-4b1f-afe1-12bc76efd38e admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:34.487943 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a445bfb-f4a1-4e3b-8853-cf8b1f96f3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:34.489018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a445bfb-f4a1-4e3b-8853-cf8b1f96f3cb admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:34.489504 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a445bfb-f4a1-4e3b-8853-cf8b1f96f3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:34.490163 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a445bfb-f4a1-4e3b-8853-cf8b1f96f3cb admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:34.491755 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a445bfb-f4a1-4e3b-8853-cf8b1f96f3cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:24:34.497489 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a445bfb-f4a1-4e3b-8853-cf8b1f96f3cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:34.497489 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a445bfb-f4a1-4e3b-8853-cf8b1f96f3cb admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:34.522119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1009/2066] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:24:34.522119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a445bfb-f4a1-4e3b-8853-cf8b1f96f3cb admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:34.544173 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a445bfb-f4a1-4e3b-8853-cf8b1f96f3cb admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:34.553319 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bba32a-8169-45a4-8e03-c8afef25d69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:34.555110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bba32a-8169-45a4-8e03-c8afef25d69e admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:34.555684 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bba32a-8169-45a4-8e03-c8afef25d69e admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:34.556318 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bba32a-8169-45a4-8e03-c8afef25d69e admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:34.558065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bba32a-8169-45a4-8e03-c8afef25d69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:34.561195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bba32a-8169-45a4-8e03-c8afef25d69e admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:34.583519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1010/2067] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:24:34.584702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bba32a-8169-45a4-8e03-c8afef25d69e admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:34.598760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bba32a-8169-45a4-8e03-c8afef25d69e admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:34.610358 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff192ba-ba6f-4a08-90f9-625b13d15eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:34.611581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff192ba-ba6f-4a08-90f9-625b13d15eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:34.611897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff192ba-ba6f-4a08-90f9-625b13d15eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:34.615639 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff192ba-ba6f-4a08-90f9-625b13d15eb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:34.615639 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff192ba-ba6f-4a08-90f9-625b13d15eb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:34.618088 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff192ba-ba6f-4a08-90f9-625b13d15eb5 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:34.620037 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1058/2068] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:24:34 2022] POST /identity/v3/users => generated 295 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:24:34.621381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2234e-1fc0-40f6-b01c-6d26f7b6e146 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:34.634675 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2234e-1fc0-40f6-b01c-6d26f7b6e146 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:34.642964 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bea3b9-29a4-4d08-b94f-657dafe3bca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:34.644100 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bea3b9-29a4-4d08-b94f-657dafe3bca9 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:34.644100 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bea3b9-29a4-4d08-b94f-657dafe3bca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:34.644727 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bea3b9-29a4-4d08-b94f-657dafe3bca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:34.647637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bea3b9-29a4-4d08-b94f-657dafe3bca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:34.648421 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bea3b9-29a4-4d08-b94f-657dafe3bca9 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:34.667922 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1059/2069] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:24:34.668914 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bea3b9-29a4-4d08-b94f-657dafe3bca9 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:34.682687 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bea3b9-29a4-4d08-b94f-657dafe3bca9 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:34.687229 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081567aa-6215-4869-9943-04d310db03bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:34.687773 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081567aa-6215-4869-9943-04d310db03bb admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:34.688100 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081567aa-6215-4869-9943-04d310db03bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:34.688377 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081567aa-6215-4869-9943-04d310db03bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:34.689032 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081567aa-6215-4869-9943-04d310db03bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:34.690800 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081567aa-6215-4869-9943-04d310db03bb admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:34.705058 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1060/2070] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:24:34.706183 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081567aa-6215-4869-9943-04d310db03bb admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:34.724985 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081567aa-6215-4869-9943-04d310db03bb admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:34.737048 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30341783-6915-4e06-ac1f-98fadb80ea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:34.738342 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30341783-6915-4e06-ac1f-98fadb80ea6f admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:34.738787 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30341783-6915-4e06-ac1f-98fadb80ea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:34.739286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30341783-6915-4e06-ac1f-98fadb80ea6f admin admin] PATH_INFO: `/v3/projects/87c7b1832bef4bd6bda46ceb7bacd8ae/users/df2d0289a0b24fbfa4fc4a9ddf2f78f5/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:34.763282 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30341783-6915-4e06-ac1f-98fadb80ea6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c7b1832bef4bd6bda46ceb7bacd8ae, user_id=df2d0289a0b24fbfa4fc4a9ddf2f78f5, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:34.767792 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30341783-6915-4e06-ac1f-98fadb80ea6f admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:34.878357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1061/2071] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:24:34 2022] PUT /identity/v3/projects/87c7b1832bef4bd6bda46ceb7bacd8ae/users/df2d0289a0b24fbfa4fc4a9ddf2f78f5/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:34.880254 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30341783-6915-4e06-ac1f-98fadb80ea6f admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:34.889522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1011/2072] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:24:34 2022] POST /identity/v3/projects => generated 377 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:24:34.892283 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff192ba-ba6f-4a08-90f9-625b13d15eb5 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:35.013090 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30341783-6915-4e06-ac1f-98fadb80ea6f admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:35.044430 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff192ba-ba6f-4a08-90f9-625b13d15eb5 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:35.053133 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4433778-dda5-462d-b379-9cc595d23bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:35.054235 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4433778-dda5-462d-b379-9cc595d23bbf admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:35.054786 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4433778-dda5-462d-b379-9cc595d23bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:35.055446 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4433778-dda5-462d-b379-9cc595d23bbf admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:35.056790 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4433778-dda5-462d-b379-9cc595d23bbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:35.061361 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4433778-dda5-462d-b379-9cc595d23bbf admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:35.095589 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdb55e-cbe1-44ab-a83a-66e4353195e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:35.096624 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdb55e-cbe1-44ab-a83a-66e4353195e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:35.096994 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdb55e-cbe1-44ab-a83a-66e4353195e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:35.097426 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdb55e-cbe1-44ab-a83a-66e4353195e7 admin admin] PATH_INFO: `/v3/projects/f8cb7afb037d4c639a33bd46fdf30517/users/543a66ead0794e04b04ae93bcf463097/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:35.115509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bdb55e-cbe1-44ab-a83a-66e4353195e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8cb7afb037d4c639a33bd46fdf30517, user_id=543a66ead0794e04b04ae93bcf463097, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:35.119909 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bdb55e-cbe1-44ab-a83a-66e4353195e7 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:35.151882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1012/2073] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:24:34 2022] POST /identity/v3/users => generated 289 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:24:35.153845 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82fd0d-1eb9-468f-b0d3-066b9d6713ea None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:35.154385 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82fd0d-1eb9-468f-b0d3-066b9d6713ea None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:35.154705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82fd0d-1eb9-468f-b0d3-066b9d6713ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:35.188041 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-bb82fd0d-1eb9-468f-b0d3-066b9d6713ea None None] MFA Rules not processed for user `df2d0289a0b24fbfa4fc4a9ddf2f78f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:35.189274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-bb82fd0d-1eb9-468f-b0d3-066b9d6713ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:35.279915 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1062/2074] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:24:34 2022] PUT /identity/v3/projects/f8cb7afb037d4c639a33bd46fdf30517/users/543a66ead0794e04b04ae93bcf463097/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:35.281395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdb55e-cbe1-44ab-a83a-66e4353195e7 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:35.321751 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1013/2075] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:35.321751 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82fd0d-1eb9-468f-b0d3-066b9d6713ea None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:35.352469 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82fd0d-1eb9-468f-b0d3-066b9d6713ea None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:35.458353 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdb55e-cbe1-44ab-a83a-66e4353195e7 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:35.469774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fdb5d-a146-4dc3-82c6-4d3a28bc2a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:35.470620 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fdb5d-a146-4dc3-82c6-4d3a28bc2a28 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:35.471185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fdb5d-a146-4dc3-82c6-4d3a28bc2a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:35.471649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fdb5d-a146-4dc3-82c6-4d3a28bc2a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:35.472566 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fdb5d-a146-4dc3-82c6-4d3a28bc2a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:35.473898 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24e336-df60-48ca-88eb-1464e402c97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:35.474768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fdb5d-a146-4dc3-82c6-4d3a28bc2a28 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:35.474991 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24e336-df60-48ca-88eb-1464e402c97e admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:35.475414 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24e336-df60-48ca-88eb-1464e402c97e admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:35.475905 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24e336-df60-48ca-88eb-1464e402c97e admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:35.477388 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24e336-df60-48ca-88eb-1464e402c97e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:35.480494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24e336-df60-48ca-88eb-1464e402c97e admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:35.486861 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1063/2076] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:24:35.491586 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fdb5d-a146-4dc3-82c6-4d3a28bc2a28 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:35.494719 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-722fdb5d-a146-4dc3-82c6-4d3a28bc2a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:35.501547 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1014/2077] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:24:35.502523 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24e336-df60-48ca-88eb-1464e402c97e admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:35.525044 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24e336-df60-48ca-88eb-1464e402c97e admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:35.533112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c50229-bcaa-4915-820b-38ec3aa19f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:35.533799 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c50229-bcaa-4915-820b-38ec3aa19f41 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:35.534120 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c50229-bcaa-4915-820b-38ec3aa19f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:35.534402 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c50229-bcaa-4915-820b-38ec3aa19f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:35.535061 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c50229-bcaa-4915-820b-38ec3aa19f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:35.536794 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c50229-bcaa-4915-820b-38ec3aa19f41 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:35.553747 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1015/2078] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:24:35.553747 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c50229-bcaa-4915-820b-38ec3aa19f41 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:35.564976 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c50229-bcaa-4915-820b-38ec3aa19f41 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:35.572790 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4e240-6e59-4dcc-b67a-798b77a5fe0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:35.573483 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4e240-6e59-4dcc-b67a-798b77a5fe0c admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:35.573767 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4e240-6e59-4dcc-b67a-798b77a5fe0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:35.574081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4e240-6e59-4dcc-b67a-798b77a5fe0c admin admin] PATH_INFO: `/v3/projects/f8cb7afb037d4c639a33bd46fdf30517/users/543a66ead0794e04b04ae93bcf463097/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:35.576128 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4e240-6e59-4dcc-b67a-798b77a5fe0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8cb7afb037d4c639a33bd46fdf30517, user_id=543a66ead0794e04b04ae93bcf463097, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:35.578945 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4e240-6e59-4dcc-b67a-798b77a5fe0c admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:35.595148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1016/2079] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:24:35 2022] PUT /identity/v3/projects/f8cb7afb037d4c639a33bd46fdf30517/users/543a66ead0794e04b04ae93bcf463097/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:35.596645 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4e240-6e59-4dcc-b67a-798b77a5fe0c admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:35.612571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fdb5d-a146-4dc3-82c6-4d3a28bc2a28 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:35.689423 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4e240-6e59-4dcc-b67a-798b77a5fe0c admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:35.699376 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc7c60-d57a-4ff7-9720-e9f09bd9a62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:35.700495 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc7c60-d57a-4ff7-9720-e9f09bd9a62d admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:35.700977 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc7c60-d57a-4ff7-9720-e9f09bd9a62d admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:35.701453 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc7c60-d57a-4ff7-9720-e9f09bd9a62d admin admin] PATH_INFO: `/v3/projects/d0d9b4769b124ec69714a30d02bb8557/users/e2940758d8424054bf3a68a42b79bb81/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:35.727145 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38025ff6-f807-4247-aec9-cf34764e756f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:35.728485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38025ff6-f807-4247-aec9-cf34764e756f service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:35.729137 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38025ff6-f807-4247-aec9-cf34764e756f service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:35.729500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38025ff6-f807-4247-aec9-cf34764e756f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:35.731879 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc7c60-d57a-4ff7-9720-e9f09bd9a62d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d9b4769b124ec69714a30d02bb8557, user_id=e2940758d8424054bf3a68a42b79bb81, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:35.737062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc7c60-d57a-4ff7-9720-e9f09bd9a62d admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:35.829389 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38025ff6-f807-4247-aec9-cf34764e756f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:35.831230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38025ff6-f807-4247-aec9-cf34764e756f service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:35.843656 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1064/2080] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:24:35.845271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2493b-5a12-4c82-b39f-738771d9fd35 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:35.845563 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2493b-5a12-4c82-b39f-738771d9fd35 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:35.845938 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2493b-5a12-4c82-b39f-738771d9fd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:35.870146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1017/2081] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:24:35 2022] PUT /identity/v3/projects/d0d9b4769b124ec69714a30d02bb8557/users/e2940758d8424054bf3a68a42b79bb81/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:35.888616 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-00b2493b-5a12-4c82-b39f-738771d9fd35 None None] MFA Rules not processed for user `543a66ead0794e04b04ae93bcf463097`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:35.890717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908824b-fcda-4e1a-bd4e-36f8d75a3bfe None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:35.891390 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-00b2493b-5a12-4c82-b39f-738771d9fd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:35.891688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908824b-fcda-4e1a-bd4e-36f8d75a3bfe None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:35.891688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908824b-fcda-4e1a-bd4e-36f8d75a3bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:35.953135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-7908824b-fcda-4e1a-bd4e-36f8d75a3bfe None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:35.955280 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-7908824b-fcda-4e1a-bd4e-36f8d75a3bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:36.041286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1065/2082] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:36.062159 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2493b-5a12-4c82-b39f-738771d9fd35 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:36.064648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-00b2493b-5a12-4c82-b39f-738771d9fd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:36.089948 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1018/2083] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:36.103460 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908824b-fcda-4e1a-bd4e-36f8d75a3bfe None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:36.106482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-7908824b-fcda-4e1a-bd4e-36f8d75a3bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:36.195817 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2493b-5a12-4c82-b39f-738771d9fd35 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:36.202152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908824b-fcda-4e1a-bd4e-36f8d75a3bfe None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:36.203193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f97c64-914e-4302-ab2d-d468287ad27b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:36.204187 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f97c64-914e-4302-ab2d-d468287ad27b service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:36.204646 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f97c64-914e-4302-ab2d-d468287ad27b service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:36.206222 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f97c64-914e-4302-ab2d-d468287ad27b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:36.207627 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bf127-dc69-43d4-8bdb-10b190d012e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:36.208616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bf127-dc69-43d4-8bdb-10b190d012e3 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:36.208895 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bf127-dc69-43d4-8bdb-10b190d012e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:36.209173 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bf127-dc69-43d4-8bdb-10b190d012e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:36.230285 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bf127-dc69-43d4-8bdb-10b190d012e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:36.233108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bf127-dc69-43d4-8bdb-10b190d012e3 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:36.252450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1019/2084] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:24:36.320864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f97c64-914e-4302-ab2d-d468287ad27b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:36.324922 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f97c64-914e-4302-ab2d-d468287ad27b service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:36.340419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1066/2085] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:24:37.309620 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:38.400444 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:41.972587 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:42.096079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bf127-dc69-43d4-8bdb-10b190d012e3 service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:42.118582 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bf127-dc69-43d4-8bdb-10b190d012e3 service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:42.129182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11278480-5fa7-459f-b74e-edf4046c1e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:42.139004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11278480-5fa7-459f-b74e-edf4046c1e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:42.139004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11278480-5fa7-459f-b74e-edf4046c1e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:42.139004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11278480-5fa7-459f-b74e-edf4046c1e3e admin admin] PATH_INFO: `/v3/users/df2d0289a0b24fbfa4fc4a9ddf2f78f5` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:42.139004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11278480-5fa7-459f-b74e-edf4046c1e3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2d0289a0b24fbfa4fc4a9ddf2f78f5)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:42.139004 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11278480-5fa7-459f-b74e-edf4046c1e3e admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:42.602619 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-11278480-5fa7-459f-b74e-edf4046c1e3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2d0289a0b24fbfa4fc4a9ddf2f78f5'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:42.608874 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-11278480-5fa7-459f-b74e-edf4046c1e3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2d0289a0b24fbfa4fc4a9ddf2f78f5'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:42.624462 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-11278480-5fa7-459f-b74e-edf4046c1e3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2d0289a0b24fbfa4fc4a9ddf2f78f5'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:42.661557 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-11278480-5fa7-459f-b74e-edf4046c1e3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2d0289a0b24fbfa4fc4a9ddf2f78f5'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:42.662881 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-11278480-5fa7-459f-b74e-edf4046c1e3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2d0289a0b24fbfa4fc4a9ddf2f78f5'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:42.884252 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:42.884252 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1020/2086] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:24:42 2022] DELETE /identity/v3/users/df2d0289a0b24fbfa4fc4a9ddf2f78f5 => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:42.888866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c137c7-f9a3-4b1c-8b49-736c7ae67a17 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:42.889197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c137c7-f9a3-4b1c-8b49-736c7ae67a17 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:42.889711 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c137c7-f9a3-4b1c-8b49-736c7ae67a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:42.930551 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-c0c137c7-f9a3-4b1c-8b49-736c7ae67a17 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:42.932434 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-c0c137c7-f9a3-4b1c-8b49-736c7ae67a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:43.052010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1067/2087] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:43.069217 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11278480-5fa7-459f-b74e-edf4046c1e3e admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:43.072582 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-11278480-5fa7-459f-b74e-edf4046c1e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:43.204710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11278480-5fa7-459f-b74e-edf4046c1e3e admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:43.234189 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b5d38-2b50-4bbd-909a-514d646e7f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:43.235317 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b5d38-2b50-4bbd-909a-514d646e7f21 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:43.235317 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b5d38-2b50-4bbd-909a-514d646e7f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:43.235610 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b5d38-2b50-4bbd-909a-514d646e7f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:43.252484 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b5d38-2b50-4bbd-909a-514d646e7f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:43.254018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b5d38-2b50-4bbd-909a-514d646e7f21 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:43.272392 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1021/2088] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:24:43.982507 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c137c7-f9a3-4b1c-8b49-736c7ae67a17 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:43.984650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-c0c137c7-f9a3-4b1c-8b49-736c7ae67a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:44.006845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c137c7-f9a3-4b1c-8b49-736c7ae67a17 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:44.012462 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e73be7-5be4-4cb3-9105-9906e72e975f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:44.013593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e73be7-5be4-4cb3-9105-9906e72e975f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:44.013939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e73be7-5be4-4cb3-9105-9906e72e975f admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:44.018186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e73be7-5be4-4cb3-9105-9906e72e975f admin admin] PATH_INFO: `/v3/projects/87c7b1832bef4bd6bda46ceb7bacd8ae` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:44.018186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e73be7-5be4-4cb3-9105-9906e72e975f admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c7b1832bef4bd6bda46ceb7bacd8ae)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:44.020545 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e73be7-5be4-4cb3-9105-9906e72e975f admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:44.323414 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e7e73be7-5be4-4cb3-9105-9906e72e975f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c7b1832bef4bd6bda46ceb7bacd8ae', 'request_id': 'req-e7e73be7-5be4-4cb3-9105-9906e72e975f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:44.331191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e7e73be7-5be4-4cb3-9105-9906e72e975f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c7b1832bef4bd6bda46ceb7bacd8ae', 'request_id': 'req-e7e73be7-5be4-4cb3-9105-9906e72e975f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:44.345656 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e7e73be7-5be4-4cb3-9105-9906e72e975f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c7b1832bef4bd6bda46ceb7bacd8ae', 'request_id': 'req-e7e73be7-5be4-4cb3-9105-9906e72e975f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:44.472555 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e7e73be7-5be4-4cb3-9105-9906e72e975f admin admin] The token cache is being invalidate because project 87c7b1832bef4bd6bda46ceb7bacd8ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:24:44.473512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e7e73be7-5be4-4cb3-9105-9906e72e975f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:44.483055 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e7e73be7-5be4-4cb3-9105-9906e72e975f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:44.496088 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1068/2089] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:24:43 2022] DELETE /identity/v3/projects/87c7b1832bef4bd6bda46ceb7bacd8ae => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:44.504682 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657a588-b08b-4425-867f-fd56ced4f904 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:44.507965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657a588-b08b-4425-867f-fd56ced4f904 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:44.507965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657a588-b08b-4425-867f-fd56ced4f904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:44.549301 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-f657a588-b08b-4425-867f-fd56ced4f904 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:44.549301 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f657a588-b08b-4425-867f-fd56ced4f904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:44.717923 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1022/2090] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:44.729868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a3e0d-62c9-40d2-811d-076a18bbaf41 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:44.730346 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a3e0d-62c9-40d2-811d-076a18bbaf41 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:44.730741 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a3e0d-62c9-40d2-811d-076a18bbaf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:44.765228 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-795a3e0d-62c9-40d2-811d-076a18bbaf41 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:44.767023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-795a3e0d-62c9-40d2-811d-076a18bbaf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:44.778619 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1069/2091] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:44.785414 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657a588-b08b-4425-867f-fd56ced4f904 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:44.802012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657a588-b08b-4425-867f-fd56ced4f904 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:44.812136 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78445958-36b2-4c22-b09d-4002e5022994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:44.813465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78445958-36b2-4c22-b09d-4002e5022994 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:44.814129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78445958-36b2-4c22-b09d-4002e5022994 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:44.814651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78445958-36b2-4c22-b09d-4002e5022994 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:44.815697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78445958-36b2-4c22-b09d-4002e5022994 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:24:44.816312 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78445958-36b2-4c22-b09d-4002e5022994 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:44.819022 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78445958-36b2-4c22-b09d-4002e5022994 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:44.851973 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1023/2092] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:24:44.853090 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a3e0d-62c9-40d2-811d-076a18bbaf41 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:44.874026 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a3e0d-62c9-40d2-811d-076a18bbaf41 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:44.880941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b11d3a-7919-4de5-950c-0e00a073258b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:44.882747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b11d3a-7919-4de5-950c-0e00a073258b admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:44.883626 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b11d3a-7919-4de5-950c-0e00a073258b admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:44.884028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b11d3a-7919-4de5-950c-0e00a073258b admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:44.884666 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b11d3a-7919-4de5-950c-0e00a073258b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:44.886759 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b11d3a-7919-4de5-950c-0e00a073258b admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:45.070278 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:45.089546 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1070/2093] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:24:44 2022] POST /identity/v3/projects => generated 371 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:24:45.094949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78445958-36b2-4c22-b09d-4002e5022994 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:45.117504 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78445958-36b2-4c22-b09d-4002e5022994 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:45.226588 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8701a1e-7060-4264-a0d8-4319a8bab721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:45.227241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8701a1e-7060-4264-a0d8-4319a8bab721 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:45.227519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8701a1e-7060-4264-a0d8-4319a8bab721 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:45.227791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8701a1e-7060-4264-a0d8-4319a8bab721 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:45.228587 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8701a1e-7060-4264-a0d8-4319a8bab721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:45.231051 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8701a1e-7060-4264-a0d8-4319a8bab721 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:45.414679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b11d3a-7919-4de5-950c-0e00a073258b admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:45.418165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1024/2094] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:24:45 2022] POST /identity/v3/users => generated 286 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:24:45.454817 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b11d3a-7919-4de5-950c-0e00a073258b admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:45.470723 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cac5b2-a5ad-44dc-b714-892eba5c3b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:45.471878 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cac5b2-a5ad-44dc-b714-892eba5c3b5e admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:45.472673 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cac5b2-a5ad-44dc-b714-892eba5c3b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:45.473252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cac5b2-a5ad-44dc-b714-892eba5c3b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:45.474784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cac5b2-a5ad-44dc-b714-892eba5c3b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:45.479000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cac5b2-a5ad-44dc-b714-892eba5c3b5e admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:45.483968 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8701a1e-7060-4264-a0d8-4319a8bab721 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:45.487127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-a8701a1e-7060-4264-a0d8-4319a8bab721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:45.503630 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1071/2095] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:24:45.512352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cac5b2-a5ad-44dc-b714-892eba5c3b5e admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:45.527305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cac5b2-a5ad-44dc-b714-892eba5c3b5e admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:45.537253 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92478e-7f93-4e27-90f8-1dec3186b43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:45.538752 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92478e-7f93-4e27-90f8-1dec3186b43c admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:45.539327 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92478e-7f93-4e27-90f8-1dec3186b43c admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:45.539845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92478e-7f93-4e27-90f8-1dec3186b43c admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:45.547571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92478e-7f93-4e27-90f8-1dec3186b43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:45.547571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92478e-7f93-4e27-90f8-1dec3186b43c admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:45.566754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1072/2096] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:24:45.573273 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92478e-7f93-4e27-90f8-1dec3186b43c admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:45.600108 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92478e-7f93-4e27-90f8-1dec3186b43c admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:45.611412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780d0f2-b1f3-459a-94b2-2cf1726553c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:45.612557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780d0f2-b1f3-459a-94b2-2cf1726553c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:45.613065 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780d0f2-b1f3-459a-94b2-2cf1726553c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:45.613578 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780d0f2-b1f3-459a-94b2-2cf1726553c6 admin admin] PATH_INFO: `/v3/projects/9cc3ef80fd3a4b02882019fb44633135/users/9d87c3c836d049dbbb4104b9f5483f22/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:45.628759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8701a1e-7060-4264-a0d8-4319a8bab721 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:45.639706 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb34da-d541-4432-aa2c-d02e603c9584 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:45.641276 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb34da-d541-4432-aa2c-d02e603c9584 service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:45.642137 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb34da-d541-4432-aa2c-d02e603c9584 service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:45.642890 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb34da-d541-4432-aa2c-d02e603c9584 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:45.645868 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-0ceb34da-d541-4432-aa2c-d02e603c9584 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:45.656633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780d0f2-b1f3-459a-94b2-2cf1726553c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc3ef80fd3a4b02882019fb44633135, user_id=9d87c3c836d049dbbb4104b9f5483f22, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:45.663628 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780d0f2-b1f3-459a-94b2-2cf1726553c6 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:45.798160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb34da-d541-4432-aa2c-d02e603c9584 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:45.799977 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb34da-d541-4432-aa2c-d02e603c9584 service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:45.825685 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1025/2097] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:24:45.855049 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1073/2098] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:24:45 2022] PUT /identity/v3/projects/9cc3ef80fd3a4b02882019fb44633135/users/9d87c3c836d049dbbb4104b9f5483f22/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:45.867745 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762e5dd-4232-405a-b907-6cc1505d62c1 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:45.868340 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762e5dd-4232-405a-b907-6cc1505d62c1 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:45.868832 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762e5dd-4232-405a-b907-6cc1505d62c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:45.919522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-d762e5dd-4232-405a-b907-6cc1505d62c1 None None] MFA Rules not processed for user `9d87c3c836d049dbbb4104b9f5483f22`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:45.922387 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d762e5dd-4232-405a-b907-6cc1505d62c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:46.083815 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1026/2099] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:46.088781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780d0f2-b1f3-459a-94b2-2cf1726553c6 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:46.118934 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:46.253988 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780d0f2-b1f3-459a-94b2-2cf1726553c6 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:46.268807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c6d58-7b81-49d0-ad38-2826ccd51ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:46.269918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c6d58-7b81-49d0-ad38-2826ccd51ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:46.270415 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c6d58-7b81-49d0-ad38-2826ccd51ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:46.271146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c6d58-7b81-49d0-ad38-2826ccd51ee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:46.272420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c6d58-7b81-49d0-ad38-2826ccd51ee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:46.275944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c6d58-7b81-49d0-ad38-2826ccd51ee6 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:46.426523 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9752f-cf79-4034-9750-8b76b7276d73 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:46.426523 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9752f-cf79-4034-9750-8b76b7276d73 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:46.426523 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9752f-cf79-4034-9750-8b76b7276d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:46.500086 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-f7a9752f-cf79-4034-9750-8b76b7276d73 None None] MFA Rules not processed for user `e2940758d8424054bf3a68a42b79bb81`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:46.505957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f7a9752f-cf79-4034-9750-8b76b7276d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:46.565628 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1074/2100] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:24:46 2022] POST /identity/v3/projects => generated 373 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:24:46.567663 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c6d58-7b81-49d0-ad38-2826ccd51ee6 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:46.804333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1027/2101] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:24:46.809650 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9752f-cf79-4034-9750-8b76b7276d73 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:46.812233 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f7a9752f-cf79-4034-9750-8b76b7276d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:46.870262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9752f-cf79-4034-9750-8b76b7276d73 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:46.904396 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c6d58-7b81-49d0-ad38-2826ccd51ee6 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:46.928734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b190f-7f25-47b1-a2c7-b6624c31e8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:46.929727 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b190f-7f25-47b1-a2c7-b6624c31e8c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:46.930409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b190f-7f25-47b1-a2c7-b6624c31e8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:46.930734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b190f-7f25-47b1-a2c7-b6624c31e8c5 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:46.932343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b190f-7f25-47b1-a2c7-b6624c31e8c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:46.935944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b190f-7f25-47b1-a2c7-b6624c31e8c5 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:46.994865 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b80d9-abf9-4bfe-8792-5ee02c129319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:46.996049 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b80d9-abf9-4bfe-8792-5ee02c129319 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:46.996618 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b80d9-abf9-4bfe-8792-5ee02c129319 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:46.998107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b80d9-abf9-4bfe-8792-5ee02c129319 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:46.999256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b80d9-abf9-4bfe-8792-5ee02c129319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:47.011132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b80d9-abf9-4bfe-8792-5ee02c129319 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:47.143640 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1075/2102] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:24:46 2022] POST /identity/v3/users => generated 293 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:24:47.153445 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b190f-7f25-47b1-a2c7-b6624c31e8c5 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:47.169513 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b190f-7f25-47b1-a2c7-b6624c31e8c5 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:47.186518 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f0baf-9958-4ed9-8c5c-268883fa570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:47.187993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f0baf-9958-4ed9-8c5c-268883fa570a admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:47.188646 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f0baf-9958-4ed9-8c5c-268883fa570a admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:47.189218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f0baf-9958-4ed9-8c5c-268883fa570a admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:47.190159 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f0baf-9958-4ed9-8c5c-268883fa570a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:47.192636 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f0baf-9958-4ed9-8c5c-268883fa570a admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:47.201801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1028/2103] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:24:46 2022] POST /identity/v3/projects => generated 379 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:24:47.209317 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b80d9-abf9-4bfe-8792-5ee02c129319 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:47.221639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1076/2104] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:24:47.224514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f0baf-9958-4ed9-8c5c-268883fa570a admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:47.243820 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f0baf-9958-4ed9-8c5c-268883fa570a admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:47.372954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b80d9-abf9-4bfe-8792-5ee02c129319 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:47.379140 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a06cb-18aa-4980-a2e3-dcbce4a4d209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:47.380776 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a06cb-18aa-4980-a2e3-dcbce4a4d209 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:47.382155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a06cb-18aa-4980-a2e3-dcbce4a4d209 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:47.383104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a06cb-18aa-4980-a2e3-dcbce4a4d209 admin admin] PATH_INFO: `/v3/projects/238b42b61bf045ccad17fa0fbf488b4f/users/8b6406ffc41c431c83d843f7e9aef257/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:47.387845 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01ac98-c72e-4197-902f-4bfad80525cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:47.388886 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01ac98-c72e-4197-902f-4bfad80525cd admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:47.389454 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01ac98-c72e-4197-902f-4bfad80525cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:47.389972 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01ac98-c72e-4197-902f-4bfad80525cd admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:47.391206 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01ac98-c72e-4197-902f-4bfad80525cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:47.403549 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01ac98-c72e-4197-902f-4bfad80525cd admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:47.421614 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a06cb-18aa-4980-a2e3-dcbce4a4d209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=238b42b61bf045ccad17fa0fbf488b4f, user_id=8b6406ffc41c431c83d843f7e9aef257, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:47.425173 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a06cb-18aa-4980-a2e3-dcbce4a4d209 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:47.604650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1077/2105] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:24:47 2022] PUT /identity/v3/projects/238b42b61bf045ccad17fa0fbf488b4f/users/8b6406ffc41c431c83d843f7e9aef257/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:47.608949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a06cb-18aa-4980-a2e3-dcbce4a4d209 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:47.681485 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1029/2106] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:24:47 2022] POST /identity/v3/users => generated 296 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:24:47.690972 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01ac98-c72e-4197-902f-4bfad80525cd admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:47.700058 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a06cb-18aa-4980-a2e3-dcbce4a4d209 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:47.706678 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39352702-e7ab-4e73-88df-6df880bc67be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:47.707636 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39352702-e7ab-4e73-88df-6df880bc67be admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:47.707923 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39352702-e7ab-4e73-88df-6df880bc67be admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:47.708250 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39352702-e7ab-4e73-88df-6df880bc67be admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:47.709053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39352702-e7ab-4e73-88df-6df880bc67be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:47.710906 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39352702-e7ab-4e73-88df-6df880bc67be admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:47.721020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01ac98-c72e-4197-902f-4bfad80525cd admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:47.733578 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23fc11a-22b1-4f51-b64b-7aedcf87d105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:47.734735 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fc11a-22b1-4f51-b64b-7aedcf87d105 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:47.735225 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fc11a-22b1-4f51-b64b-7aedcf87d105 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:47.735690 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fc11a-22b1-4f51-b64b-7aedcf87d105 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:47.736539 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23fc11a-22b1-4f51-b64b-7aedcf87d105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:47.738061 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1078/2107] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:24:47.739945 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23fc11a-22b1-4f51-b64b-7aedcf87d105 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:47.743015 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39352702-e7ab-4e73-88df-6df880bc67be admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:47.770362 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1030/2108] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:24:47.771304 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39352702-e7ab-4e73-88df-6df880bc67be admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:47.772660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23fc11a-22b1-4f51-b64b-7aedcf87d105 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:47.781735 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03e522-df56-403c-83d2-634c282b7eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:47.783813 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03e522-df56-403c-83d2-634c282b7eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:47.783813 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03e522-df56-403c-83d2-634c282b7eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:47.784525 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03e522-df56-403c-83d2-634c282b7eb7 admin admin] PATH_INFO: `/v3/projects/238b42b61bf045ccad17fa0fbf488b4f/users/8b6406ffc41c431c83d843f7e9aef257/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:47.789026 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03e522-df56-403c-83d2-634c282b7eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=238b42b61bf045ccad17fa0fbf488b4f, user_id=8b6406ffc41c431c83d843f7e9aef257, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:47.795478 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03e522-df56-403c-83d2-634c282b7eb7 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:47.798373 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23fc11a-22b1-4f51-b64b-7aedcf87d105 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:47.809157 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8b800-4349-4d17-a37e-4becac68f3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:47.810545 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8b800-4349-4d17-a37e-4becac68f3e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:47.811079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8b800-4349-4d17-a37e-4becac68f3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:47.811559 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8b800-4349-4d17-a37e-4becac68f3e0 admin admin] PATH_INFO: `/v3/projects/41f32b62a4f64ba69edc44f63a37574d/users/558225cbbac34934948da9b212dfc6a0/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:47.822254 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1079/2109] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:24:47 2022] PUT /identity/v3/projects/238b42b61bf045ccad17fa0fbf488b4f/users/8b6406ffc41c431c83d843f7e9aef257/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:47.852861 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f9b51-2d0a-422f-9609-5d2aade4711d None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:47.853375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f9b51-2d0a-422f-9609-5d2aade4711d None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:47.853934 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f9b51-2d0a-422f-9609-5d2aade4711d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:47.861684 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc8b800-4349-4d17-a37e-4becac68f3e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f32b62a4f64ba69edc44f63a37574d, user_id=558225cbbac34934948da9b212dfc6a0, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:47.870087 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc8b800-4349-4d17-a37e-4becac68f3e0 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:47.911576 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-648f9b51-2d0a-422f-9609-5d2aade4711d None None] MFA Rules not processed for user `8b6406ffc41c431c83d843f7e9aef257`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:47.913399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-648f9b51-2d0a-422f-9609-5d2aade4711d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:48.038550 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1080/2110] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:24:48.069160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1031/2111] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:24:47 2022] PUT /identity/v3/projects/41f32b62a4f64ba69edc44f63a37574d/users/558225cbbac34934948da9b212dfc6a0/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:48.083084 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f9b51-2d0a-422f-9609-5d2aade4711d None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:48.094024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8b800-4349-4d17-a37e-4becac68f3e0 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:48.303155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f9b51-2d0a-422f-9609-5d2aade4711d None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:48.340541 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8b800-4349-4d17-a37e-4becac68f3e0 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:48.363922 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb64ee-e562-4cad-aef8-0f3838b5f8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:48.368976 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb64ee-e562-4cad-aef8-0f3838b5f8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:48.373217 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb64ee-e562-4cad-aef8-0f3838b5f8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:48.375176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb64ee-e562-4cad-aef8-0f3838b5f8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:48.377956 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb64ee-e562-4cad-aef8-0f3838b5f8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:48.389852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb64ee-e562-4cad-aef8-0f3838b5f8f7 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:48.414846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e60923-24a2-46ee-bc74-6682fe4fca4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:48.415543 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60923-24a2-46ee-bc74-6682fe4fca4c service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:48.415839 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60923-24a2-46ee-bc74-6682fe4fca4c service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:48.416115 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60923-24a2-46ee-bc74-6682fe4fca4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:48.462184 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1032/2112] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:24:48.464664 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb64ee-e562-4cad-aef8-0f3838b5f8f7 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:48.503412 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb64ee-e562-4cad-aef8-0f3838b5f8f7 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:48.511856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f970e-2206-4ce3-95ea-8cb869b72691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:48.513205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f970e-2206-4ce3-95ea-8cb869b72691 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:48.513859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f970e-2206-4ce3-95ea-8cb869b72691 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:48.514191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f970e-2206-4ce3-95ea-8cb869b72691 admin admin] PATH_INFO: `/v3/projects/41f32b62a4f64ba69edc44f63a37574d/users/558225cbbac34934948da9b212dfc6a0/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:48.517994 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f970e-2206-4ce3-95ea-8cb869b72691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f32b62a4f64ba69edc44f63a37574d, user_id=558225cbbac34934948da9b212dfc6a0, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:48.524361 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f970e-2206-4ce3-95ea-8cb869b72691 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:48.547694 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1033/2113] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:24:48 2022] PUT /identity/v3/projects/41f32b62a4f64ba69edc44f63a37574d/users/558225cbbac34934948da9b212dfc6a0/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:48.595667 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e60923-24a2-46ee-bc74-6682fe4fca4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:48.595667 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e60923-24a2-46ee-bc74-6682fe4fca4c service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:48.621870 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1081/2114] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:24:49.190850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f970e-2206-4ce3-95ea-8cb869b72691 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:49.312778 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:49.327271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e60923-24a2-46ee-bc74-6682fe4fca4c service cinder] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:49.329787 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-27e60923-24a2-46ee-bc74-6682fe4fca4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:49.367653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e60923-24a2-46ee-bc74-6682fe4fca4c service cinder] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:49.398643 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f970e-2206-4ce3-95ea-8cb869b72691 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:49.420234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2d055-899f-4e8e-9787-3c1392f4fcdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:49.422429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2d055-899f-4e8e-9787-3c1392f4fcdd service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:49.422950 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2d055-899f-4e8e-9787-3c1392f4fcdd service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:49.423333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2d055-899f-4e8e-9787-3c1392f4fcdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:49.506823 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66725e6a-1f73-49ef-8b85-395d6ff2f19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:49.507848 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66725e6a-1f73-49ef-8b85-395d6ff2f19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:49.508168 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66725e6a-1f73-49ef-8b85-395d6ff2f19a admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:49.508557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66725e6a-1f73-49ef-8b85-395d6ff2f19a admin admin] PATH_INFO: `/v3/users/d49c8a05edd5400eb46734675fbc40fb` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:49.510039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66725e6a-1f73-49ef-8b85-395d6ff2f19a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d49c8a05edd5400eb46734675fbc40fb)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:49.512354 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66725e6a-1f73-49ef-8b85-395d6ff2f19a admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:49.599516 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2d055-899f-4e8e-9787-3c1392f4fcdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:49.604324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2d055-899f-4e8e-9787-3c1392f4fcdd service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:49.621921 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1034/2115] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:24:49.751153 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:49.986236 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-66725e6a-1f73-49ef-8b85-395d6ff2f19a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd49c8a05edd5400eb46734675fbc40fb'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:49.987058 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-66725e6a-1f73-49ef-8b85-395d6ff2f19a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd49c8a05edd5400eb46734675fbc40fb'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:50.016295 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-66725e6a-1f73-49ef-8b85-395d6ff2f19a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd49c8a05edd5400eb46734675fbc40fb'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:50.029062 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-66725e6a-1f73-49ef-8b85-395d6ff2f19a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd49c8a05edd5400eb46734675fbc40fb'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:50.031382 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-66725e6a-1f73-49ef-8b85-395d6ff2f19a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd49c8a05edd5400eb46734675fbc40fb'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:50.161318 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1082/2116] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:24:49 2022] DELETE /identity/v3/users/d49c8a05edd5400eb46734675fbc40fb => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:50.562675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2d055-899f-4e8e-9787-3c1392f4fcdd service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:50.578897 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2d055-899f-4e8e-9787-3c1392f4fcdd service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:50.681948 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ce21c-4de0-4e15-9473-61dfcd6a2069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:50.683509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ce21c-4de0-4e15-9473-61dfcd6a2069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:50.683509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ce21c-4de0-4e15-9473-61dfcd6a2069 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:50.684238 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ce21c-4de0-4e15-9473-61dfcd6a2069 admin admin] PATH_INFO: `/v3/projects/e6df86b2b713438ab6050195b4a682ac` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:50.685993 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ce21c-4de0-4e15-9473-61dfcd6a2069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6df86b2b713438ab6050195b4a682ac)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:50.688555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ce21c-4de0-4e15-9473-61dfcd6a2069 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:51.032619 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-6b7ce21c-4de0-4e15-9473-61dfcd6a2069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6df86b2b713438ab6050195b4a682ac', 'request_id': 'req-6b7ce21c-4de0-4e15-9473-61dfcd6a2069'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:51.047030 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-6b7ce21c-4de0-4e15-9473-61dfcd6a2069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6df86b2b713438ab6050195b4a682ac', 'request_id': 'req-6b7ce21c-4de0-4e15-9473-61dfcd6a2069'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:51.066323 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-6b7ce21c-4de0-4e15-9473-61dfcd6a2069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6df86b2b713438ab6050195b4a682ac', 'request_id': 'req-6b7ce21c-4de0-4e15-9473-61dfcd6a2069'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:51.282157 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-6b7ce21c-4de0-4e15-9473-61dfcd6a2069 admin admin] The token cache is being invalidate because project e6df86b2b713438ab6050195b4a682ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:24:51.282157 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-6b7ce21c-4de0-4e15-9473-61dfcd6a2069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:51.282157 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-6b7ce21c-4de0-4e15-9473-61dfcd6a2069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:51.289461 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66725e6a-1f73-49ef-8b85-395d6ff2f19a admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:51.291034 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1035/2117] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:24:50 2022] DELETE /identity/v3/projects/e6df86b2b713438ab6050195b4a682ac => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:51.292835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-66725e6a-1f73-49ef-8b85-395d6ff2f19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:51.316362 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66725e6a-1f73-49ef-8b85-395d6ff2f19a admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:51.478026 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4df6e3-9ca2-47df-946b-1dc12df81fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:51.478750 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4df6e3-9ca2-47df-946b-1dc12df81fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:51.480965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4df6e3-9ca2-47df-946b-1dc12df81fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:51.480965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4df6e3-9ca2-47df-946b-1dc12df81fa5 admin admin] PATH_INFO: `/v3/users/80211d54d67b45afb4368e8c2a0c49df` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:51.480965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4df6e3-9ca2-47df-946b-1dc12df81fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80211d54d67b45afb4368e8c2a0c49df)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:51.482628 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4df6e3-9ca2-47df-946b-1dc12df81fa5 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:51.983857 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-de4df6e3-9ca2-47df-946b-1dc12df81fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80211d54d67b45afb4368e8c2a0c49df'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:51.985178 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-de4df6e3-9ca2-47df-946b-1dc12df81fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80211d54d67b45afb4368e8c2a0c49df'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:52.004775 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-de4df6e3-9ca2-47df-946b-1dc12df81fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80211d54d67b45afb4368e8c2a0c49df'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:52.021366 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-de4df6e3-9ca2-47df-946b-1dc12df81fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80211d54d67b45afb4368e8c2a0c49df'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:52.022834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-de4df6e3-9ca2-47df-946b-1dc12df81fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80211d54d67b45afb4368e8c2a0c49df'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:52.211553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1083/2118] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:24:51 2022] DELETE /identity/v3/users/80211d54d67b45afb4368e8c2a0c49df => generated 0 bytes in 923 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:52.981852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ce21c-4de0-4e15-9473-61dfcd6a2069 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:52.986881 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-6b7ce21c-4de0-4e15-9473-61dfcd6a2069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:53.058308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ce21c-4de0-4e15-9473-61dfcd6a2069 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:53.153669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:53.238711 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c05946-4d92-47fe-be5f-a6eaa0deeac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:53.239554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c05946-4d92-47fe-be5f-a6eaa0deeac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:53.239996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c05946-4d92-47fe-be5f-a6eaa0deeac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:53.241330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c05946-4d92-47fe-be5f-a6eaa0deeac3 admin admin] PATH_INFO: `/v3/projects/1d98ae47ac95450c800d1fd771f99cd8` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:53.243058 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c05946-4d92-47fe-be5f-a6eaa0deeac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d98ae47ac95450c800d1fd771f99cd8)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:53.245366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c05946-4d92-47fe-be5f-a6eaa0deeac3 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:53.468079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-12c05946-4d92-47fe-be5f-a6eaa0deeac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d98ae47ac95450c800d1fd771f99cd8', 'request_id': 'req-12c05946-4d92-47fe-be5f-a6eaa0deeac3'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:53.476812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-12c05946-4d92-47fe-be5f-a6eaa0deeac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d98ae47ac95450c800d1fd771f99cd8', 'request_id': 'req-12c05946-4d92-47fe-be5f-a6eaa0deeac3'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:53.485690 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-12c05946-4d92-47fe-be5f-a6eaa0deeac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d98ae47ac95450c800d1fd771f99cd8', 'request_id': 'req-12c05946-4d92-47fe-be5f-a6eaa0deeac3'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:53.760165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-12c05946-4d92-47fe-be5f-a6eaa0deeac3 admin admin] The token cache is being invalidate because project 1d98ae47ac95450c800d1fd771f99cd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:24:53.760630 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-12c05946-4d92-47fe-be5f-a6eaa0deeac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:53.761761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-12c05946-4d92-47fe-be5f-a6eaa0deeac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:24:53.763555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1036/2119] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:24:52 2022] DELETE /identity/v3/projects/1d98ae47ac95450c800d1fd771f99cd8 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:53.769405 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c6517-34e7-47c6-8d11-6ea458b94ae9 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:53.770347 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c6517-34e7-47c6-8d11-6ea458b94ae9 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:53.770688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c6517-34e7-47c6-8d11-6ea458b94ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:53.810169 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-ec1c6517-34e7-47c6-8d11-6ea458b94ae9 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:53.811906 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ec1c6517-34e7-47c6-8d11-6ea458b94ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:53.911799 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1084/2120] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:24:53.923109 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997637e-3a8c-48ba-91c6-8c2e51c9aebd None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:53.923603 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997637e-3a8c-48ba-91c6-8c2e51c9aebd None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:53.924076 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997637e-3a8c-48ba-91c6-8c2e51c9aebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:53.951882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-6997637e-3a8c-48ba-91c6-8c2e51c9aebd None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:53.952828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-6997637e-3a8c-48ba-91c6-8c2e51c9aebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:53.964327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1037/2121] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:24:53.969305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c6517-34e7-47c6-8d11-6ea458b94ae9 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:53.979924 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c6517-34e7-47c6-8d11-6ea458b94ae9 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:53.985636 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba824a-0e74-4b4d-8012-074abf635828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:53.986442 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba824a-0e74-4b4d-8012-074abf635828 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:53.986731 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba824a-0e74-4b4d-8012-074abf635828 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:53.987014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba824a-0e74-4b4d-8012-074abf635828 admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:53.987687 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba824a-0e74-4b4d-8012-074abf635828 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:24:53.987997 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba824a-0e74-4b4d-8012-074abf635828 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:53.989789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba824a-0e74-4b4d-8012-074abf635828 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:54.012570 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1085/2122] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:24:54.017900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997637e-3a8c-48ba-91c6-8c2e51c9aebd None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:54.030504 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997637e-3a8c-48ba-91c6-8c2e51c9aebd None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:54.039019 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c26d0-4e49-4c74-9e4b-4f2f88aa67e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:54.039783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c26d0-4e49-4c74-9e4b-4f2f88aa67e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:54.040182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c26d0-4e49-4c74-9e4b-4f2f88aa67e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:54.040552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c26d0-4e49-4c74-9e4b-4f2f88aa67e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:54.042329 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c26d0-4e49-4c74-9e4b-4f2f88aa67e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:54.045624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c26d0-4e49-4c74-9e4b-4f2f88aa67e0 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:54.291036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1038/2123] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:24:54 2022] POST /identity/v3/projects => generated 385 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:24:54.294890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba824a-0e74-4b4d-8012-074abf635828 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:54.320989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba824a-0e74-4b4d-8012-074abf635828 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:54.527394 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128ef3d-5512-4100-b92e-a6301b1d21eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:54.531460 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128ef3d-5512-4100-b92e-a6301b1d21eb admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:54.532025 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128ef3d-5512-4100-b92e-a6301b1d21eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:54.532776 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128ef3d-5512-4100-b92e-a6301b1d21eb admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:54.533948 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128ef3d-5512-4100-b92e-a6301b1d21eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:54.542955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128ef3d-5512-4100-b92e-a6301b1d21eb admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:54.756976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1086/2124] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:24:54 2022] POST /identity/v3/users => generated 293 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:24:54.760314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c26d0-4e49-4c74-9e4b-4f2f88aa67e0 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:54.791094 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c26d0-4e49-4c74-9e4b-4f2f88aa67e0 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:54.799646 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd12d1-17b0-436b-9db8-707fde8eb98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:54.800639 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd12d1-17b0-436b-9db8-707fde8eb98e admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:54.801074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd12d1-17b0-436b-9db8-707fde8eb98e admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:54.801652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd12d1-17b0-436b-9db8-707fde8eb98e admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:54.802511 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd12d1-17b0-436b-9db8-707fde8eb98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:54.804369 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd12d1-17b0-436b-9db8-707fde8eb98e admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:54.819081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1039/2125] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:24:54.832467 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128ef3d-5512-4100-b92e-a6301b1d21eb admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:54.859020 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128ef3d-5512-4100-b92e-a6301b1d21eb admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:54.873626 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8dafab-35c4-460b-b228-8eb72cc7d8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:54.875463 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dafab-35c4-460b-b228-8eb72cc7d8df admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:54.876205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dafab-35c4-460b-b228-8eb72cc7d8df admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:54.877961 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dafab-35c4-460b-b228-8eb72cc7d8df admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:54.879853 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8dafab-35c4-460b-b228-8eb72cc7d8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:54.886565 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8dafab-35c4-460b-b228-8eb72cc7d8df admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:54.911003 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1087/2126] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:24:54.920405 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd12d1-17b0-436b-9db8-707fde8eb98e admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:54.944465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd12d1-17b0-436b-9db8-707fde8eb98e admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:54.952806 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ee483-eee3-40b9-a3ac-db33e7ba8fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:54.953980 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ee483-eee3-40b9-a3ac-db33e7ba8fea admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:54.954434 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ee483-eee3-40b9-a3ac-db33e7ba8fea admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:54.954792 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ee483-eee3-40b9-a3ac-db33e7ba8fea admin admin] PATH_INFO: `/v3/projects/b75681f6c5c6434ca5ffb7ee61c57652/users/54adb1041bd245baa49b3125a5ab4b7a/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:54.988342 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ee483-eee3-40b9-a3ac-db33e7ba8fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75681f6c5c6434ca5ffb7ee61c57652, user_id=54adb1041bd245baa49b3125a5ab4b7a, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:54.994574 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ee483-eee3-40b9-a3ac-db33e7ba8fea admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:55.326177 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1040/2127] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:24:54 2022] PUT /identity/v3/projects/b75681f6c5c6434ca5ffb7ee61c57652/users/54adb1041bd245baa49b3125a5ab4b7a/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:24:55.339436 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4e3db-48d3-4dc6-8460-a94ebd7f255c None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:55.339790 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4e3db-48d3-4dc6-8460-a94ebd7f255c None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:55.340124 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4e3db-48d3-4dc6-8460-a94ebd7f255c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:55.373981 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-b2d4e3db-48d3-4dc6-8460-a94ebd7f255c None None] MFA Rules not processed for user `54adb1041bd245baa49b3125a5ab4b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:55.375272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b2d4e3db-48d3-4dc6-8460-a94ebd7f255c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:55.458192 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1088/2128] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:55.471646 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ee483-eee3-40b9-a3ac-db33e7ba8fea admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:55.475420 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-da4ee483-eee3-40b9-a3ac-db33e7ba8fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:55.561855 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ee483-eee3-40b9-a3ac-db33e7ba8fea admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:55.569912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13df948-d42f-4d5d-ac45-dbd2ab5f3a10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:55.571234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13df948-d42f-4d5d-ac45-dbd2ab5f3a10 service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:55.571827 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13df948-d42f-4d5d-ac45-dbd2ab5f3a10 service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:55.572151 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13df948-d42f-4d5d-ac45-dbd2ab5f3a10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:55.590506 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13df948-d42f-4d5d-ac45-dbd2ab5f3a10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:24:55.593394 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13df948-d42f-4d5d-ac45-dbd2ab5f3a10 service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:24:55.606705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1041/2129] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:24:56.890389 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:58.615474 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:59.650762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b271a-c944-49a6-8cfa-30beb9606226 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:59.651363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b271a-c944-49a6-8cfa-30beb9606226 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:59.651363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b271a-c944-49a6-8cfa-30beb9606226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:59.688267 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-a21b271a-c944-49a6-8cfa-30beb9606226 None None] MFA Rules not processed for user `558225cbbac34934948da9b212dfc6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:24:59.689515 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-a21b271a-c944-49a6-8cfa-30beb9606226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:59.823651 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1089/2130] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:24:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:24:59.842232 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13df948-d42f-4d5d-ac45-dbd2ab5f3a10 service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:24:59.850450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f13df948-d42f-4d5d-ac45-dbd2ab5f3a10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:24:59.958594 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13df948-d42f-4d5d-ac45-dbd2ab5f3a10 service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:24:59.964529 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac077a86-e17b-4c06-96c1-7349e09984b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:24:59.965181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac077a86-e17b-4c06-96c1-7349e09984b4 service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:24:59.965543 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac077a86-e17b-4c06-96c1-7349e09984b4 service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:24:59.965747 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac077a86-e17b-4c06-96c1-7349e09984b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:24:59.967695 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ac077a86-e17b-4c06-96c1-7349e09984b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:00.057861 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac077a86-e17b-4c06-96c1-7349e09984b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:00.059500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac077a86-e17b-4c06-96c1-7349e09984b4 service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:00.073795 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1042/2131] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:24:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:25:00.180630 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:01.456929 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:05.616248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:06.701098 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:07.276834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b271a-c944-49a6-8cfa-30beb9606226 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:07.386891 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b271a-c944-49a6-8cfa-30beb9606226 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:07.432250 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4cabc-19f8-404d-b762-6fb7b37b8c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:07.433603 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4cabc-19f8-404d-b762-6fb7b37b8c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:07.434357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4cabc-19f8-404d-b762-6fb7b37b8c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:07.435480 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4cabc-19f8-404d-b762-6fb7b37b8c50 admin admin] PATH_INFO: `/v3/users/54adb1041bd245baa49b3125a5ab4b7a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:07.438273 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4cabc-19f8-404d-b762-6fb7b37b8c50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54adb1041bd245baa49b3125a5ab4b7a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:07.443180 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4cabc-19f8-404d-b762-6fb7b37b8c50 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:07.871427 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-98a4cabc-19f8-404d-b762-6fb7b37b8c50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54adb1041bd245baa49b3125a5ab4b7a'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:07.872437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-98a4cabc-19f8-404d-b762-6fb7b37b8c50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54adb1041bd245baa49b3125a5ab4b7a'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:07.898821 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-98a4cabc-19f8-404d-b762-6fb7b37b8c50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54adb1041bd245baa49b3125a5ab4b7a'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:07.911368 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-98a4cabc-19f8-404d-b762-6fb7b37b8c50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54adb1041bd245baa49b3125a5ab4b7a'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:07.912469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-98a4cabc-19f8-404d-b762-6fb7b37b8c50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54adb1041bd245baa49b3125a5ab4b7a'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:08.208946 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1090/2132] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:25:07 2022] DELETE /identity/v3/users/54adb1041bd245baa49b3125a5ab4b7a => generated 0 bytes in 924 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:25:08.209467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69dedc-4cd4-4526-a349-b08c5ad42a5d None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:08.209957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69dedc-4cd4-4526-a349-b08c5ad42a5d None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:08.210590 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69dedc-4cd4-4526-a349-b08c5ad42a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:08.242733 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-cc69dedc-4cd4-4526-a349-b08c5ad42a5d None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:25:08.244450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-cc69dedc-4cd4-4526-a349-b08c5ad42a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:08.401698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1043/2133] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:25:08.422848 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4cabc-19f8-404d-b762-6fb7b37b8c50 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:08.447400 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-98a4cabc-19f8-404d-b762-6fb7b37b8c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:08.660315 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4cabc-19f8-404d-b762-6fb7b37b8c50 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:08.685110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c163e-08e7-49e5-8fef-b1c779fcb875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:08.685110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c163e-08e7-49e5-8fef-b1c779fcb875 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:08.685110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c163e-08e7-49e5-8fef-b1c779fcb875 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:08.685110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c163e-08e7-49e5-8fef-b1c779fcb875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:08.704940 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c163e-08e7-49e5-8fef-b1c779fcb875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:08.707300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c163e-08e7-49e5-8fef-b1c779fcb875 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:08.733344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1091/2134] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:25:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:25:09.621113 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69dedc-4cd4-4526-a349-b08c5ad42a5d None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:09.625210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-cc69dedc-4cd4-4526-a349-b08c5ad42a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:09.647661 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69dedc-4cd4-4526-a349-b08c5ad42a5d None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:09.653318 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a3ab7-23ff-4123-b3b9-b8f14b1c6c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:09.654029 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a3ab7-23ff-4123-b3b9-b8f14b1c6c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:09.654306 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a3ab7-23ff-4123-b3b9-b8f14b1c6c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:09.654762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a3ab7-23ff-4123-b3b9-b8f14b1c6c44 admin admin] PATH_INFO: `/v3/projects/b75681f6c5c6434ca5ffb7ee61c57652` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:09.656164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a3ab7-23ff-4123-b3b9-b8f14b1c6c44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b75681f6c5c6434ca5ffb7ee61c57652)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:09.660347 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a3ab7-23ff-4123-b3b9-b8f14b1c6c44 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:09.921430 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2f3a3ab7-23ff-4123-b3b9-b8f14b1c6c44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b75681f6c5c6434ca5ffb7ee61c57652', 'request_id': 'req-2f3a3ab7-23ff-4123-b3b9-b8f14b1c6c44'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:09.929417 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2f3a3ab7-23ff-4123-b3b9-b8f14b1c6c44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b75681f6c5c6434ca5ffb7ee61c57652', 'request_id': 'req-2f3a3ab7-23ff-4123-b3b9-b8f14b1c6c44'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:09.942115 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2f3a3ab7-23ff-4123-b3b9-b8f14b1c6c44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b75681f6c5c6434ca5ffb7ee61c57652', 'request_id': 'req-2f3a3ab7-23ff-4123-b3b9-b8f14b1c6c44'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:10.144593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2f3a3ab7-23ff-4123-b3b9-b8f14b1c6c44 admin admin] The token cache is being invalidate because project b75681f6c5c6434ca5ffb7ee61c57652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:25:10.146813 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2f3a3ab7-23ff-4123-b3b9-b8f14b1c6c44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:10.147838 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2f3a3ab7-23ff-4123-b3b9-b8f14b1c6c44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:10.153080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1044/2135] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:25:09 2022] DELETE /identity/v3/projects/b75681f6c5c6434ca5ffb7ee61c57652 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:25:10.159552 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc12d83-ad15-4948-a462-c1d66fd0987d None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:10.160428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc12d83-ad15-4948-a462-c1d66fd0987d None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:10.160428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc12d83-ad15-4948-a462-c1d66fd0987d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:10.196700 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-5dc12d83-ad15-4948-a462-c1d66fd0987d None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:25:10.198572 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-5dc12d83-ad15-4948-a462-c1d66fd0987d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:10.304126 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1092/2136] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:25:10.313825 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc27cd2-e766-41ee-a776-b55be544e6f1 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:10.314287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc27cd2-e766-41ee-a776-b55be544e6f1 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:10.314577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc27cd2-e766-41ee-a776-b55be544e6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:10.340197 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-8dc27cd2-e766-41ee-a776-b55be544e6f1 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:25:10.341528 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8dc27cd2-e766-41ee-a776-b55be544e6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:10.354476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1045/2137] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:25:10.359195 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc12d83-ad15-4948-a462-c1d66fd0987d None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:10.370019 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc12d83-ad15-4948-a462-c1d66fd0987d None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:10.375135 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d758c-5a6e-4095-b600-dcdb0837c2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:10.375853 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d758c-5a6e-4095-b600-dcdb0837c2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:10.376067 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d758c-5a6e-4095-b600-dcdb0837c2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:10.376336 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d758c-5a6e-4095-b600-dcdb0837c2d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:10.377392 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d758c-5a6e-4095-b600-dcdb0837c2d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:25:10.377392 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d758c-5a6e-4095-b600-dcdb0837c2d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:10.380467 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d758c-5a6e-4095-b600-dcdb0837c2d2 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:10.404055 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1093/2138] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:25:10.410135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc27cd2-e766-41ee-a776-b55be544e6f1 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:10.427800 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc27cd2-e766-41ee-a776-b55be544e6f1 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:10.434983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2b23f-f380-4527-bf36-1a71dd96d19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:10.435629 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2b23f-f380-4527-bf36-1a71dd96d19c admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:10.436042 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2b23f-f380-4527-bf36-1a71dd96d19c admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:10.436554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2b23f-f380-4527-bf36-1a71dd96d19c admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:10.437557 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2b23f-f380-4527-bf36-1a71dd96d19c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:10.439643 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2b23f-f380-4527-bf36-1a71dd96d19c admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:10.663402 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1046/2139] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:25:10 2022] POST /identity/v3/projects => generated 383 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:25:10.669498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d758c-5a6e-4095-b600-dcdb0837c2d2 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:10.685490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d758c-5a6e-4095-b600-dcdb0837c2d2 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:10.790100 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c85925-8d60-444c-9146-5c28cc2f7d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:10.790802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c85925-8d60-444c-9146-5c28cc2f7d8b admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:10.791003 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c85925-8d60-444c-9146-5c28cc2f7d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:10.791306 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c85925-8d60-444c-9146-5c28cc2f7d8b admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:10.792213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c85925-8d60-444c-9146-5c28cc2f7d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:10.794360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c85925-8d60-444c-9146-5c28cc2f7d8b admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:11.012252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1094/2140] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:25:10 2022] POST /identity/v3/users => generated 292 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:25:11.020136 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2b23f-f380-4527-bf36-1a71dd96d19c admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:11.035010 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2b23f-f380-4527-bf36-1a71dd96d19c admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:11.043433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ab955-b3a1-44f1-a64b-2b0b0b6ee80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:11.045896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:11.046032 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ab955-b3a1-44f1-a64b-2b0b0b6ee80b admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:11.046032 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ab955-b3a1-44f1-a64b-2b0b0b6ee80b admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:11.046032 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ab955-b3a1-44f1-a64b-2b0b0b6ee80b admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:11.046032 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ab955-b3a1-44f1-a64b-2b0b0b6ee80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:11.047738 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ab955-b3a1-44f1-a64b-2b0b0b6ee80b admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:11.071920 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1047/2141] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:25:11.077193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c85925-8d60-444c-9146-5c28cc2f7d8b admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:11.106715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c85925-8d60-444c-9146-5c28cc2f7d8b admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:11.115735 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dccd8f-1f98-4992-b705-5af7bf920a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:11.116126 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dccd8f-1f98-4992-b705-5af7bf920a64 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:11.116427 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dccd8f-1f98-4992-b705-5af7bf920a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:11.116709 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dccd8f-1f98-4992-b705-5af7bf920a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:11.117397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dccd8f-1f98-4992-b705-5af7bf920a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:11.119122 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dccd8f-1f98-4992-b705-5af7bf920a64 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:11.135041 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1095/2142] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:25:11.148418 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ab955-b3a1-44f1-a64b-2b0b0b6ee80b admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:11.163805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ab955-b3a1-44f1-a64b-2b0b0b6ee80b admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:11.172420 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519e5f7-47ad-467b-a46a-688d0e16a501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:11.178966 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519e5f7-47ad-467b-a46a-688d0e16a501 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:11.178966 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519e5f7-47ad-467b-a46a-688d0e16a501 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:11.178966 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519e5f7-47ad-467b-a46a-688d0e16a501 admin admin] PATH_INFO: `/v3/projects/2a715e1b8137477b9f39b1d6d8d0d268/users/b0884441f5744f09b23823752684fe08/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:11.204032 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519e5f7-47ad-467b-a46a-688d0e16a501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a715e1b8137477b9f39b1d6d8d0d268, user_id=b0884441f5744f09b23823752684fe08, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:11.207143 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519e5f7-47ad-467b-a46a-688d0e16a501 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:11.354168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1048/2143] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:25:11 2022] PUT /identity/v3/projects/2a715e1b8137477b9f39b1d6d8d0d268/users/b0884441f5744f09b23823752684fe08/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:25:11.361372 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffada407-6052-420c-b1b8-6f402e23f79a None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:11.362126 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffada407-6052-420c-b1b8-6f402e23f79a None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:11.362306 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffada407-6052-420c-b1b8-6f402e23f79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:11.388162 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-ffada407-6052-420c-b1b8-6f402e23f79a None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:25:11.390739 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ffada407-6052-420c-b1b8-6f402e23f79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:11.482383 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1096/2144] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:25:11.493688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519e5f7-47ad-467b-a46a-688d0e16a501 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:11.496377 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-b519e5f7-47ad-467b-a46a-688d0e16a501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:11.589386 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519e5f7-47ad-467b-a46a-688d0e16a501 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:11.595156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bfffb-855f-4d8e-8914-54cb6e1d492f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:11.595811 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bfffb-855f-4d8e-8914-54cb6e1d492f service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:11.596096 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bfffb-855f-4d8e-8914-54cb6e1d492f service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:11.596411 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bfffb-855f-4d8e-8914-54cb6e1d492f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:11.607381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235bfffb-855f-4d8e-8914-54cb6e1d492f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:11.608953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235bfffb-855f-4d8e-8914-54cb6e1d492f service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:11.622723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1049/2145] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:25:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:25:11.773778 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:14.698791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:15.803099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:19.566343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:20.180178 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:20.680911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2360c0-c54b-456d-8086-a98077a2ebcf None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:20.681454 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2360c0-c54b-456d-8086-a98077a2ebcf None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:20.681454 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2360c0-c54b-456d-8086-a98077a2ebcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:20.738572 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-9f2360c0-c54b-456d-8086-a98077a2ebcf None None] MFA Rules not processed for user `b0884441f5744f09b23823752684fe08`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:25:20.742885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-9f2360c0-c54b-456d-8086-a98077a2ebcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:20.855084 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1097/2146] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:25:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:25:20.859972 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bfffb-855f-4d8e-8914-54cb6e1d492f service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:20.869514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:20.874105 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bfffb-855f-4d8e-8914-54cb6e1d492f service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:20.879151 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a631ea-3594-45c4-bf5c-a5bb9c77e32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:20.879773 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a631ea-3594-45c4-bf5c-a5bb9c77e32a admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:20.880082 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a631ea-3594-45c4-bf5c-a5bb9c77e32a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:20.880561 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a631ea-3594-45c4-bf5c-a5bb9c77e32a admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:20.881227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a631ea-3594-45c4-bf5c-a5bb9c77e32a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:20.883241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a631ea-3594-45c4-bf5c-a5bb9c77e32a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:21.019366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1050/2147] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:25:20 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:25:21.024815 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2360c0-c54b-456d-8086-a98077a2ebcf None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:21.036519 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2360c0-c54b-456d-8086-a98077a2ebcf None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:21.112003 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a54b6-08cc-4cf1-96db-37ce00bce6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:21.112624 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a54b6-08cc-4cf1-96db-37ce00bce6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:21.112912 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a54b6-08cc-4cf1-96db-37ce00bce6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:21.113414 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a54b6-08cc-4cf1-96db-37ce00bce6b8 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:21.113867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a54b6-08cc-4cf1-96db-37ce00bce6b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:21.116058 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a54b6-08cc-4cf1-96db-37ce00bce6b8 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:21.218705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1098/2148] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:25:21 2022] POST /identity/v3/users => generated 299 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:25:21.222742 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a631ea-3594-45c4-bf5c-a5bb9c77e32a admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:21.233268 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a631ea-3594-45c4-bf5c-a5bb9c77e32a admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:21.238080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce61b7-9f37-4d2a-aac2-eba96d3c4dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:21.238689 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce61b7-9f37-4d2a-aac2-eba96d3c4dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:21.238973 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce61b7-9f37-4d2a-aac2-eba96d3c4dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:21.239252 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce61b7-9f37-4d2a-aac2-eba96d3c4dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:21.240005 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce61b7-9f37-4d2a-aac2-eba96d3c4dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:21.241677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce61b7-9f37-4d2a-aac2-eba96d3c4dc0 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:21.256586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1051/2149] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:25:21.257768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a54b6-08cc-4cf1-96db-37ce00bce6b8 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:21.268638 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a54b6-08cc-4cf1-96db-37ce00bce6b8 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:21.274983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104e38b-f335-48a7-b567-7ba77f065ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:21.275656 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104e38b-f335-48a7-b567-7ba77f065ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:21.275941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104e38b-f335-48a7-b567-7ba77f065ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:21.276219 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104e38b-f335-48a7-b567-7ba77f065ae2 admin admin] PATH_INFO: `/v3/projects/4e7e12bf88cf4600a747394aabd1b594/users/64926cf65bab4ce8bdb4047f3b91da09/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:21.296138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104e38b-f335-48a7-b567-7ba77f065ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7e12bf88cf4600a747394aabd1b594, user_id=64926cf65bab4ce8bdb4047f3b91da09, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:21.298863 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104e38b-f335-48a7-b567-7ba77f065ae2 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:21.441262 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1099/2150] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:25:21 2022] PUT /identity/v3/projects/4e7e12bf88cf4600a747394aabd1b594/users/64926cf65bab4ce8bdb4047f3b91da09/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:25:21.449123 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce61b7-9f37-4d2a-aac2-eba96d3c4dc0 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:21.459494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce61b7-9f37-4d2a-aac2-eba96d3c4dc0 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:21.523628 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699ccb7-6aa1-4b79-a286-ca9f7d3ff7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:21.524250 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699ccb7-6aa1-4b79-a286-ca9f7d3ff7ad admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:21.524541 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699ccb7-6aa1-4b79-a286-ca9f7d3ff7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:21.524820 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699ccb7-6aa1-4b79-a286-ca9f7d3ff7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:21.525486 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699ccb7-6aa1-4b79-a286-ca9f7d3ff7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:21.527203 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699ccb7-6aa1-4b79-a286-ca9f7d3ff7ad admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:21.537853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1052/2151] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:25:21.542090 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104e38b-f335-48a7-b567-7ba77f065ae2 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:21.554159 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104e38b-f335-48a7-b567-7ba77f065ae2 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:21.559112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a2fb1-17fc-4372-a74a-85b59cdc0b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:21.559786 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a2fb1-17fc-4372-a74a-85b59cdc0b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:21.561183 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a2fb1-17fc-4372-a74a-85b59cdc0b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:21.561183 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a2fb1-17fc-4372-a74a-85b59cdc0b3a admin admin] PATH_INFO: `/v3/projects/4e7e12bf88cf4600a747394aabd1b594/users/64926cf65bab4ce8bdb4047f3b91da09/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:21.562346 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a2fb1-17fc-4372-a74a-85b59cdc0b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7e12bf88cf4600a747394aabd1b594, user_id=64926cf65bab4ce8bdb4047f3b91da09, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:21.565028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a2fb1-17fc-4372-a74a-85b59cdc0b3a admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:21.577129 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1100/2152] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:25:21 2022] PUT /identity/v3/projects/4e7e12bf88cf4600a747394aabd1b594/users/64926cf65bab4ce8bdb4047f3b91da09/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:25:22.378176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:22.910291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:24.263617 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:28.994644 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:29.808517 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:30.161660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2485920-0e94-4452-b33e-457c636c2d95 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:30.162206 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2485920-0e94-4452-b33e-457c636c2d95 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:30.164458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2485920-0e94-4452-b33e-457c636c2d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:30.203941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-b2485920-0e94-4452-b33e-457c636c2d95 None None] MFA Rules not processed for user `f45f65dd3a844cb583e42d837d2a58d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:25:30.215400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-b2485920-0e94-4452-b33e-457c636c2d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:30.323370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1053/2153] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Sep 2 21:25:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:25:30.435770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a2fb1-17fc-4372-a74a-85b59cdc0b3a admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:30.438803 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ea5a2fb1-17fc-4372-a74a-85b59cdc0b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:30.562940 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2485920-0e94-4452-b33e-457c636c2d95 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:30.566514 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-b2485920-0e94-4452-b33e-457c636c2d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:30.771105 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2485920-0e94-4452-b33e-457c636c2d95 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:30.775167 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a2fb1-17fc-4372-a74a-85b59cdc0b3a admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:30.779244 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fce76-b92c-4818-808d-34ec880fcd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:30.780060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fce76-b92c-4818-808d-34ec880fcd5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:30.780548 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fce76-b92c-4818-808d-34ec880fcd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:30.781206 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fce76-b92c-4818-808d-34ec880fcd5f admin admin] PATH_INFO: `/v3/users/ed5b3792ab6c49988f6cf13d07c3cb6b` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:30.782759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fce76-b92c-4818-808d-34ec880fcd5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed5b3792ab6c49988f6cf13d07c3cb6b)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:30.785196 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fce76-b92c-4818-808d-34ec880fcd5f admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:30.786144 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b5072-fc24-4888-92ee-86fddf74523e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da2b1dc9dae413a8ee63ad67e840f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:30.787084 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b5072-fc24-4888-92ee-86fddf74523e service swift] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:30.793632 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b5072-fc24-4888-92ee-86fddf74523e service swift] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:30.794464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b5072-fc24-4888-92ee-86fddf74523e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:30.810461 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b5072-fc24-4888-92ee-86fddf74523e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:30.823380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b5072-fc24-4888-92ee-86fddf74523e service swift] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:30.824535 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1101/2154] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Sep 2 21:25:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:25:31.344953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-cd2fce76-b92c-4818-808d-34ec880fcd5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed5b3792ab6c49988f6cf13d07c3cb6b'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:31.344953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-cd2fce76-b92c-4818-808d-34ec880fcd5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed5b3792ab6c49988f6cf13d07c3cb6b'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:31.347373 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-cd2fce76-b92c-4818-808d-34ec880fcd5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed5b3792ab6c49988f6cf13d07c3cb6b'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:31.366635 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-cd2fce76-b92c-4818-808d-34ec880fcd5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed5b3792ab6c49988f6cf13d07c3cb6b'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:31.368158 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-cd2fce76-b92c-4818-808d-34ec880fcd5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed5b3792ab6c49988f6cf13d07c3cb6b'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:31.518223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1054/2155] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:25:30 2022] DELETE /identity/v3/users/ed5b3792ab6c49988f6cf13d07c3cb6b => generated 0 bytes in 956 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:25:31.524319 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b16a3-4fc4-4549-97c4-de904d8e4e53 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:31.525495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b16a3-4fc4-4549-97c4-de904d8e4e53 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:31.526019 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b16a3-4fc4-4549-97c4-de904d8e4e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:31.566413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-133b16a3-4fc4-4549-97c4-de904d8e4e53 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:25:31.569114 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-133b16a3-4fc4-4549-97c4-de904d8e4e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:31.845725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1102/2156] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:25:31.859950 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fce76-b92c-4818-808d-34ec880fcd5f admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:31.861759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-cd2fce76-b92c-4818-808d-34ec880fcd5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:32.002209 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fce76-b92c-4818-808d-34ec880fcd5f admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:32.010881 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195a992-3284-4c3b-893a-52202d143b4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:32.012210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195a992-3284-4c3b-893a-52202d143b4a service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:32.012906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195a992-3284-4c3b-893a-52202d143b4a service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:32.013432 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195a992-3284-4c3b-893a-52202d143b4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:32.026974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195a992-3284-4c3b-893a-52202d143b4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:32.029414 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195a992-3284-4c3b-893a-52202d143b4a service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:32.052133 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1055/2157] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:25:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:25:32.207179 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c577f17-0302-4745-9828-31ee037d5fd7 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:32.208675 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c577f17-0302-4745-9828-31ee037d5fd7 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:32.209175 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c577f17-0302-4745-9828-31ee037d5fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:32.288708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-4c577f17-0302-4745-9828-31ee037d5fd7 None None] MFA Rules not processed for user `64926cf65bab4ce8bdb4047f3b91da09`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:25:32.291358 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-4c577f17-0302-4745-9828-31ee037d5fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:32.497406 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1103/2158] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:25:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:25:32.894420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:33.103447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195a992-3284-4c3b-893a-52202d143b4a service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:33.103447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-0195a992-3284-4c3b-893a-52202d143b4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:33.165490 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195a992-3284-4c3b-893a-52202d143b4a service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:33.180995 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647139a-d188-4eca-835e-b84fb4e78b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:33.181755 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647139a-d188-4eca-835e-b84fb4e78b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:33.182136 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647139a-d188-4eca-835e-b84fb4e78b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:33.182598 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647139a-d188-4eca-835e-b84fb4e78b82 admin admin] PATH_INFO: `/v3/projects/66288fdaf8504842a91cf26e197693da` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:33.187270 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647139a-d188-4eca-835e-b84fb4e78b82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66288fdaf8504842a91cf26e197693da)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:33.191566 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647139a-d188-4eca-835e-b84fb4e78b82 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:33.391421 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c577f17-0302-4745-9828-31ee037d5fd7 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:33.394111 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-4c577f17-0302-4745-9828-31ee037d5fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:33.411937 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e647139a-d188-4eca-835e-b84fb4e78b82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66288fdaf8504842a91cf26e197693da', 'request_id': 'req-e647139a-d188-4eca-835e-b84fb4e78b82'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:33.429879 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e647139a-d188-4eca-835e-b84fb4e78b82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66288fdaf8504842a91cf26e197693da', 'request_id': 'req-e647139a-d188-4eca-835e-b84fb4e78b82'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:33.457098 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e647139a-d188-4eca-835e-b84fb4e78b82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66288fdaf8504842a91cf26e197693da', 'request_id': 'req-e647139a-d188-4eca-835e-b84fb4e78b82'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:33.532763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e647139a-d188-4eca-835e-b84fb4e78b82 admin admin] The token cache is being invalidate because project 66288fdaf8504842a91cf26e197693da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:25:33.533103 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e647139a-d188-4eca-835e-b84fb4e78b82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:33.534300 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e647139a-d188-4eca-835e-b84fb4e78b82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:33.543646 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1056/2159] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:25:33 2022] DELETE /identity/v3/projects/66288fdaf8504842a91cf26e197693da => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:25:33.547985 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647139a-d188-4eca-835e-b84fb4e78b82 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:33.553459 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e647139a-d188-4eca-835e-b84fb4e78b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:33.646078 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:33.668361 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c577f17-0302-4745-9828-31ee037d5fd7 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:33.777293 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647139a-d188-4eca-835e-b84fb4e78b82 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:33.782428 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc6202-0634-4976-ac92-e179b32129ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:33.783928 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc6202-0634-4976-ac92-e179b32129ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:33.784222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc6202-0634-4976-ac92-e179b32129ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:33.784510 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc6202-0634-4976-ac92-e179b32129ca admin admin] PATH_INFO: `/v3/users/543a66ead0794e04b04ae93bcf463097` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:33.787527 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc6202-0634-4976-ac92-e179b32129ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=543a66ead0794e04b04ae93bcf463097)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:33.789739 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc6202-0634-4976-ac92-e179b32129ca admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:33.822293 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb45b3e-abda-43fa-9a47-7a08d83a0827 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72840602ec264a74855b601c8d1ddf89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:33.840333 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb45b3e-abda-43fa-9a47-7a08d83a0827 service glance] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:33.840333 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb45b3e-abda-43fa-9a47-7a08d83a0827 service glance] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:33.840333 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb45b3e-abda-43fa-9a47-7a08d83a0827 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:33.841416 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-edb45b3e-abda-43fa-9a47-7a08d83a0827 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:33.985464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb45b3e-abda-43fa-9a47-7a08d83a0827 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:33.988120 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb45b3e-abda-43fa-9a47-7a08d83a0827 service glance] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:33.999903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1104/2160] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:25:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:25:34.222207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-c8fc6202-0634-4976-ac92-e179b32129ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '543a66ead0794e04b04ae93bcf463097'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:34.224913 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-c8fc6202-0634-4976-ac92-e179b32129ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '543a66ead0794e04b04ae93bcf463097'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:34.280752 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-c8fc6202-0634-4976-ac92-e179b32129ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '543a66ead0794e04b04ae93bcf463097'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:34.351776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-c8fc6202-0634-4976-ac92-e179b32129ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '543a66ead0794e04b04ae93bcf463097'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:34.351776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-c8fc6202-0634-4976-ac92-e179b32129ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '543a66ead0794e04b04ae93bcf463097'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:34.538691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1057/2161] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:25:33 2022] DELETE /identity/v3/users/543a66ead0794e04b04ae93bcf463097 => generated 0 bytes in 985 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:25:34.603397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f748bb-e3c8-4ad1-b8b0-50f95b5bb87d None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:34.603882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f748bb-e3c8-4ad1-b8b0-50f95b5bb87d None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:34.604360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f748bb-e3c8-4ad1-b8b0-50f95b5bb87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:34.735900 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-e6f748bb-e3c8-4ad1-b8b0-50f95b5bb87d None None] MFA Rules not processed for user `f45f65dd3a844cb583e42d837d2a58d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:25:34.737404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-e6f748bb-e3c8-4ad1-b8b0-50f95b5bb87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:34.989591 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1105/2162] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Sep 2 21:25:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:25:35.010900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc6202-0634-4976-ac92-e179b32129ca admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:35.012711 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-c8fc6202-0634-4976-ac92-e179b32129ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:35.218027 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc6202-0634-4976-ac92-e179b32129ca admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:35.233699 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc4e3e-f837-4620-b654-95daa4745e51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da2b1dc9dae413a8ee63ad67e840f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:35.234915 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc4e3e-f837-4620-b654-95daa4745e51 service swift] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:35.234915 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc4e3e-f837-4620-b654-95daa4745e51 service swift] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:35.235813 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc4e3e-f837-4620-b654-95daa4745e51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:35.259086 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc4e3e-f837-4620-b654-95daa4745e51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:35.261040 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc4e3e-f837-4620-b654-95daa4745e51 service swift] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:35.289857 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1058/2163] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Sep 2 21:25:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:25:35.340553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:35.411384 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f748bb-e3c8-4ad1-b8b0-50f95b5bb87d None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:35.412747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-e6f748bb-e3c8-4ad1-b8b0-50f95b5bb87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:35.678178 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f748bb-e3c8-4ad1-b8b0-50f95b5bb87d None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:35.726080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775f2f9-f4bc-4ed4-a80c-45690447af60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:35.726787 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775f2f9-f4bc-4ed4-a80c-45690447af60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:35.727081 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775f2f9-f4bc-4ed4-a80c-45690447af60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:35.727364 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775f2f9-f4bc-4ed4-a80c-45690447af60 admin admin] PATH_INFO: `/v3/projects/f8cb7afb037d4c639a33bd46fdf30517` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:35.740228 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775f2f9-f4bc-4ed4-a80c-45690447af60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8cb7afb037d4c639a33bd46fdf30517)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:35.744212 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775f2f9-f4bc-4ed4-a80c-45690447af60 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:35.936829 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e775f2f9-f4bc-4ed4-a80c-45690447af60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8cb7afb037d4c639a33bd46fdf30517', 'request_id': 'req-e775f2f9-f4bc-4ed4-a80c-45690447af60'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:35.952515 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e775f2f9-f4bc-4ed4-a80c-45690447af60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8cb7afb037d4c639a33bd46fdf30517', 'request_id': 'req-e775f2f9-f4bc-4ed4-a80c-45690447af60'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:35.969798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e775f2f9-f4bc-4ed4-a80c-45690447af60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8cb7afb037d4c639a33bd46fdf30517', 'request_id': 'req-e775f2f9-f4bc-4ed4-a80c-45690447af60'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:36.102703 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e775f2f9-f4bc-4ed4-a80c-45690447af60 admin admin] The token cache is being invalidate because project f8cb7afb037d4c639a33bd46fdf30517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:25:36.103805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e775f2f9-f4bc-4ed4-a80c-45690447af60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:36.107190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e775f2f9-f4bc-4ed4-a80c-45690447af60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:25:36.112774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1106/2164] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:25:35 2022] DELETE /identity/v3/projects/f8cb7afb037d4c639a33bd46fdf30517 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:25:36.115580 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd40f5-e583-467c-83d6-a7e15dc2f91d None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:36.116424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd40f5-e583-467c-83d6-a7e15dc2f91d None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:36.117294 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd40f5-e583-467c-83d6-a7e15dc2f91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:36.215516 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-82dd40f5-e583-467c-83d6-a7e15dc2f91d None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:25:36.216830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-82dd40f5-e583-467c-83d6-a7e15dc2f91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:36.383983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa73aef-8c3f-4fc6-8b7b-f8a078717b05 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:36.384337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1059/2165] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:25:36.384927 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa73aef-8c3f-4fc6-8b7b-f8a078717b05 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:36.385049 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa73aef-8c3f-4fc6-8b7b-f8a078717b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:36.477481 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-3fa73aef-8c3f-4fc6-8b7b-f8a078717b05 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:25:36.479287 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-3fa73aef-8c3f-4fc6-8b7b-f8a078717b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:36.509904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1107/2166] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:25:36.516030 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd40f5-e583-467c-83d6-a7e15dc2f91d None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:36.531005 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd40f5-e583-467c-83d6-a7e15dc2f91d None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:36.564043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b253e-7672-4120-becb-eb71131a8cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:36.564043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b253e-7672-4120-becb-eb71131a8cdc admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:36.564043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b253e-7672-4120-becb-eb71131a8cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:36.564043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b253e-7672-4120-becb-eb71131a8cdc admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:36.564504 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b253e-7672-4120-becb-eb71131a8cdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:25:36.564504 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b253e-7672-4120-becb-eb71131a8cdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:36.564504 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b253e-7672-4120-becb-eb71131a8cdc admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:36.597327 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa73aef-8c3f-4fc6-8b7b-f8a078717b05 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:36.609443 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa73aef-8c3f-4fc6-8b7b-f8a078717b05 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:36.619627 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1060/2167] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:25:36.669447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a49826-acfe-4306-bdfa-25f8ff9f2285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:36.669447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a49826-acfe-4306-bdfa-25f8ff9f2285 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:36.669447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a49826-acfe-4306-bdfa-25f8ff9f2285 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:36.669447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a49826-acfe-4306-bdfa-25f8ff9f2285 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:36.670626 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a49826-acfe-4306-bdfa-25f8ff9f2285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:36.670626 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a49826-acfe-4306-bdfa-25f8ff9f2285 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:36.963369 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b253e-7672-4120-becb-eb71131a8cdc admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:36.964729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1108/2168] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:25:36 2022] POST /identity/v3/projects => generated 391 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:25:36.986843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b253e-7672-4120-becb-eb71131a8cdc admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:37.117273 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:37.320428 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead33a3c-9bd9-43a2-96f7-2b510477b95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:37.321942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead33a3c-9bd9-43a2-96f7-2b510477b95b admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:37.322417 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead33a3c-9bd9-43a2-96f7-2b510477b95b admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:37.323040 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead33a3c-9bd9-43a2-96f7-2b510477b95b admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:37.324792 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead33a3c-9bd9-43a2-96f7-2b510477b95b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:37.329183 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead33a3c-9bd9-43a2-96f7-2b510477b95b admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:37.900006 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1061/2169] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:25:36 2022] POST /identity/v3/users => generated 296 bytes in 926 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:25:37.900881 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a49826-acfe-4306-bdfa-25f8ff9f2285 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:37.920332 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a49826-acfe-4306-bdfa-25f8ff9f2285 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:37.933061 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c9107-4c85-46be-a4f1-3d2586db7404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:37.934531 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c9107-4c85-46be-a4f1-3d2586db7404 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:37.935341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c9107-4c85-46be-a4f1-3d2586db7404 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:37.936047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c9107-4c85-46be-a4f1-3d2586db7404 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:37.937712 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c9107-4c85-46be-a4f1-3d2586db7404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:37.941185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c9107-4c85-46be-a4f1-3d2586db7404 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:37.989917 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1109/2170] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:25:37.991291 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead33a3c-9bd9-43a2-96f7-2b510477b95b admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:38.037504 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead33a3c-9bd9-43a2-96f7-2b510477b95b admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:38.076976 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94570c8c-8380-4469-953b-df380362e69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:38.081679 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94570c8c-8380-4469-953b-df380362e69a admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:38.086793 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94570c8c-8380-4469-953b-df380362e69a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:38.087528 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94570c8c-8380-4469-953b-df380362e69a admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:38.094276 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94570c8c-8380-4469-953b-df380362e69a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:38.098717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94570c8c-8380-4469-953b-df380362e69a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:38.154952 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1062/2171] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:25:38.156710 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c9107-4c85-46be-a4f1-3d2586db7404 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:38.180292 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c9107-4c85-46be-a4f1-3d2586db7404 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:38.198123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a216ad0-8237-4dd9-b19c-112b31f75605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:38.198989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a216ad0-8237-4dd9-b19c-112b31f75605 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:38.199381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a216ad0-8237-4dd9-b19c-112b31f75605 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:38.199767 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a216ad0-8237-4dd9-b19c-112b31f75605 admin admin] PATH_INFO: `/v3/projects/923365fa6cdf4390b957deea7f7e6e30/users/b3d36615d23f496492cf8b42d71e650d/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:38.260649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a216ad0-8237-4dd9-b19c-112b31f75605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=923365fa6cdf4390b957deea7f7e6e30, user_id=b3d36615d23f496492cf8b42d71e650d, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:38.266687 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a216ad0-8237-4dd9-b19c-112b31f75605 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:38.478978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1110/2172] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:25:38 2022] PUT /identity/v3/projects/923365fa6cdf4390b957deea7f7e6e30/users/b3d36615d23f496492cf8b42d71e650d/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:25:38.492685 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2225f23-cf93-413a-bc87-5c18fe6b53c2 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:38.493005 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2225f23-cf93-413a-bc87-5c18fe6b53c2 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:38.493406 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2225f23-cf93-413a-bc87-5c18fe6b53c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:38.616583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-d2225f23-cf93-413a-bc87-5c18fe6b53c2 None None] MFA Rules not processed for user `b3d36615d23f496492cf8b42d71e650d`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:25:38.626867 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d2225f23-cf93-413a-bc87-5c18fe6b53c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:38.884531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1063/2173] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:25:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:25:38.890559 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a216ad0-8237-4dd9-b19c-112b31f75605 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:39.092814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a216ad0-8237-4dd9-b19c-112b31f75605 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:39.104098 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665f933-aafa-4952-a0a2-ea6c4e96e4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:39.106281 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665f933-aafa-4952-a0a2-ea6c4e96e4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:39.106998 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665f933-aafa-4952-a0a2-ea6c4e96e4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:39.107689 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665f933-aafa-4952-a0a2-ea6c4e96e4e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:39.109324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665f933-aafa-4952-a0a2-ea6c4e96e4e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:39.117784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665f933-aafa-4952-a0a2-ea6c4e96e4e2 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:39.186765 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638700b-66f6-4b59-b57d-31c5a3b69bbf None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:39.187707 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638700b-66f6-4b59-b57d-31c5a3b69bbf None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:39.188294 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638700b-66f6-4b59-b57d-31c5a3b69bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:39.226197 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-1638700b-66f6-4b59-b57d-31c5a3b69bbf None None] MFA Rules not processed for user `c81bafbe3e444e84a7da18ac9d782479`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:25:39.228059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-1638700b-66f6-4b59-b57d-31c5a3b69bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:39.303463 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1111/2174] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:25:38 2022] POST /identity/v3/projects => generated 393 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:25:39.310717 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665f933-aafa-4952-a0a2-ea6c4e96e4e2 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:39.416828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1064/2175] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:25:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:25:39.536201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665f933-aafa-4952-a0a2-ea6c4e96e4e2 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:39.563398 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b00b11-199e-4d32-8ca3-793a870b48ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:39.564152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b00b11-199e-4d32-8ca3-793a870b48ba admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:39.564544 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b00b11-199e-4d32-8ca3-793a870b48ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:39.564944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b00b11-199e-4d32-8ca3-793a870b48ba admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:39.565697 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b00b11-199e-4d32-8ca3-793a870b48ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:39.576309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b00b11-199e-4d32-8ca3-793a870b48ba admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:39.593072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:39.755000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638700b-66f6-4b59-b57d-31c5a3b69bbf None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:39.758054 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1112/2176] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:25:39 2022] POST /identity/v3/users => generated 303 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:25:39.770986 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638700b-66f6-4b59-b57d-31c5a3b69bbf None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:39.776903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8114b-167e-4976-8965-56e90816d1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:39.777966 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8114b-167e-4976-8965-56e90816d1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:39.796298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8114b-167e-4976-8965-56e90816d1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:39.796298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8114b-167e-4976-8965-56e90816d1c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:39.796298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8114b-167e-4976-8965-56e90816d1c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:39.796298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8114b-167e-4976-8965-56e90816d1c5 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:39.800308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1065/2177] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:25:39.805112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b00b11-199e-4d32-8ca3-793a870b48ba admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:39.835173 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b00b11-199e-4d32-8ca3-793a870b48ba admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:39.851982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade2f90-06fc-4a33-ad4f-8da00520cad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:39.853054 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade2f90-06fc-4a33-ad4f-8da00520cad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:39.853616 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade2f90-06fc-4a33-ad4f-8da00520cad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:39.854135 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade2f90-06fc-4a33-ad4f-8da00520cad6 admin admin] PATH_INFO: `/v3/projects/f48b9c9eb6634717b4574b94e11ea623/users/3e04f78a67324b27918f5dcde1bdeed1/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:39.880978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade2f90-06fc-4a33-ad4f-8da00520cad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48b9c9eb6634717b4574b94e11ea623, user_id=3e04f78a67324b27918f5dcde1bdeed1, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:39.884788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade2f90-06fc-4a33-ad4f-8da00520cad6 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:40.025623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1113/2178] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:25:39 2022] PUT /identity/v3/projects/f48b9c9eb6634717b4574b94e11ea623/users/3e04f78a67324b27918f5dcde1bdeed1/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:25:40.029703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8114b-167e-4976-8965-56e90816d1c5 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:40.051821 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8114b-167e-4976-8965-56e90816d1c5 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:40.181276 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dee85-8f58-4839-9936-8e10d5589d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:40.182257 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dee85-8f58-4839-9936-8e10d5589d07 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:40.182697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dee85-8f58-4839-9936-8e10d5589d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:40.183152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dee85-8f58-4839-9936-8e10d5589d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:40.184330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dee85-8f58-4839-9936-8e10d5589d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:40.190755 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dee85-8f58-4839-9936-8e10d5589d07 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:40.218059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1066/2179] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:25:40.225032 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade2f90-06fc-4a33-ad4f-8da00520cad6 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:40.241020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:40.259881 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade2f90-06fc-4a33-ad4f-8da00520cad6 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:40.281699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a6c49-5a6c-4260-9ee2-71d56f24c9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:40.283075 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a6c49-5a6c-4260-9ee2-71d56f24c9fa admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:40.283784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a6c49-5a6c-4260-9ee2-71d56f24c9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:40.284347 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a6c49-5a6c-4260-9ee2-71d56f24c9fa admin admin] PATH_INFO: `/v3/projects/f48b9c9eb6634717b4574b94e11ea623/users/3e04f78a67324b27918f5dcde1bdeed1/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:40.292451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a6c49-5a6c-4260-9ee2-71d56f24c9fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48b9c9eb6634717b4574b94e11ea623, user_id=3e04f78a67324b27918f5dcde1bdeed1, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:40.298574 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a6c49-5a6c-4260-9ee2-71d56f24c9fa admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:40.321824 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1114/2180] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:25:40 2022] PUT /identity/v3/projects/f48b9c9eb6634717b4574b94e11ea623/users/3e04f78a67324b27918f5dcde1bdeed1/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:25:40.340105 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1ef74-9fca-4702-8b51-75675b797757 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:40.341069 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1ef74-9fca-4702-8b51-75675b797757 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:40.341772 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1ef74-9fca-4702-8b51-75675b797757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:40.420104 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-2af1ef74-9fca-4702-8b51-75675b797757 None None] MFA Rules not processed for user `3e04f78a67324b27918f5dcde1bdeed1`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:25:40.420364 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-2af1ef74-9fca-4702-8b51-75675b797757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:40.741450 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a6c49-5a6c-4260-9ee2-71d56f24c9fa admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:40.742146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1067/2181] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:25:40 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:25:40.780762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-545a6c49-5a6c-4260-9ee2-71d56f24c9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:41.104426 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a6c49-5a6c-4260-9ee2-71d56f24c9fa admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:41.118686 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa1c30-5b7d-4edc-a211-2b776ca385a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:41.119729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa1c30-5b7d-4edc-a211-2b776ca385a4 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:41.122614 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa1c30-5b7d-4edc-a211-2b776ca385a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:41.123089 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa1c30-5b7d-4edc-a211-2b776ca385a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:41.173920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa1c30-5b7d-4edc-a211-2b776ca385a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:41.198632 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa1c30-5b7d-4edc-a211-2b776ca385a4 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:41.242177 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1115/2182] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:25:40 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:25:41.404435 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1ef74-9fca-4702-8b51-75675b797757 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:41.430826 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1ef74-9fca-4702-8b51-75675b797757 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:25:41.464331 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a225d5-5e7d-4076-bbd0-92ade9317f8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:25:41.465456 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a225d5-5e7d-4076-bbd0-92ade9317f8b service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:41.465769 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a225d5-5e7d-4076-bbd0-92ade9317f8b service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:41.466227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a225d5-5e7d-4076-bbd0-92ade9317f8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:41.711094 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a225d5-5e7d-4076-bbd0-92ade9317f8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:25:41.716328 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a225d5-5e7d-4076-bbd0-92ade9317f8b service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:25:41.739376 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1068/2183] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:25:41 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:25:44.057459 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:44.450618 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:47.338013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:47.379062 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:50.445454 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:50.548356 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:51.833664 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:52.971473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:53.330309 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:54.921956 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:56.187291 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:56.266154 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afa4ba-7258-4360-98d7-c520768fcddd None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:25:56.266948 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afa4ba-7258-4360-98d7-c520768fcddd None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:25:56.266948 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afa4ba-7258-4360-98d7-c520768fcddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:25:56.300983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-02afa4ba-7258-4360-98d7-c520768fcddd None None] MFA Rules not processed for user `b0884441f5744f09b23823752684fe08`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:25:56.300983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-02afa4ba-7258-4360-98d7-c520768fcddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:25:56.366653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1116/2184] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:25:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:25:57.514737 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:58.233936 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:59.021284 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:59.914173 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a225d5-5e7d-4076-bbd0-92ade9317f8b service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:25:59.915751 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-93a225d5-5e7d-4076-bbd0-92ade9317f8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:00.010339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a225d5-5e7d-4076-bbd0-92ade9317f8b service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:00.017896 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed60733-a9e6-46fa-8fcc-c7f188de68c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0f9604ee2e43b4967cbdc779e63e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:00.018955 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed60733-a9e6-46fa-8fcc-c7f188de68c4 service placement] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:00.019474 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed60733-a9e6-46fa-8fcc-c7f188de68c4 service placement] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:00.019958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed60733-a9e6-46fa-8fcc-c7f188de68c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:00.022336 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-aed60733-a9e6-46fa-8fcc-c7f188de68c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:00.039197 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed60733-a9e6-46fa-8fcc-c7f188de68c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:00.040830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed60733-a9e6-46fa-8fcc-c7f188de68c4 service placement] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:00.055049 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1069/2185] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:25:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:00.141690 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:00.171078 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:02.377469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:03.203986 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afa4ba-7258-4360-98d7-c520768fcddd None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:03.304488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afa4ba-7258-4360-98d7-c520768fcddd None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:03.310450 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b29ce8-bd7a-42cf-bbbc-41b7292d65bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:03.311097 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b29ce8-bd7a-42cf-bbbc-41b7292d65bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:03.311383 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b29ce8-bd7a-42cf-bbbc-41b7292d65bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:03.313920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b29ce8-bd7a-42cf-bbbc-41b7292d65bb admin admin] PATH_INFO: `/v3/users/b3d36615d23f496492cf8b42d71e650d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:03.313920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b29ce8-bd7a-42cf-bbbc-41b7292d65bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3d36615d23f496492cf8b42d71e650d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:03.315497 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b29ce8-bd7a-42cf-bbbc-41b7292d65bb admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:03.461160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:03.664735 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-35b29ce8-bd7a-42cf-bbbc-41b7292d65bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3d36615d23f496492cf8b42d71e650d'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:03.665907 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-35b29ce8-bd7a-42cf-bbbc-41b7292d65bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3d36615d23f496492cf8b42d71e650d'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:03.679579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-35b29ce8-bd7a-42cf-bbbc-41b7292d65bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3d36615d23f496492cf8b42d71e650d'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:03.686543 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-35b29ce8-bd7a-42cf-bbbc-41b7292d65bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3d36615d23f496492cf8b42d71e650d'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:03.687302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-35b29ce8-bd7a-42cf-bbbc-41b7292d65bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3d36615d23f496492cf8b42d71e650d'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:03.796148 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1117/2186] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:26:03 2022] DELETE /identity/v3/users/b3d36615d23f496492cf8b42d71e650d => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:03.798851 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04679a87-9c2d-4d80-8e5f-6b229fcdc59f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:03.799336 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04679a87-9c2d-4d80-8e5f-6b229fcdc59f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:03.799762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04679a87-9c2d-4d80-8e5f-6b229fcdc59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:03.836763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-04679a87-9c2d-4d80-8e5f-6b229fcdc59f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:03.839108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-04679a87-9c2d-4d80-8e5f-6b229fcdc59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:03.924557 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1070/2187] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:03.935440 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b29ce8-bd7a-42cf-bbbc-41b7292d65bb admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:03.937720 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-35b29ce8-bd7a-42cf-bbbc-41b7292d65bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:04.030611 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b29ce8-bd7a-42cf-bbbc-41b7292d65bb admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:04.041460 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6480ed-e046-4b79-8b9a-2992dae56983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:04.042422 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6480ed-e046-4b79-8b9a-2992dae56983 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:04.042718 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6480ed-e046-4b79-8b9a-2992dae56983 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:04.043112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6480ed-e046-4b79-8b9a-2992dae56983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:04.062792 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6480ed-e046-4b79-8b9a-2992dae56983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:04.064394 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6480ed-e046-4b79-8b9a-2992dae56983 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:04.078871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1118/2188] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:04.529986 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:04.937477 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04679a87-9c2d-4d80-8e5f-6b229fcdc59f None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:04.941527 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-04679a87-9c2d-4d80-8e5f-6b229fcdc59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:04.972533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04679a87-9c2d-4d80-8e5f-6b229fcdc59f None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:04.979681 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de6394-5868-4e08-aa9f-8ef31f48bb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:04.980878 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de6394-5868-4e08-aa9f-8ef31f48bb83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:04.981288 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de6394-5868-4e08-aa9f-8ef31f48bb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:04.981736 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de6394-5868-4e08-aa9f-8ef31f48bb83 admin admin] PATH_INFO: `/v3/projects/923365fa6cdf4390b957deea7f7e6e30` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:04.983483 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de6394-5868-4e08-aa9f-8ef31f48bb83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=923365fa6cdf4390b957deea7f7e6e30)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:04.992479 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de6394-5868-4e08-aa9f-8ef31f48bb83 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:05.134602 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d4de6394-5868-4e08-aa9f-8ef31f48bb83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '923365fa6cdf4390b957deea7f7e6e30', 'request_id': 'req-d4de6394-5868-4e08-aa9f-8ef31f48bb83'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:05.142059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d4de6394-5868-4e08-aa9f-8ef31f48bb83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '923365fa6cdf4390b957deea7f7e6e30', 'request_id': 'req-d4de6394-5868-4e08-aa9f-8ef31f48bb83'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:05.148693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d4de6394-5868-4e08-aa9f-8ef31f48bb83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '923365fa6cdf4390b957deea7f7e6e30', 'request_id': 'req-d4de6394-5868-4e08-aa9f-8ef31f48bb83'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:05.224061 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:05.273388 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d4de6394-5868-4e08-aa9f-8ef31f48bb83 admin admin] The token cache is being invalidate because project 923365fa6cdf4390b957deea7f7e6e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:26:05.277050 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d4de6394-5868-4e08-aa9f-8ef31f48bb83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:05.277050 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d4de6394-5868-4e08-aa9f-8ef31f48bb83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:05.279772 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1071/2189] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:26:04 2022] DELETE /identity/v3/projects/923365fa6cdf4390b957deea7f7e6e30 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:26:05.280749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6480ed-e046-4b79-8b9a-2992dae56983 service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:05.299737 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6480ed-e046-4b79-8b9a-2992dae56983 service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:05.435826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c46ef-1d32-4cd0-9e41-90fef9aa0652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:05.437129 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c46ef-1d32-4cd0-9e41-90fef9aa0652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:05.437476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c46ef-1d32-4cd0-9e41-90fef9aa0652 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:05.437817 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c46ef-1d32-4cd0-9e41-90fef9aa0652 admin admin] PATH_INFO: `/v3/users/3e04f78a67324b27918f5dcde1bdeed1` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:05.441726 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c46ef-1d32-4cd0-9e41-90fef9aa0652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e04f78a67324b27918f5dcde1bdeed1)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:05.449016 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c46ef-1d32-4cd0-9e41-90fef9aa0652 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:05.892303 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9b7c46ef-1d32-4cd0-9e41-90fef9aa0652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e04f78a67324b27918f5dcde1bdeed1'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:05.893204 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9b7c46ef-1d32-4cd0-9e41-90fef9aa0652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e04f78a67324b27918f5dcde1bdeed1'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:05.918106 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9b7c46ef-1d32-4cd0-9e41-90fef9aa0652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e04f78a67324b27918f5dcde1bdeed1'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:05.933909 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9b7c46ef-1d32-4cd0-9e41-90fef9aa0652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e04f78a67324b27918f5dcde1bdeed1'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:05.937541 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9b7c46ef-1d32-4cd0-9e41-90fef9aa0652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e04f78a67324b27918f5dcde1bdeed1'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:06.063022 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1119/2190] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:26:05 2022] DELETE /identity/v3/users/3e04f78a67324b27918f5dcde1bdeed1 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:06.339942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837272c-026c-4620-97de-a110c8150cd0 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:06.339942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837272c-026c-4620-97de-a110c8150cd0 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:06.339942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837272c-026c-4620-97de-a110c8150cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:06.375666 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-0837272c-026c-4620-97de-a110c8150cd0 None None] MFA Rules not processed for user `f45f65dd3a844cb583e42d837d2a58d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:06.377284 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-0837272c-026c-4620-97de-a110c8150cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:06.476063 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1072/2191] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Sep 2 21:26:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:06.489637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c46ef-1d32-4cd0-9e41-90fef9aa0652 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:06.492640 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-9b7c46ef-1d32-4cd0-9e41-90fef9aa0652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:06.586435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c46ef-1d32-4cd0-9e41-90fef9aa0652 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:06.592051 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4363b19-4408-4b73-8035-c6d9e88839c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da2b1dc9dae413a8ee63ad67e840f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:06.592663 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4363b19-4408-4b73-8035-c6d9e88839c4 service swift] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:06.593121 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4363b19-4408-4b73-8035-c6d9e88839c4 service swift] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:06.593548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4363b19-4408-4b73-8035-c6d9e88839c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:06.606652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4363b19-4408-4b73-8035-c6d9e88839c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:06.610228 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4363b19-4408-4b73-8035-c6d9e88839c4 service swift] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:06.625102 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1120/2192] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Sep 2 21:26:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:26:06.635974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb100b7-fb68-4031-8ed6-a1daa10db1c9 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:06.635974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb100b7-fb68-4031-8ed6-a1daa10db1c9 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:06.635974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb100b7-fb68-4031-8ed6-a1daa10db1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:06.661470 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-ddb100b7-fb68-4031-8ed6-a1daa10db1c9 None None] MFA Rules not processed for user `e2940758d8424054bf3a68a42b79bb81`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:06.662810 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ddb100b7-fb68-4031-8ed6-a1daa10db1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:06.772041 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1073/2193] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:07.106900 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:07.125589 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4363b19-4408-4b73-8035-c6d9e88839c4 service swift] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:07.127421 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-e4363b19-4408-4b73-8035-c6d9e88839c4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:07.365322 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4363b19-4408-4b73-8035-c6d9e88839c4 service swift] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:07.382719 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea625d2-32ed-403f-8111-547c23dd2d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:07.383606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea625d2-32ed-403f-8111-547c23dd2d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:07.384051 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea625d2-32ed-403f-8111-547c23dd2d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:07.384507 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea625d2-32ed-403f-8111-547c23dd2d3a admin admin] PATH_INFO: `/v3/projects/f48b9c9eb6634717b4574b94e11ea623` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:07.389026 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea625d2-32ed-403f-8111-547c23dd2d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f48b9c9eb6634717b4574b94e11ea623)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:07.391108 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea625d2-32ed-403f-8111-547c23dd2d3a admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:07.607065 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-bea625d2-32ed-403f-8111-547c23dd2d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f48b9c9eb6634717b4574b94e11ea623', 'request_id': 'req-bea625d2-32ed-403f-8111-547c23dd2d3a'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:07.615872 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-bea625d2-32ed-403f-8111-547c23dd2d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f48b9c9eb6634717b4574b94e11ea623', 'request_id': 'req-bea625d2-32ed-403f-8111-547c23dd2d3a'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:07.623149 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-bea625d2-32ed-403f-8111-547c23dd2d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f48b9c9eb6634717b4574b94e11ea623', 'request_id': 'req-bea625d2-32ed-403f-8111-547c23dd2d3a'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:07.720057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-bea625d2-32ed-403f-8111-547c23dd2d3a admin admin] The token cache is being invalidate because project f48b9c9eb6634717b4574b94e11ea623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:26:07.721146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-bea625d2-32ed-403f-8111-547c23dd2d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:07.724222 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-bea625d2-32ed-403f-8111-547c23dd2d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:07.725275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1121/2194] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:26:07 2022] DELETE /identity/v3/projects/f48b9c9eb6634717b4574b94e11ea623 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:07.730805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffa10d-b79c-44ed-b98e-f4cf764af63f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:07.732352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffa10d-b79c-44ed-b98e-f4cf764af63f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:07.733104 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffa10d-b79c-44ed-b98e-f4cf764af63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:07.816411 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-e3ffa10d-b79c-44ed-b98e-f4cf764af63f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:07.818045 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e3ffa10d-b79c-44ed-b98e-f4cf764af63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:08.000946 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0da5de-c779-44ff-b18f-1258431aa570 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.001228 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0da5de-c779-44ff-b18f-1258431aa570 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.001508 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0da5de-c779-44ff-b18f-1258431aa570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.006267 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1074/2195] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:08.037123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-cc0da5de-c779-44ff-b18f-1258431aa570 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:08.038828 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-cc0da5de-c779-44ff-b18f-1258431aa570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:08.052792 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1122/2196] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:08.059195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffa10d-b79c-44ed-b98e-f4cf764af63f None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:08.079234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffa10d-b79c-44ed-b98e-f4cf764af63f None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:08.086255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bd3fe-33bc-41dd-bd0f-4cd6caab50cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:08.093548 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bd3fe-33bc-41dd-bd0f-4cd6caab50cb admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.093901 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bd3fe-33bc-41dd-bd0f-4cd6caab50cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.094600 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bd3fe-33bc-41dd-bd0f-4cd6caab50cb admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.095104 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bd3fe-33bc-41dd-bd0f-4cd6caab50cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:26:08.095561 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bd3fe-33bc-41dd-bd0f-4cd6caab50cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:08.097236 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bd3fe-33bc-41dd-bd0f-4cd6caab50cb admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:08.133460 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1075/2197] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:26:08.138729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0da5de-c779-44ff-b18f-1258431aa570 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:08.155999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0da5de-c779-44ff-b18f-1258431aa570 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:08.178612 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86cce4-2dc2-4d56-9520-d919186c77c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:08.179258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86cce4-2dc2-4d56-9520-d919186c77c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.179540 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86cce4-2dc2-4d56-9520-d919186c77c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.179813 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86cce4-2dc2-4d56-9520-d919186c77c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.180467 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86cce4-2dc2-4d56-9520-d919186c77c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:08.182690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86cce4-2dc2-4d56-9520-d919186c77c2 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:08.411225 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1123/2198] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:08 2022] POST /identity/v3/projects => generated 385 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:08.415880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bd3fe-33bc-41dd-bd0f-4cd6caab50cb admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:08.436322 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bd3fe-33bc-41dd-bd0f-4cd6caab50cb admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:08.594861 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b95da2-3676-4e7b-81a4-42e6651459a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:08.595657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b95da2-3676-4e7b-81a4-42e6651459a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.595946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b95da2-3676-4e7b-81a4-42e6651459a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.596225 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b95da2-3676-4e7b-81a4-42e6651459a8 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.598913 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b95da2-3676-4e7b-81a4-42e6651459a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:08.601678 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b95da2-3676-4e7b-81a4-42e6651459a8 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:08.753111 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1076/2199] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:08 2022] POST /identity/v3/users => generated 293 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:08.758401 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86cce4-2dc2-4d56-9520-d919186c77c2 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:08.774063 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86cce4-2dc2-4d56-9520-d919186c77c2 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:08.779923 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ec349-4727-4a0a-9d13-2a4465cc31ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:08.780611 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ec349-4727-4a0a-9d13-2a4465cc31ea admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.781098 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ec349-4727-4a0a-9d13-2a4465cc31ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.781236 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ec349-4727-4a0a-9d13-2a4465cc31ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.782288 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ec349-4727-4a0a-9d13-2a4465cc31ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:08.784350 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ec349-4727-4a0a-9d13-2a4465cc31ea admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:08.808400 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1124/2200] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:08.808995 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b95da2-3676-4e7b-81a4-42e6651459a8 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:08.823877 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b95da2-3676-4e7b-81a4-42e6651459a8 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:08.842275 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3f390-af0f-4a63-a0ea-4ee42741ee68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:08.843186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3f390-af0f-4a63-a0ea-4ee42741ee68 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.843636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3f390-af0f-4a63-a0ea-4ee42741ee68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.844098 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3f390-af0f-4a63-a0ea-4ee42741ee68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.844956 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3f390-af0f-4a63-a0ea-4ee42741ee68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:08.847436 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3f390-af0f-4a63-a0ea-4ee42741ee68 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:08.900370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1077/2201] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:26:08.902628 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ec349-4727-4a0a-9d13-2a4465cc31ea admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:08.953412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ec349-4727-4a0a-9d13-2a4465cc31ea admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:08.968566 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e1cb1-124a-4444-85af-8b127eb5ba41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:08.970056 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e1cb1-124a-4444-85af-8b127eb5ba41 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:08.970652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e1cb1-124a-4444-85af-8b127eb5ba41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:08.971247 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e1cb1-124a-4444-85af-8b127eb5ba41 admin admin] PATH_INFO: `/v3/projects/b4dff9f2f7864ddab299546b5cf1ea82/users/4def9281a5374b1ca86235f6be347c40/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:08.999420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e1cb1-124a-4444-85af-8b127eb5ba41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4dff9f2f7864ddab299546b5cf1ea82, user_id=4def9281a5374b1ca86235f6be347c40, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:09.004481 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e1cb1-124a-4444-85af-8b127eb5ba41 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:09.058708 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59699a96-803e-4688-93f7-854e2d315050 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:09.059435 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59699a96-803e-4688-93f7-854e2d315050 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:09.059960 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59699a96-803e-4688-93f7-854e2d315050 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:09.063649 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1078/2202] 10.222.0.79 () {54 vars in 921 bytes} [Fri Sep 2 21:26:09 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:26:09.071545 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11335379-cc4e-44cd-963d-1405086b4927 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:09.073138 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11335379-cc4e-44cd-963d-1405086b4927 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:09.073703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11335379-cc4e-44cd-963d-1405086b4927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:09.115185 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-11335379-cc4e-44cd-963d-1405086b4927 None None] MFA Rules not processed for user `632071470f7d409ab7b0129d120320c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:09.116779 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-11335379-cc4e-44cd-963d-1405086b4927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:09.150259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1125/2203] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:08 2022] PUT /identity/v3/projects/b4dff9f2f7864ddab299546b5cf1ea82/users/4def9281a5374b1ca86235f6be347c40/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:09.162234 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc9775-137f-402a-b1e1-ccb9335117fe None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:09.162535 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc9775-137f-402a-b1e1-ccb9335117fe None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:09.162839 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc9775-137f-402a-b1e1-ccb9335117fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:09.196635 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:09.226499 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-dddc9775-137f-402a-b1e1-ccb9335117fe None None] MFA Rules not processed for user `4def9281a5374b1ca86235f6be347c40`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:09.230047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-dddc9775-137f-402a-b1e1-ccb9335117fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:09.259039 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1079/2204] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Sep 2 21:26:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:09.272706 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11335379-cc4e-44cd-963d-1405086b4927 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:09.275271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-11335379-cc4e-44cd-963d-1405086b4927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:09.431295 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1126/2205] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:09.438315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11335379-cc4e-44cd-963d-1405086b4927 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:09.439102 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc9775-137f-402a-b1e1-ccb9335117fe None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:09.441721 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-dddc9775-137f-402a-b1e1-ccb9335117fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:09.562300 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5adc4-8ffd-45ab-9286-32d0eaa27f99 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72840602ec264a74855b601c8d1ddf89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:09.562875 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5adc4-8ffd-45ab-9286-32d0eaa27f99 service glance] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:09.563204 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5adc4-8ffd-45ab-9286-32d0eaa27f99 service glance] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:09.563454 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5adc4-8ffd-45ab-9286-32d0eaa27f99 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:09.614113 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc9775-137f-402a-b1e1-ccb9335117fe None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:09.633490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d4819-2bd9-4549-a933-4170995d3a40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:09.634721 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d4819-2bd9-4549-a933-4170995d3a40 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:09.635369 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d4819-2bd9-4549-a933-4170995d3a40 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:09.636503 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d4819-2bd9-4549-a933-4170995d3a40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:09.667181 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d4819-2bd9-4549-a933-4170995d3a40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:09.679291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d4819-2bd9-4549-a933-4170995d3a40 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:09.724732 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1127/2206] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:26:09.763143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d4819-2bd9-4549-a933-4170995d3a40 service cinder] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:09.806389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5adc4-8ffd-45ab-9286-32d0eaa27f99 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:09.808154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5adc4-8ffd-45ab-9286-32d0eaa27f99 service glance] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:09.860161 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1080/2207] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:10.001109 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d4819-2bd9-4549-a933-4170995d3a40 service cinder] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:10.011022 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78b209-0af5-40ea-a5ca-30ce70f042b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:10.011928 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78b209-0af5-40ea-a5ca-30ce70f042b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.012267 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78b209-0af5-40ea-a5ca-30ce70f042b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.012555 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78b209-0af5-40ea-a5ca-30ce70f042b5 admin admin] PATH_INFO: `/v3/users/4def9281a5374b1ca86235f6be347c40` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:10.014421 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78b209-0af5-40ea-a5ca-30ce70f042b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4def9281a5374b1ca86235f6be347c40)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:10.017604 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78b209-0af5-40ea-a5ca-30ce70f042b5 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:10.489350 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c7f57-cfb4-4ca1-9051-919e2c83c5b4 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.489772 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c7f57-cfb4-4ca1-9051-919e2c83c5b4 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.490178 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c7f57-cfb4-4ca1-9051-919e2c83c5b4 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:10.492061 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1081/2208] 10.222.0.79 () {54 vars in 921 bytes} [Fri Sep 2 21:26:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:26:10.498048 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa459a2-0e4a-4ffe-abcc-776cf69d73e6 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.498582 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa459a2-0e4a-4ffe-abcc-776cf69d73e6 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.503267 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa459a2-0e4a-4ffe-abcc-776cf69d73e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:10.523556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-afa459a2-0e4a-4ffe-abcc-776cf69d73e6 None None] MFA Rules not processed for user `aefaf6998acc4434aab62b9625bd25fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:10.524844 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-afa459a2-0e4a-4ffe-abcc-776cf69d73e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:10.562099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7b78b209-0af5-40ea-a5ca-30ce70f042b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4def9281a5374b1ca86235f6be347c40'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:10.563199 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7b78b209-0af5-40ea-a5ca-30ce70f042b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4def9281a5374b1ca86235f6be347c40'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:10.577323 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7b78b209-0af5-40ea-a5ca-30ce70f042b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4def9281a5374b1ca86235f6be347c40'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:10.585702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7b78b209-0af5-40ea-a5ca-30ce70f042b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4def9281a5374b1ca86235f6be347c40'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:10.586621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1082/2209] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Sep 2 21:26:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:26:10.586742 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7b78b209-0af5-40ea-a5ca-30ce70f042b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4def9281a5374b1ca86235f6be347c40'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:10.600809 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa459a2-0e4a-4ffe-abcc-776cf69d73e6 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:10.602928 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-afa459a2-0e4a-4ffe-abcc-776cf69d73e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:10.614089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa459a2-0e4a-4ffe-abcc-776cf69d73e6 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:10.624107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3bdc6-61f9-43dc-9f4d-51f12c0a94fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:10.624107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3bdc6-61f9-43dc-9f4d-51f12c0a94fd service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.624107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3bdc6-61f9-43dc-9f4d-51f12c0a94fd service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.624107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3bdc6-61f9-43dc-9f4d-51f12c0a94fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:10.627298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e1d3bdc6-61f9-43dc-9f4d-51f12c0a94fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:10.653124 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3bdc6-61f9-43dc-9f4d-51f12c0a94fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:10.656859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3bdc6-61f9-43dc-9f4d-51f12c0a94fd service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:10.676055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1083/2210] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:26:10.795604 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1128/2211] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:26:09 2022] DELETE /identity/v3/users/4def9281a5374b1ca86235f6be347c40 => generated 0 bytes in 1033 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:10.801492 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ee40-3076-4f5d-b750-215168cb941d None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.801988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ee40-3076-4f5d-b750-215168cb941d None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.802402 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ee40-3076-4f5d-b750-215168cb941d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:10.851342 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-20d8ee40-3076-4f5d-b750-215168cb941d None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:10.855564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-20d8ee40-3076-4f5d-b750-215168cb941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:10.885358 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3519a-27ad-4f9f-9647-40d6152a65e6 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.888979 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3519a-27ad-4f9f-9647-40d6152a65e6 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.888979 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3519a-27ad-4f9f-9647-40d6152a65e6 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:10.889416 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1129/2212] 10.222.0.79 () {54 vars in 921 bytes} [Fri Sep 2 21:26:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:26:10.902222 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4a0cd-9be3-4637-91de-051f63b84565 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:10.902222 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4a0cd-9be3-4637-91de-051f63b84565 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:10.902222 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4a0cd-9be3-4637-91de-051f63b84565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:10.953930 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-32a4a0cd-9be3-4637-91de-051f63b84565 None None] MFA Rules not processed for user `632071470f7d409ab7b0129d120320c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:10.956403 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-32a4a0cd-9be3-4637-91de-051f63b84565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:11.059475 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1084/2213] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:11.077031 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8ee40-3076-4f5d-b750-215168cb941d None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:11.078958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-20d8ee40-3076-4f5d-b750-215168cb941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:11.188647 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1130/2214] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Sep 2 21:26:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:11.195543 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4a0cd-9be3-4637-91de-051f63b84565 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:11.203803 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8ee40-3076-4f5d-b750-215168cb941d None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:11.211440 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4a0cd-9be3-4637-91de-051f63b84565 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:11.217661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46025c-5616-4298-9dba-b8aec321ecb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:11.218848 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46025c-5616-4298-9dba-b8aec321ecb2 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:11.219253 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb53f3-7d78-49ff-b204-5a08270560df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:11.219640 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46025c-5616-4298-9dba-b8aec321ecb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:11.220133 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46025c-5616-4298-9dba-b8aec321ecb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:11.223129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb53f3-7d78-49ff-b204-5a08270560df service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:11.223705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb53f3-7d78-49ff-b204-5a08270560df service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:11.224418 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb53f3-7d78-49ff-b204-5a08270560df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:11.237538 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46025c-5616-4298-9dba-b8aec321ecb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:11.239962 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46025c-5616-4298-9dba-b8aec321ecb2 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:11.249648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb53f3-7d78-49ff-b204-5a08270560df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:11.255677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb53f3-7d78-49ff-b204-5a08270560df service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:11.258207 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1131/2215] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:11.319066 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1085/2216] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:11.599037 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:12.569260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46025c-5616-4298-9dba-b8aec321ecb2 service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:12.576823 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-eb46025c-5616-4298-9dba-b8aec321ecb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:12.648818 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46025c-5616-4298-9dba-b8aec321ecb2 service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:12.660589 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d19ad9-d1c9-4936-bc9c-0466af8b709f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:12.661705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d19ad9-d1c9-4936-bc9c-0466af8b709f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:12.664007 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d19ad9-d1c9-4936-bc9c-0466af8b709f admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:12.664681 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d19ad9-d1c9-4936-bc9c-0466af8b709f admin admin] PATH_INFO: `/v3/projects/b4dff9f2f7864ddab299546b5cf1ea82` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:12.669036 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d19ad9-d1c9-4936-bc9c-0466af8b709f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4dff9f2f7864ddab299546b5cf1ea82)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:12.671118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d19ad9-d1c9-4936-bc9c-0466af8b709f admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:13.059698 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c8d19ad9-d1c9-4936-bc9c-0466af8b709f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4dff9f2f7864ddab299546b5cf1ea82', 'request_id': 'req-c8d19ad9-d1c9-4936-bc9c-0466af8b709f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:13.079048 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c8d19ad9-d1c9-4936-bc9c-0466af8b709f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4dff9f2f7864ddab299546b5cf1ea82', 'request_id': 'req-c8d19ad9-d1c9-4936-bc9c-0466af8b709f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:13.108493 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c8d19ad9-d1c9-4936-bc9c-0466af8b709f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4dff9f2f7864ddab299546b5cf1ea82', 'request_id': 'req-c8d19ad9-d1c9-4936-bc9c-0466af8b709f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:13.391479 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c8d19ad9-d1c9-4936-bc9c-0466af8b709f admin admin] The token cache is being invalidate because project b4dff9f2f7864ddab299546b5cf1ea82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:26:13.392384 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c8d19ad9-d1c9-4936-bc9c-0466af8b709f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:13.393728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c8d19ad9-d1c9-4936-bc9c-0466af8b709f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:13.401535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0af66-0055-4749-902f-4fdddca6ca1b None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:13.403118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0af66-0055-4749-902f-4fdddca6ca1b None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:13.403961 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0af66-0055-4749-902f-4fdddca6ca1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:13.409484 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1132/2217] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:26:12 2022] DELETE /identity/v3/projects/b4dff9f2f7864ddab299546b5cf1ea82 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:13.444778 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-a0c0af66-0055-4749-902f-4fdddca6ca1b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:13.446773 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-a0c0af66-0055-4749-902f-4fdddca6ca1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:13.692373 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1086/2218] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:13.700322 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dee9d-721b-4640-a50a-edc717ba4df2 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:13.701238 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dee9d-721b-4640-a50a-edc717ba4df2 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:13.701238 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dee9d-721b-4640-a50a-edc717ba4df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:13.756655 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-5f3dee9d-721b-4640-a50a-edc717ba4df2 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:13.757952 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-5f3dee9d-721b-4640-a50a-edc717ba4df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:13.792340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1133/2219] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:13.797335 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0af66-0055-4749-902f-4fdddca6ca1b None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:13.829578 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0af66-0055-4749-902f-4fdddca6ca1b None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:13.849968 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42592de7-a305-4209-9a7c-cce8e9a276a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:13.852784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42592de7-a305-4209-9a7c-cce8e9a276a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:13.854061 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42592de7-a305-4209-9a7c-cce8e9a276a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:13.855433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42592de7-a305-4209-9a7c-cce8e9a276a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:13.861496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42592de7-a305-4209-9a7c-cce8e9a276a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:26:13.863368 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42592de7-a305-4209-9a7c-cce8e9a276a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:13.872621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42592de7-a305-4209-9a7c-cce8e9a276a1 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:13.920190 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1087/2220] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:26:13.921284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dee9d-721b-4640-a50a-edc717ba4df2 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:13.936043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dee9d-721b-4640-a50a-edc717ba4df2 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:13.952465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c3de6-2af4-4d83-82ec-686ace7cea21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:13.953197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c3de6-2af4-4d83-82ec-686ace7cea21 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:13.953493 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c3de6-2af4-4d83-82ec-686ace7cea21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:13.953776 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c3de6-2af4-4d83-82ec-686ace7cea21 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:13.954466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c3de6-2af4-4d83-82ec-686ace7cea21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:13.958246 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c3de6-2af4-4d83-82ec-686ace7cea21 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:14.465956 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1134/2221] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:13 2022] POST /identity/v3/projects => generated 373 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:14.470543 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42592de7-a305-4209-9a7c-cce8e9a276a1 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:14.495983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42592de7-a305-4209-9a7c-cce8e9a276a1 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:14.638315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d00da-578f-4483-bfe9-daf554c7ab7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:14.639501 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d00da-578f-4483-bfe9-daf554c7ab7b admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:14.639881 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d00da-578f-4483-bfe9-daf554c7ab7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:14.640604 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d00da-578f-4483-bfe9-daf554c7ab7b admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:14.642903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d00da-578f-4483-bfe9-daf554c7ab7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:14.645712 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d00da-578f-4483-bfe9-daf554c7ab7b admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:14.869006 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1088/2222] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:14 2022] POST /identity/v3/users => generated 287 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:14.870154 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c3de6-2af4-4d83-82ec-686ace7cea21 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:14.882190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c3de6-2af4-4d83-82ec-686ace7cea21 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:14.894083 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f082a1b-d04d-4292-abbe-eaf15c8791b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:14.896615 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f082a1b-d04d-4292-abbe-eaf15c8791b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:14.896615 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f082a1b-d04d-4292-abbe-eaf15c8791b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:14.896615 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f082a1b-d04d-4292-abbe-eaf15c8791b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:14.897238 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f082a1b-d04d-4292-abbe-eaf15c8791b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:14.899027 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f082a1b-d04d-4292-abbe-eaf15c8791b6 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:14.912505 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1135/2223] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:14.916654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d00da-578f-4483-bfe9-daf554c7ab7b admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:14.931136 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d00da-578f-4483-bfe9-daf554c7ab7b admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:14.937869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6798ac-aa7f-428f-8ba0-67e3ccd220d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:14.938921 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6798ac-aa7f-428f-8ba0-67e3ccd220d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:14.939204 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6798ac-aa7f-428f-8ba0-67e3ccd220d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:14.939550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6798ac-aa7f-428f-8ba0-67e3ccd220d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:14.942664 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6798ac-aa7f-428f-8ba0-67e3ccd220d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:14.945098 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6798ac-aa7f-428f-8ba0-67e3ccd220d3 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:14.964042 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1089/2224] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:14.969928 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f082a1b-d04d-4292-abbe-eaf15c8791b6 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:14.983107 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f082a1b-d04d-4292-abbe-eaf15c8791b6 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:14.990054 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda5c57-34ad-4d57-8aff-c20fb7f9e5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:14.996189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda5c57-34ad-4d57-8aff-c20fb7f9e5a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:14.996189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda5c57-34ad-4d57-8aff-c20fb7f9e5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:14.996189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda5c57-34ad-4d57-8aff-c20fb7f9e5a1 admin admin] PATH_INFO: `/v3/projects/00fbc2e7b83e496c9db6e8b0601ec81d/users/f99376abecf24499b39dacbc7926e8c0/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:15.014044 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda5c57-34ad-4d57-8aff-c20fb7f9e5a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00fbc2e7b83e496c9db6e8b0601ec81d, user_id=f99376abecf24499b39dacbc7926e8c0, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:15.017083 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda5c57-34ad-4d57-8aff-c20fb7f9e5a1 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:15.134570 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1136/2225] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:14 2022] PUT /identity/v3/projects/00fbc2e7b83e496c9db6e8b0601ec81d/users/f99376abecf24499b39dacbc7926e8c0/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:26:15.141849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c4970-f961-430c-8e64-814cad6bd845 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:15.142236 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c4970-f961-430c-8e64-814cad6bd845 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:15.142745 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c4970-f961-430c-8e64-814cad6bd845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:15.185939 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-6e9c4970-f961-430c-8e64-814cad6bd845 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:15.192394 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-6e9c4970-f961-430c-8e64-814cad6bd845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:15.269864 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1090/2226] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:15.277316 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda5c57-34ad-4d57-8aff-c20fb7f9e5a1 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:15.279662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-0cda5c57-34ad-4d57-8aff-c20fb7f9e5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:15.403519 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda5c57-34ad-4d57-8aff-c20fb7f9e5a1 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:15.407299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc4477-c27a-4ba4-9c5c-01daa6782dd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:15.408332 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc4477-c27a-4ba4-9c5c-01daa6782dd1 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:15.409569 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc4477-c27a-4ba4-9c5c-01daa6782dd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:15.410149 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc4477-c27a-4ba4-9c5c-01daa6782dd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:15.423401 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc4477-c27a-4ba4-9c5c-01daa6782dd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:15.427684 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc4477-c27a-4ba4-9c5c-01daa6782dd1 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:15.437533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1137/2227] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:15.843971 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:16.169177 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:18.367185 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546ef97-7107-4ac5-b9da-352509f6cc6d None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:18.367819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546ef97-7107-4ac5-b9da-352509f6cc6d None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:18.367819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546ef97-7107-4ac5-b9da-352509f6cc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:18.401946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-d546ef97-7107-4ac5-b9da-352509f6cc6d None None] MFA Rules not processed for user `f99376abecf24499b39dacbc7926e8c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:18.403225 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d546ef97-7107-4ac5-b9da-352509f6cc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:18.474553 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1091/2228] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:18.487753 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc4477-c27a-4ba4-9c5c-01daa6782dd1 service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:18.489288 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-90cc4477-c27a-4ba4-9c5c-01daa6782dd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:18.549476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc4477-c27a-4ba4-9c5c-01daa6782dd1 service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:18.553415 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba971b-893c-41a4-8740-9f0b86180142 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:18.554071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba971b-893c-41a4-8740-9f0b86180142 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:18.554361 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba971b-893c-41a4-8740-9f0b86180142 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:18.554640 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba971b-893c-41a4-8740-9f0b86180142 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:18.563779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba971b-893c-41a4-8740-9f0b86180142 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:18.565267 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba971b-893c-41a4-8740-9f0b86180142 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:18.574590 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1138/2229] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:18.885842 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:20.192295 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:20.402856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:20.698205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11feeb4-6d46-4662-aae0-6ace0025c8e6 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:20.698555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11feeb4-6d46-4662-aae0-6ace0025c8e6 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:20.698836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11feeb4-6d46-4662-aae0-6ace0025c8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:20.723085 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-e11feeb4-6d46-4662-aae0-6ace0025c8e6 None None] MFA Rules not processed for user `f99376abecf24499b39dacbc7926e8c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:20.724330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e11feeb4-6d46-4662-aae0-6ace0025c8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:20.731823 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1092/2230] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:26:21.375807 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:24.474259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:27.300368 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba971b-893c-41a4-8740-9f0b86180142 service cinder] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:27.302505 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-deba971b-893c-41a4-8740-9f0b86180142 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:27.330988 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba971b-893c-41a4-8740-9f0b86180142 service cinder] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:27.337325 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafb978-ef50-4c4f-b5c7-9340ed3c350d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:27.338173 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafb978-ef50-4c4f-b5c7-9340ed3c350d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:27.338469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafb978-ef50-4c4f-b5c7-9340ed3c350d admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:27.338752 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafb978-ef50-4c4f-b5c7-9340ed3c350d admin admin] PATH_INFO: `/v3/users/9d87c3c836d049dbbb4104b9f5483f22` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:27.340261 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aafb978-ef50-4c4f-b5c7-9340ed3c350d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d87c3c836d049dbbb4104b9f5483f22)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:27.342378 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aafb978-ef50-4c4f-b5c7-9340ed3c350d admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:27.793365 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2aafb978-ef50-4c4f-b5c7-9340ed3c350d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d87c3c836d049dbbb4104b9f5483f22'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:27.794877 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2aafb978-ef50-4c4f-b5c7-9340ed3c350d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d87c3c836d049dbbb4104b9f5483f22'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:27.816686 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2aafb978-ef50-4c4f-b5c7-9340ed3c350d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d87c3c836d049dbbb4104b9f5483f22'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:27.826381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2aafb978-ef50-4c4f-b5c7-9340ed3c350d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d87c3c836d049dbbb4104b9f5483f22'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:27.828423 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2aafb978-ef50-4c4f-b5c7-9340ed3c350d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d87c3c836d049dbbb4104b9f5483f22'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:27.980628 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1139/2231] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:26:27 2022] DELETE /identity/v3/users/9d87c3c836d049dbbb4104b9f5483f22 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:27.986508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c6b1b-18bb-4103-84ac-88a10c7e2941 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:27.987270 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c6b1b-18bb-4103-84ac-88a10c7e2941 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:27.987270 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c6b1b-18bb-4103-84ac-88a10c7e2941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:28.008843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-4d0c6b1b-18bb-4103-84ac-88a10c7e2941 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:28.010424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-4d0c6b1b-18bb-4103-84ac-88a10c7e2941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:28.094640 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1093/2232] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:28.105748 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafb978-ef50-4c4f-b5c7-9340ed3c350d admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:28.107482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-2aafb978-ef50-4c4f-b5c7-9340ed3c350d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:28.178062 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafb978-ef50-4c4f-b5c7-9340ed3c350d admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:28.182128 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109ac61-ee80-4800-a614-01c1706bffd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:28.183032 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109ac61-ee80-4800-a614-01c1706bffd0 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:28.183386 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109ac61-ee80-4800-a614-01c1706bffd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:28.183747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109ac61-ee80-4800-a614-01c1706bffd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:28.194635 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109ac61-ee80-4800-a614-01c1706bffd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:28.196176 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109ac61-ee80-4800-a614-01c1706bffd0 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:28.207161 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1140/2233] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:29.714201 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c6b1b-18bb-4103-84ac-88a10c7e2941 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:29.716356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-4d0c6b1b-18bb-4103-84ac-88a10c7e2941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:29.731116 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c6b1b-18bb-4103-84ac-88a10c7e2941 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:29.737195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6b12e-79cd-40e7-8237-db6692621561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:29.738214 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6b12e-79cd-40e7-8237-db6692621561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:29.739677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6b12e-79cd-40e7-8237-db6692621561 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:29.740181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6b12e-79cd-40e7-8237-db6692621561 admin admin] PATH_INFO: `/v3/projects/9cc3ef80fd3a4b02882019fb44633135` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:29.741706 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6b12e-79cd-40e7-8237-db6692621561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc3ef80fd3a4b02882019fb44633135)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:29.743838 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6b12e-79cd-40e7-8237-db6692621561 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:29.959377 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-eab6b12e-79cd-40e7-8237-db6692621561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc3ef80fd3a4b02882019fb44633135', 'request_id': 'req-eab6b12e-79cd-40e7-8237-db6692621561'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:29.966900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-eab6b12e-79cd-40e7-8237-db6692621561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc3ef80fd3a4b02882019fb44633135', 'request_id': 'req-eab6b12e-79cd-40e7-8237-db6692621561'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:29.973251 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-eab6b12e-79cd-40e7-8237-db6692621561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc3ef80fd3a4b02882019fb44633135', 'request_id': 'req-eab6b12e-79cd-40e7-8237-db6692621561'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:30.095046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-eab6b12e-79cd-40e7-8237-db6692621561 admin admin] The token cache is being invalidate because project 9cc3ef80fd3a4b02882019fb44633135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:26:30.095522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-eab6b12e-79cd-40e7-8237-db6692621561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:30.096534 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-eab6b12e-79cd-40e7-8237-db6692621561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:30.098335 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1094/2234] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:26:29 2022] DELETE /identity/v3/projects/9cc3ef80fd3a4b02882019fb44633135 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:30.102748 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109ac61-ee80-4800-a614-01c1706bffd0 service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:30.114143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109ac61-ee80-4800-a614-01c1706bffd0 service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:30.198771 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09aa18-fe4b-4714-936b-fb53b400c72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:30.198771 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09aa18-fe4b-4714-936b-fb53b400c72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:30.198771 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09aa18-fe4b-4714-936b-fb53b400c72e admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:30.198771 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09aa18-fe4b-4714-936b-fb53b400c72e admin admin] PATH_INFO: `/v3/users/8b6406ffc41c431c83d843f7e9aef257` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:30.199068 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09aa18-fe4b-4714-936b-fb53b400c72e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b6406ffc41c431c83d843f7e9aef257)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:30.199068 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09aa18-fe4b-4714-936b-fb53b400c72e admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:30.563335 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-5b09aa18-fe4b-4714-936b-fb53b400c72e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b6406ffc41c431c83d843f7e9aef257'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:30.564915 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-5b09aa18-fe4b-4714-936b-fb53b400c72e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b6406ffc41c431c83d843f7e9aef257'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:30.578454 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-5b09aa18-fe4b-4714-936b-fb53b400c72e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b6406ffc41c431c83d843f7e9aef257'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:30.585494 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-5b09aa18-fe4b-4714-936b-fb53b400c72e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b6406ffc41c431c83d843f7e9aef257'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:30.586274 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-5b09aa18-fe4b-4714-936b-fb53b400c72e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b6406ffc41c431c83d843f7e9aef257'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:30.819910 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1141/2235] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:26:30 2022] DELETE /identity/v3/users/8b6406ffc41c431c83d843f7e9aef257 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:31.151066 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:31.748604 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6b12e-79cd-40e7-8237-db6692621561 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:31.752363 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-eab6b12e-79cd-40e7-8237-db6692621561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:31.768053 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6b12e-79cd-40e7-8237-db6692621561 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:31.837201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:31.868353 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101442b-fc6c-4596-b8b1-92260d7d6d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:31.869353 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101442b-fc6c-4596-b8b1-92260d7d6d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:31.871005 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101442b-fc6c-4596-b8b1-92260d7d6d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:31.872191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101442b-fc6c-4596-b8b1-92260d7d6d49 admin admin] PATH_INFO: `/v3/projects/238b42b61bf045ccad17fa0fbf488b4f` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:31.873879 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101442b-fc6c-4596-b8b1-92260d7d6d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=238b42b61bf045ccad17fa0fbf488b4f)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:31.877691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101442b-fc6c-4596-b8b1-92260d7d6d49 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:32.140899 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-5101442b-fc6c-4596-b8b1-92260d7d6d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '238b42b61bf045ccad17fa0fbf488b4f', 'request_id': 'req-5101442b-fc6c-4596-b8b1-92260d7d6d49'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:32.150501 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-5101442b-fc6c-4596-b8b1-92260d7d6d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '238b42b61bf045ccad17fa0fbf488b4f', 'request_id': 'req-5101442b-fc6c-4596-b8b1-92260d7d6d49'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:32.160511 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-5101442b-fc6c-4596-b8b1-92260d7d6d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '238b42b61bf045ccad17fa0fbf488b4f', 'request_id': 'req-5101442b-fc6c-4596-b8b1-92260d7d6d49'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:32.465779 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-5101442b-fc6c-4596-b8b1-92260d7d6d49 admin admin] The token cache is being invalidate because project 238b42b61bf045ccad17fa0fbf488b4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:26:32.466121 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-5101442b-fc6c-4596-b8b1-92260d7d6d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:32.466805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-5101442b-fc6c-4596-b8b1-92260d7d6d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:32.475762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1095/2236] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:26:31 2022] DELETE /identity/v3/projects/238b42b61bf045ccad17fa0fbf488b4f => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:32.475903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8668cb-56a6-492d-8ea6-6b9cccffcf7a None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:32.475903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8668cb-56a6-492d-8ea6-6b9cccffcf7a None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:32.475903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8668cb-56a6-492d-8ea6-6b9cccffcf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:32.497853 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-8b8668cb-56a6-492d-8ea6-6b9cccffcf7a None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:32.499199 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-8b8668cb-56a6-492d-8ea6-6b9cccffcf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:32.565408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1142/2237] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:32.573862 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb3b83-a8a7-4d55-b1ca-1517de44a7d6 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:32.574152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb3b83-a8a7-4d55-b1ca-1517de44a7d6 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:32.574445 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb3b83-a8a7-4d55-b1ca-1517de44a7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:32.597746 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-76cb3b83-a8a7-4d55-b1ca-1517de44a7d6 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:32.598983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-76cb3b83-a8a7-4d55-b1ca-1517de44a7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:32.611803 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1096/2238] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:32.614327 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8668cb-56a6-492d-8ea6-6b9cccffcf7a None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:32.624878 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8668cb-56a6-492d-8ea6-6b9cccffcf7a None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:32.632849 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6d3ba-09f5-42f6-97be-383931ef8a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:32.633472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6d3ba-09f5-42f6-97be-383931ef8a50 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:32.633964 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6d3ba-09f5-42f6-97be-383931ef8a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:32.634392 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6d3ba-09f5-42f6-97be-383931ef8a50 admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:32.635195 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6d3ba-09f5-42f6-97be-383931ef8a50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:26:32.635674 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6d3ba-09f5-42f6-97be-383931ef8a50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:32.637627 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6d3ba-09f5-42f6-97be-383931ef8a50 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:32.651937 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1143/2239] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:26:32.656611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb3b83-a8a7-4d55-b1ca-1517de44a7d6 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:32.668697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb3b83-a8a7-4d55-b1ca-1517de44a7d6 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:32.674253 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a9658-b2fc-4df9-afec-b17a6a065ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:32.674977 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a9658-b2fc-4df9-afec-b17a6a065ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:32.675259 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a9658-b2fc-4df9-afec-b17a6a065ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:32.675535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a9658-b2fc-4df9-afec-b17a6a065ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:32.676267 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a9658-b2fc-4df9-afec-b17a6a065ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:32.678302 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a9658-b2fc-4df9-afec-b17a6a065ec0 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:32.888393 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1097/2240] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:32 2022] POST /identity/v3/projects => generated 363 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:32.889848 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6d3ba-09f5-42f6-97be-383931ef8a50 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:32.907606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6d3ba-09f5-42f6-97be-383931ef8a50 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:32.971721 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c8aaa-1029-4704-9107-39f73f1902fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:32.972482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c8aaa-1029-4704-9107-39f73f1902fe admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:32.972964 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c8aaa-1029-4704-9107-39f73f1902fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:32.973428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c8aaa-1029-4704-9107-39f73f1902fe admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:32.974120 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c8aaa-1029-4704-9107-39f73f1902fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:32.976536 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c8aaa-1029-4704-9107-39f73f1902fe admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:33.191951 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1144/2241] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:32 2022] POST /identity/v3/users => generated 282 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:33.192849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a9658-b2fc-4df9-afec-b17a6a065ec0 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:33.205050 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a9658-b2fc-4df9-afec-b17a6a065ec0 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:33.210739 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd846bb-6004-4c9c-8aa9-7b8fa66340c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:33.211370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd846bb-6004-4c9c-8aa9-7b8fa66340c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:33.211651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd846bb-6004-4c9c-8aa9-7b8fa66340c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:33.211930 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd846bb-6004-4c9c-8aa9-7b8fa66340c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:33.212621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd846bb-6004-4c9c-8aa9-7b8fa66340c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:33.214280 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd846bb-6004-4c9c-8aa9-7b8fa66340c2 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:33.225498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1098/2242] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:33.230081 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c8aaa-1029-4704-9107-39f73f1902fe admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:33.242357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c8aaa-1029-4704-9107-39f73f1902fe admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:33.247135 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad4874-9805-4ef9-b0c1-5a29008fcf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:33.249576 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad4874-9805-4ef9-b0c1-5a29008fcf60 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:33.249576 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad4874-9805-4ef9-b0c1-5a29008fcf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:33.249576 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad4874-9805-4ef9-b0c1-5a29008fcf60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:33.249576 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad4874-9805-4ef9-b0c1-5a29008fcf60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:33.250626 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad4874-9805-4ef9-b0c1-5a29008fcf60 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:33.263035 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1145/2243] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:33.267842 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd846bb-6004-4c9c-8aa9-7b8fa66340c2 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:33.281316 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd846bb-6004-4c9c-8aa9-7b8fa66340c2 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:33.287809 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d3230-b96c-4984-8c58-1552bb49efbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:33.288516 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d3230-b96c-4984-8c58-1552bb49efbd admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:33.288847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d3230-b96c-4984-8c58-1552bb49efbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:33.289132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d3230-b96c-4984-8c58-1552bb49efbd admin admin] PATH_INFO: `/v3/projects/d1568aa233614e51a3851a83502b7e4b/users/a611dcfedc804df28457b548ce1abfb8/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:33.311471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d3230-b96c-4984-8c58-1552bb49efbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1568aa233614e51a3851a83502b7e4b, user_id=a611dcfedc804df28457b548ce1abfb8, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:33.315381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d3230-b96c-4984-8c58-1552bb49efbd admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:33.469975 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448d90f-7036-4362-a1d1-27ee95578146 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:33.470365 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448d90f-7036-4362-a1d1-27ee95578146 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:33.470452 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448d90f-7036-4362-a1d1-27ee95578146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:33.490738 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-b448d90f-7036-4362-a1d1-27ee95578146 None None] MFA Rules not processed for user `f45f65dd3a844cb583e42d837d2a58d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:33.492648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b448d90f-7036-4362-a1d1-27ee95578146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:33.524396 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1099/2244] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:33 2022] PUT /identity/v3/projects/d1568aa233614e51a3851a83502b7e4b/users/a611dcfedc804df28457b548ce1abfb8/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:33.525916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052d2fe-a013-44ed-b1f9-1ce92ee7b341 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:33.526219 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052d2fe-a013-44ed-b1f9-1ce92ee7b341 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:33.526503 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052d2fe-a013-44ed-b1f9-1ce92ee7b341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:33.561883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-d052d2fe-a013-44ed-b1f9-1ce92ee7b341 None None] MFA Rules not processed for user `a611dcfedc804df28457b548ce1abfb8`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:33.564054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d052d2fe-a013-44ed-b1f9-1ce92ee7b341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:33.576117 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1146/2245] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Sep 2 21:26:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:33.603484 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448d90f-7036-4362-a1d1-27ee95578146 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:33.605308 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b448d90f-7036-4362-a1d1-27ee95578146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:33.667840 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1100/2246] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:33.672136 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052d2fe-a013-44ed-b1f9-1ce92ee7b341 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:33.717488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448d90f-7036-4362-a1d1-27ee95578146 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:33.758676 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052d2fe-a013-44ed-b1f9-1ce92ee7b341 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:33.770041 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ea963-99cd-4bb7-abd4-0b0cf373097c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:33.770759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ea963-99cd-4bb7-abd4-0b0cf373097c admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:33.771118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ea963-99cd-4bb7-abd4-0b0cf373097c admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:33.772131 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ea963-99cd-4bb7-abd4-0b0cf373097c admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:33.773344 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ea963-99cd-4bb7-abd4-0b0cf373097c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:33.776392 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ea963-99cd-4bb7-abd4-0b0cf373097c admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:33.797823 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f8041-9f2a-4cf4-9306-a25a16e3d1e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da2b1dc9dae413a8ee63ad67e840f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:33.799006 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f8041-9f2a-4cf4-9306-a25a16e3d1e9 service swift] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:33.799358 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f8041-9f2a-4cf4-9306-a25a16e3d1e9 service swift] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:33.799701 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f8041-9f2a-4cf4-9306-a25a16e3d1e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:33.877181 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f8041-9f2a-4cf4-9306-a25a16e3d1e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:33.878771 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f8041-9f2a-4cf4-9306-a25a16e3d1e9 service swift] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:33.887493 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1147/2247] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Sep 2 21:26:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:26:33.975333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1101/2248] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:33 2022] POST /identity/v3/projects => generated 361 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:26:33.980642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f8041-9f2a-4cf4-9306-a25a16e3d1e9 service swift] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:33.994435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f8041-9f2a-4cf4-9306-a25a16e3d1e9 service swift] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:34.079021 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3c868-a513-47b2-9a27-5ea6a0c90a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:34.080174 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3c868-a513-47b2-9a27-5ea6a0c90a3a admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:34.081125 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3c868-a513-47b2-9a27-5ea6a0c90a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:34.081414 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3c868-a513-47b2-9a27-5ea6a0c90a3a admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:34.082112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3c868-a513-47b2-9a27-5ea6a0c90a3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:34.084302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3c868-a513-47b2-9a27-5ea6a0c90a3a admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:34.250443 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1148/2249] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:33 2022] POST /identity/v3/users => generated 287 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:34.255830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ea963-99cd-4bb7-abd4-0b0cf373097c admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:34.270426 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ea963-99cd-4bb7-abd4-0b0cf373097c admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:34.294101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10101d05-8a00-4f13-974e-f4a08b7fea70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:34.294859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10101d05-8a00-4f13-974e-f4a08b7fea70 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:34.295243 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10101d05-8a00-4f13-974e-f4a08b7fea70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:34.295972 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10101d05-8a00-4f13-974e-f4a08b7fea70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:34.296872 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10101d05-8a00-4f13-974e-f4a08b7fea70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:34.300875 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10101d05-8a00-4f13-974e-f4a08b7fea70 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:34.333873 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1102/2250] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:34.346739 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3c868-a513-47b2-9a27-5ea6a0c90a3a admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:34.366636 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3c868-a513-47b2-9a27-5ea6a0c90a3a admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:34.375267 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e848a9-b5b5-4930-b1f0-f31a2c1555ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:34.377729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e848a9-b5b5-4930-b1f0-f31a2c1555ef admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:34.378234 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e848a9-b5b5-4930-b1f0-f31a2c1555ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:34.378782 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e848a9-b5b5-4930-b1f0-f31a2c1555ef admin admin] PATH_INFO: `/v3/projects/a315e0184571414d8563e7357f41689b/users/08426379d38f4fa786820d90b38e3143/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:34.470953 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e848a9-b5b5-4930-b1f0-f31a2c1555ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a315e0184571414d8563e7357f41689b, user_id=08426379d38f4fa786820d90b38e3143, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:34.479779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e848a9-b5b5-4930-b1f0-f31a2c1555ef admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:35.848837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1149/2251] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:34 2022] PUT /identity/v3/projects/a315e0184571414d8563e7357f41689b/users/08426379d38f4fa786820d90b38e3143/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 1503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:35.853203 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10101d05-8a00-4f13-974e-f4a08b7fea70 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:35.867557 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10101d05-8a00-4f13-974e-f4a08b7fea70 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:35.990792 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d92e5-3a9f-4046-9a05-a0930b3478ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:35.991537 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d92e5-3a9f-4046-9a05-a0930b3478ef admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:35.991824 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d92e5-3a9f-4046-9a05-a0930b3478ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:35.992179 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d92e5-3a9f-4046-9a05-a0930b3478ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:35.992926 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d92e5-3a9f-4046-9a05-a0930b3478ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:35.996923 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d92e5-3a9f-4046-9a05-a0930b3478ef admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:36.014620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1103/2252] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:36.025307 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e848a9-b5b5-4930-b1f0-f31a2c1555ef admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:36.054531 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e848a9-b5b5-4930-b1f0-f31a2c1555ef admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:36.064218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a685170-e46a-45dc-a4fd-c6ce9bf8465d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:36.065207 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a685170-e46a-45dc-a4fd-c6ce9bf8465d admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:36.065657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a685170-e46a-45dc-a4fd-c6ce9bf8465d admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:36.066115 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a685170-e46a-45dc-a4fd-c6ce9bf8465d admin admin] PATH_INFO: `/v3/projects/a315e0184571414d8563e7357f41689b/users/08426379d38f4fa786820d90b38e3143/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:36.073685 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a685170-e46a-45dc-a4fd-c6ce9bf8465d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a315e0184571414d8563e7357f41689b, user_id=08426379d38f4fa786820d90b38e3143, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:36.075646 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a685170-e46a-45dc-a4fd-c6ce9bf8465d admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:36.103076 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1150/2253] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:36 2022] PUT /identity/v3/projects/a315e0184571414d8563e7357f41689b/users/08426379d38f4fa786820d90b38e3143/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:36.117545 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f38c4-ee22-4df2-ae27-04892876add8 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:36.118046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f38c4-ee22-4df2-ae27-04892876add8 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:36.118261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f38c4-ee22-4df2-ae27-04892876add8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:36.170687 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-958f38c4-ee22-4df2-ae27-04892876add8 None None] MFA Rules not processed for user `08426379d38f4fa786820d90b38e3143`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:36.174612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-958f38c4-ee22-4df2-ae27-04892876add8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:36.320029 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1104/2254] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:36 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:36.356692 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a685170-e46a-45dc-a4fd-c6ce9bf8465d admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:36.360680 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-6a685170-e46a-45dc-a4fd-c6ce9bf8465d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:36.436410 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a685170-e46a-45dc-a4fd-c6ce9bf8465d admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:36.445161 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa207c-fc57-47a0-b51d-2b95b6c1e74d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:36.445965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa207c-fc57-47a0-b51d-2b95b6c1e74d service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:36.446168 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa207c-fc57-47a0-b51d-2b95b6c1e74d service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:36.446596 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa207c-fc57-47a0-b51d-2b95b6c1e74d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:36.458377 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa207c-fc57-47a0-b51d-2b95b6c1e74d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:36.458976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa207c-fc57-47a0-b51d-2b95b6c1e74d service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:36.481055 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1151/2255] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:36 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:36.678597 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:38.278791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f38c4-ee22-4df2-ae27-04892876add8 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:38.372014 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f38c4-ee22-4df2-ae27-04892876add8 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:38.391962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504310a-2b83-4494-90ad-fbcf786f7925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:38.391962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504310a-2b83-4494-90ad-fbcf786f7925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:38.391962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504310a-2b83-4494-90ad-fbcf786f7925 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:38.391962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504310a-2b83-4494-90ad-fbcf786f7925 admin admin] PATH_INFO: `/v3/users/a611dcfedc804df28457b548ce1abfb8` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:38.393705 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504310a-2b83-4494-90ad-fbcf786f7925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a611dcfedc804df28457b548ce1abfb8)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:38.395761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504310a-2b83-4494-90ad-fbcf786f7925 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:38.761796 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d504310a-2b83-4494-90ad-fbcf786f7925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a611dcfedc804df28457b548ce1abfb8'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:38.766415 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d504310a-2b83-4494-90ad-fbcf786f7925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a611dcfedc804df28457b548ce1abfb8'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:38.777352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d504310a-2b83-4494-90ad-fbcf786f7925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a611dcfedc804df28457b548ce1abfb8'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:38.819879 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d504310a-2b83-4494-90ad-fbcf786f7925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a611dcfedc804df28457b548ce1abfb8'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:38.821175 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d504310a-2b83-4494-90ad-fbcf786f7925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a611dcfedc804df28457b548ce1abfb8'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:38.994814 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1105/2256] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:26:38 2022] DELETE /identity/v3/users/a611dcfedc804df28457b548ce1abfb8 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:38.999607 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d8d5d-e8c4-47f3-9753-f70a95652928 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:39.000735 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d8d5d-e8c4-47f3-9753-f70a95652928 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:39.000735 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d8d5d-e8c4-47f3-9753-f70a95652928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:39.021035 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-f90d8d5d-e8c4-47f3-9753-f70a95652928 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:39.022306 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f90d8d5d-e8c4-47f3-9753-f70a95652928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:39.088689 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1152/2257] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:26:39.099429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504310a-2b83-4494-90ad-fbcf786f7925 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:39.101230 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d504310a-2b83-4494-90ad-fbcf786f7925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:39.215382 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504310a-2b83-4494-90ad-fbcf786f7925 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:39.219791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558eab4-f98a-4851-8be4-ef517600d048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:39.220551 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558eab4-f98a-4851-8be4-ef517600d048 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:39.220858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558eab4-f98a-4851-8be4-ef517600d048 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:39.221150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558eab4-f98a-4851-8be4-ef517600d048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:39.240541 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558eab4-f98a-4851-8be4-ef517600d048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:39.242166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558eab4-f98a-4851-8be4-ef517600d048 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:39.256363 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1106/2258] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:39.744553 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:39.982317 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d8d5d-e8c4-47f3-9753-f70a95652928 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:39.984390 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f90d8d5d-e8c4-47f3-9753-f70a95652928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:39.999207 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d8d5d-e8c4-47f3-9753-f70a95652928 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:40.008048 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da36958-7b54-45a2-a887-e7db79a5fba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:40.009085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da36958-7b54-45a2-a887-e7db79a5fba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:40.009085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da36958-7b54-45a2-a887-e7db79a5fba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:40.009782 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da36958-7b54-45a2-a887-e7db79a5fba9 admin admin] PATH_INFO: `/v3/projects/d1568aa233614e51a3851a83502b7e4b` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:40.011767 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da36958-7b54-45a2-a887-e7db79a5fba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1568aa233614e51a3851a83502b7e4b)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:40.017617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da36958-7b54-45a2-a887-e7db79a5fba9 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:40.199249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2da36958-7b54-45a2-a887-e7db79a5fba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1568aa233614e51a3851a83502b7e4b', 'request_id': 'req-2da36958-7b54-45a2-a887-e7db79a5fba9'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:40.209521 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2da36958-7b54-45a2-a887-e7db79a5fba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1568aa233614e51a3851a83502b7e4b', 'request_id': 'req-2da36958-7b54-45a2-a887-e7db79a5fba9'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:40.223248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2da36958-7b54-45a2-a887-e7db79a5fba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1568aa233614e51a3851a83502b7e4b', 'request_id': 'req-2da36958-7b54-45a2-a887-e7db79a5fba9'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:40.406370 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2da36958-7b54-45a2-a887-e7db79a5fba9 admin admin] The token cache is being invalidate because project d1568aa233614e51a3851a83502b7e4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:26:40.407074 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2da36958-7b54-45a2-a887-e7db79a5fba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:40.407951 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2da36958-7b54-45a2-a887-e7db79a5fba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:40.409917 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1153/2259] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:26:39 2022] DELETE /identity/v3/projects/d1568aa233614e51a3851a83502b7e4b => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:40.414119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558eab4-f98a-4851-8be4-ef517600d048 service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:40.433160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558eab4-f98a-4851-8be4-ef517600d048 service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:40.553452 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99534c55-0c2f-4e72-b952-641f55ebc6e1 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:40.553990 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99534c55-0c2f-4e72-b952-641f55ebc6e1 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:40.554461 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99534c55-0c2f-4e72-b952-641f55ebc6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:40.592064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-99534c55-0c2f-4e72-b952-641f55ebc6e1 None None] MFA Rules not processed for user `7431e8c106ba4e2689c0aa1001bbafe7`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:40.593717 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-99534c55-0c2f-4e72-b952-641f55ebc6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:40.625974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52648d-b051-42fe-9588-e6ccb2654b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:40.627156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52648d-b051-42fe-9588-e6ccb2654b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:40.627537 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52648d-b051-42fe-9588-e6ccb2654b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:40.627883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52648d-b051-42fe-9588-e6ccb2654b1c admin admin] PATH_INFO: `/v3/users/08426379d38f4fa786820d90b38e3143` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:40.629377 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52648d-b051-42fe-9588-e6ccb2654b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=08426379d38f4fa786820d90b38e3143)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:40.633198 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52648d-b051-42fe-9588-e6ccb2654b1c admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:40.669993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1154/2260] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:26:40.736746 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:40.933003 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-3d52648d-b051-42fe-9588-e6ccb2654b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08426379d38f4fa786820d90b38e3143'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:40.933734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-3d52648d-b051-42fe-9588-e6ccb2654b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08426379d38f4fa786820d90b38e3143'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:40.942636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-3d52648d-b051-42fe-9588-e6ccb2654b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08426379d38f4fa786820d90b38e3143'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:40.960214 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-3d52648d-b051-42fe-9588-e6ccb2654b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08426379d38f4fa786820d90b38e3143'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:40.963886 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-3d52648d-b051-42fe-9588-e6ccb2654b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08426379d38f4fa786820d90b38e3143'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:41.172066 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1107/2261] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:26:40 2022] DELETE /identity/v3/users/08426379d38f4fa786820d90b38e3143 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:42.249102 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99534c55-0c2f-4e72-b952-641f55ebc6e1 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:42.250894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-99534c55-0c2f-4e72-b952-641f55ebc6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:42.281521 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99534c55-0c2f-4e72-b952-641f55ebc6e1 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:42.380916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:42.452713 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b961dd1-400a-4b8e-a6a8-173c804a52b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:42.454221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b961dd1-400a-4b8e-a6a8-173c804a52b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:42.454781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b961dd1-400a-4b8e-a6a8-173c804a52b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:42.455193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b961dd1-400a-4b8e-a6a8-173c804a52b1 admin admin] PATH_INFO: `/v3/projects/a315e0184571414d8563e7357f41689b` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:42.458897 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b961dd1-400a-4b8e-a6a8-173c804a52b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a315e0184571414d8563e7357f41689b)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:42.465464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b961dd1-400a-4b8e-a6a8-173c804a52b1 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:42.737638 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9b961dd1-400a-4b8e-a6a8-173c804a52b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a315e0184571414d8563e7357f41689b', 'request_id': 'req-9b961dd1-400a-4b8e-a6a8-173c804a52b1'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:42.754493 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9b961dd1-400a-4b8e-a6a8-173c804a52b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a315e0184571414d8563e7357f41689b', 'request_id': 'req-9b961dd1-400a-4b8e-a6a8-173c804a52b1'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:42.764916 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9b961dd1-400a-4b8e-a6a8-173c804a52b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a315e0184571414d8563e7357f41689b', 'request_id': 'req-9b961dd1-400a-4b8e-a6a8-173c804a52b1'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:42.940456 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9b961dd1-400a-4b8e-a6a8-173c804a52b1 admin admin] The token cache is being invalidate because project a315e0184571414d8563e7357f41689b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:26:42.940456 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9b961dd1-400a-4b8e-a6a8-173c804a52b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:42.944801 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9b961dd1-400a-4b8e-a6a8-173c804a52b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:42.947095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1155/2262] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:26:42 2022] DELETE /identity/v3/projects/a315e0184571414d8563e7357f41689b => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:42.957166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3625eab-e6e7-45fc-92b3-f53e948fc702 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:42.957881 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3625eab-e6e7-45fc-92b3-f53e948fc702 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:42.958432 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3625eab-e6e7-45fc-92b3-f53e948fc702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:42.995876 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-a3625eab-e6e7-45fc-92b3-f53e948fc702 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:42.998471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-a3625eab-e6e7-45fc-92b3-f53e948fc702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:43.093131 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1108/2263] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:43.104829 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708dc78-0b7e-4e38-8432-c1cb9ec31fe9 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:43.105171 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708dc78-0b7e-4e38-8432-c1cb9ec31fe9 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:43.105580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708dc78-0b7e-4e38-8432-c1cb9ec31fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:43.131282 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-f708dc78-0b7e-4e38-8432-c1cb9ec31fe9 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:43.132425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f708dc78-0b7e-4e38-8432-c1cb9ec31fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:43.154382 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1156/2264] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:43.162517 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3625eab-e6e7-45fc-92b3-f53e948fc702 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:43.180844 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3625eab-e6e7-45fc-92b3-f53e948fc702 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:43.186893 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde7a39-7f2c-4ba5-8480-dbeb34dbdf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:43.188523 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde7a39-7f2c-4ba5-8480-dbeb34dbdf37 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:43.188935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde7a39-7f2c-4ba5-8480-dbeb34dbdf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:43.189330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde7a39-7f2c-4ba5-8480-dbeb34dbdf37 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:43.191079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde7a39-7f2c-4ba5-8480-dbeb34dbdf37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:26:43.191614 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde7a39-7f2c-4ba5-8480-dbeb34dbdf37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:43.196336 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde7a39-7f2c-4ba5-8480-dbeb34dbdf37 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:43.220400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1109/2265] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:26:43.225943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708dc78-0b7e-4e38-8432-c1cb9ec31fe9 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:43.243395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708dc78-0b7e-4e38-8432-c1cb9ec31fe9 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:43.252224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2feec-5e99-4db6-8084-37c26782ec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:43.254189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2feec-5e99-4db6-8084-37c26782ec2b admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:43.254816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2feec-5e99-4db6-8084-37c26782ec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:43.255529 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2feec-5e99-4db6-8084-37c26782ec2b admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:43.256707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2feec-5e99-4db6-8084-37c26782ec2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:43.260304 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2feec-5e99-4db6-8084-37c26782ec2b admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:43.500140 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1157/2266] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:43 2022] POST /identity/v3/projects => generated 367 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:43.501214 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde7a39-7f2c-4ba5-8480-dbeb34dbdf37 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:43.514930 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde7a39-7f2c-4ba5-8480-dbeb34dbdf37 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:43.712821 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0526971-1ac4-4d82-a8ea-810b0ad41f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:43.714613 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0526971-1ac4-4d82-a8ea-810b0ad41f31 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:43.714613 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0526971-1ac4-4d82-a8ea-810b0ad41f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:43.714613 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0526971-1ac4-4d82-a8ea-810b0ad41f31 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:43.715078 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0526971-1ac4-4d82-a8ea-810b0ad41f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:43.717443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0526971-1ac4-4d82-a8ea-810b0ad41f31 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:43.986875 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1110/2267] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:43 2022] POST /identity/v3/users => generated 284 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:43.997960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2feec-5e99-4db6-8084-37c26782ec2b admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:44.029387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2feec-5e99-4db6-8084-37c26782ec2b admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:44.043990 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bfb6df-2ef0-4a17-a04e-aa4c84e35db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:44.044710 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfb6df-2ef0-4a17-a04e-aa4c84e35db2 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:44.045241 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfb6df-2ef0-4a17-a04e-aa4c84e35db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:44.045624 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfb6df-2ef0-4a17-a04e-aa4c84e35db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:44.046398 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bfb6df-2ef0-4a17-a04e-aa4c84e35db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:44.048495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bfb6df-2ef0-4a17-a04e-aa4c84e35db2 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:44.084383 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1158/2268] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:44.088295 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0526971-1ac4-4d82-a8ea-810b0ad41f31 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:44.108771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0526971-1ac4-4d82-a8ea-810b0ad41f31 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:44.119858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d10e19-f3e9-4cdd-8c04-62a2e95a7c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:44.120402 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d10e19-f3e9-4cdd-8c04-62a2e95a7c6a admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:44.120725 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d10e19-f3e9-4cdd-8c04-62a2e95a7c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:44.121182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d10e19-f3e9-4cdd-8c04-62a2e95a7c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:44.121978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d10e19-f3e9-4cdd-8c04-62a2e95a7c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:44.123769 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d10e19-f3e9-4cdd-8c04-62a2e95a7c6a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:44.154703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1111/2269] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:26:44.156001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bfb6df-2ef0-4a17-a04e-aa4c84e35db2 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:44.168819 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bfb6df-2ef0-4a17-a04e-aa4c84e35db2 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:44.193582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4c6a9-6f07-4631-b722-6937ed8a61ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:44.194370 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4c6a9-6f07-4631-b722-6937ed8a61ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:44.194725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4c6a9-6f07-4631-b722-6937ed8a61ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:44.195130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4c6a9-6f07-4631-b722-6937ed8a61ee admin admin] PATH_INFO: `/v3/projects/df8ba1fefd5d4858b3ac59e61f9126ee/users/ad2e8276f50e46398cf6072fc4e915d1/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:44.238758 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4c6a9-6f07-4631-b722-6937ed8a61ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8ba1fefd5d4858b3ac59e61f9126ee, user_id=ad2e8276f50e46398cf6072fc4e915d1, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:44.238758 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4c6a9-6f07-4631-b722-6937ed8a61ee admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:44.795678 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1159/2270] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:44 2022] PUT /identity/v3/projects/df8ba1fefd5d4858b3ac59e61f9126ee/users/ad2e8276f50e46398cf6072fc4e915d1/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:44.797292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209935d-6e8f-41e9-a32b-a41b2535f686 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:44.797685 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209935d-6e8f-41e9-a32b-a41b2535f686 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:44.797971 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209935d-6e8f-41e9-a32b-a41b2535f686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:44.834733 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-5209935d-6e8f-41e9-a32b-a41b2535f686 None None] MFA Rules not processed for user `ad2e8276f50e46398cf6072fc4e915d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:44.836032 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-5209935d-6e8f-41e9-a32b-a41b2535f686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:44.983170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1112/2271] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:26:44.988663 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4c6a9-6f07-4631-b722-6937ed8a61ee admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:45.097673 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4c6a9-6f07-4631-b722-6937ed8a61ee admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:45.106589 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2107ba-8d1e-4fdc-ac18-74073bb32607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:45.107252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2107ba-8d1e-4fdc-ac18-74073bb32607 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:45.107540 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2107ba-8d1e-4fdc-ac18-74073bb32607 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:45.107856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2107ba-8d1e-4fdc-ac18-74073bb32607 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:45.108563 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2107ba-8d1e-4fdc-ac18-74073bb32607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:45.111418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2107ba-8d1e-4fdc-ac18-74073bb32607 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:45.682689 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1160/2272] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:44 2022] POST /identity/v3/projects => generated 367 bytes in 695 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:45.687813 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209935d-6e8f-41e9-a32b-a41b2535f686 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:45.700935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209935d-6e8f-41e9-a32b-a41b2535f686 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:45.778793 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a2497-70fd-4d55-8c8e-21d10f580507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:45.788812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a2497-70fd-4d55-8c8e-21d10f580507 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:45.788812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a2497-70fd-4d55-8c8e-21d10f580507 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:45.788812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a2497-70fd-4d55-8c8e-21d10f580507 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:45.788812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a2497-70fd-4d55-8c8e-21d10f580507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:45.788812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a2497-70fd-4d55-8c8e-21d10f580507 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:45.921892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1113/2273] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:26:45 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:26:45.923818 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2107ba-8d1e-4fdc-ac18-74073bb32607 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:45.940103 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2107ba-8d1e-4fdc-ac18-74073bb32607 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:45.947841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f8808-490b-48f4-8fd8-301621a51409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:45.948847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f8808-490b-48f4-8fd8-301621a51409 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:45.949342 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f8808-490b-48f4-8fd8-301621a51409 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:45.949873 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f8808-490b-48f4-8fd8-301621a51409 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:45.951062 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f8808-490b-48f4-8fd8-301621a51409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:45.954750 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f8808-490b-48f4-8fd8-301621a51409 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:45.972017 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1161/2274] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:26:45.976579 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a2497-70fd-4d55-8c8e-21d10f580507 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:45.992267 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a2497-70fd-4d55-8c8e-21d10f580507 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:45.999255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9a718-a1eb-4134-b834-a0e2a4adba09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:46.000744 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9a718-a1eb-4134-b834-a0e2a4adba09 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:46.001192 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9a718-a1eb-4134-b834-a0e2a4adba09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:46.001511 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9a718-a1eb-4134-b834-a0e2a4adba09 admin admin] PATH_INFO: `/v3/projects/8fffa930020c4eaf941cbfc854e55110/users/e3fadf38a754418097000036f15dddd4/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:46.020347 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9a718-a1eb-4134-b834-a0e2a4adba09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fffa930020c4eaf941cbfc854e55110, user_id=e3fadf38a754418097000036f15dddd4, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:46.024002 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9a718-a1eb-4134-b834-a0e2a4adba09 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:46.184566 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1114/2275] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:45 2022] PUT /identity/v3/projects/8fffa930020c4eaf941cbfc854e55110/users/e3fadf38a754418097000036f15dddd4/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:46.191609 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f8808-490b-48f4-8fd8-301621a51409 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:46.205930 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f8808-490b-48f4-8fd8-301621a51409 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:46.285999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887a264-b0b4-4eae-9fde-66918554b442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:46.286630 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887a264-b0b4-4eae-9fde-66918554b442 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:46.287039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887a264-b0b4-4eae-9fde-66918554b442 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:46.287181 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887a264-b0b4-4eae-9fde-66918554b442 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:46.287834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887a264-b0b4-4eae-9fde-66918554b442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:46.289456 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887a264-b0b4-4eae-9fde-66918554b442 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:46.306171 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1162/2276] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:26:46.308912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9a718-a1eb-4134-b834-a0e2a4adba09 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:46.327998 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9a718-a1eb-4134-b834-a0e2a4adba09 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:46.336708 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd3f96-6310-4259-9663-fa1d7920fc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:46.337698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd3f96-6310-4259-9663-fa1d7920fc1e admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:46.338073 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd3f96-6310-4259-9663-fa1d7920fc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:46.338426 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd3f96-6310-4259-9663-fa1d7920fc1e admin admin] PATH_INFO: `/v3/projects/8fffa930020c4eaf941cbfc854e55110/users/e3fadf38a754418097000036f15dddd4/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:46.340966 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd3f96-6310-4259-9663-fa1d7920fc1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fffa930020c4eaf941cbfc854e55110, user_id=e3fadf38a754418097000036f15dddd4, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:46.344053 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd3f96-6310-4259-9663-fa1d7920fc1e admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:46.361042 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1115/2277] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:26:46 2022] PUT /identity/v3/projects/8fffa930020c4eaf941cbfc854e55110/users/e3fadf38a754418097000036f15dddd4/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:46.384042 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e38bff-ca6b-4210-a1bf-3330b3053b11 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:46.385345 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e38bff-ca6b-4210-a1bf-3330b3053b11 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:46.386544 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e38bff-ca6b-4210-a1bf-3330b3053b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:46.475362 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-58e38bff-ca6b-4210-a1bf-3330b3053b11 None None] MFA Rules not processed for user `e3fadf38a754418097000036f15dddd4`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:46.476776 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-58e38bff-ca6b-4210-a1bf-3330b3053b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:46.623345 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:46.625947 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1163/2278] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:26:46.641587 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd3f96-6310-4259-9663-fa1d7920fc1e admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:46.646720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ddbd3f96-6310-4259-9663-fa1d7920fc1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:46.757425 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd3f96-6310-4259-9663-fa1d7920fc1e admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:46.762996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822cc91-be5b-4262-8d71-85a73e641992 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:46.764062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822cc91-be5b-4262-8d71-85a73e641992 service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:46.764238 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822cc91-be5b-4262-8d71-85a73e641992 service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:46.764959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822cc91-be5b-4262-8d71-85a73e641992 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:46.777681 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822cc91-be5b-4262-8d71-85a73e641992 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:46.779211 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822cc91-be5b-4262-8d71-85a73e641992 service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:46.794515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1116/2279] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:46.964466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e38bff-ca6b-4210-a1bf-3330b3053b11 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:46.966772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-58e38bff-ca6b-4210-a1bf-3330b3053b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:46.986944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e38bff-ca6b-4210-a1bf-3330b3053b11 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:46.992846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d9438-3278-4066-96f1-ff8d73df87ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:46.993934 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d9438-3278-4066-96f1-ff8d73df87ce service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:46.994436 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d9438-3278-4066-96f1-ff8d73df87ce service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:46.994927 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d9438-3278-4066-96f1-ff8d73df87ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:47.049072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:47.101912 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d9438-3278-4066-96f1-ff8d73df87ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:47.103652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d9438-3278-4066-96f1-ff8d73df87ce service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:47.117730 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1164/2280] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:48.360819 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:49.905367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:53.149720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:55.218453 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822cc91-be5b-4262-8d71-85a73e641992 service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:55.293459 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822cc91-be5b-4262-8d71-85a73e641992 service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:55.300693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232aa8e-4f7c-4bff-a30a-365862f7c4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:55.301503 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232aa8e-4f7c-4bff-a30a-365862f7c4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:55.301921 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232aa8e-4f7c-4bff-a30a-365862f7c4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:55.303563 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232aa8e-4f7c-4bff-a30a-365862f7c4e1 admin admin] PATH_INFO: `/v3/users/ad2e8276f50e46398cf6072fc4e915d1` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:55.303677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232aa8e-4f7c-4bff-a30a-365862f7c4e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad2e8276f50e46398cf6072fc4e915d1)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:55.305984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232aa8e-4f7c-4bff-a30a-365862f7c4e1 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:55.593448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a232aa8e-4f7c-4bff-a30a-365862f7c4e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad2e8276f50e46398cf6072fc4e915d1'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:55.594453 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a232aa8e-4f7c-4bff-a30a-365862f7c4e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad2e8276f50e46398cf6072fc4e915d1'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:55.606177 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a232aa8e-4f7c-4bff-a30a-365862f7c4e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad2e8276f50e46398cf6072fc4e915d1'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:55.630239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a232aa8e-4f7c-4bff-a30a-365862f7c4e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad2e8276f50e46398cf6072fc4e915d1'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:55.631009 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a232aa8e-4f7c-4bff-a30a-365862f7c4e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad2e8276f50e46398cf6072fc4e915d1'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:55.744845 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1117/2281] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:26:55 2022] DELETE /identity/v3/users/ad2e8276f50e46398cf6072fc4e915d1 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:55.745147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e42ce-d2a3-4994-b76e-96d959dc93f9 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:55.745858 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e42ce-d2a3-4994-b76e-96d959dc93f9 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:55.745858 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e42ce-d2a3-4994-b76e-96d959dc93f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:55.770026 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-b36e42ce-d2a3-4994-b76e-96d959dc93f9 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:55.771562 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b36e42ce-d2a3-4994-b76e-96d959dc93f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:55.778521 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:55.884949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1165/2282] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:55.901929 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232aa8e-4f7c-4bff-a30a-365862f7c4e1 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:55.908788 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-a232aa8e-4f7c-4bff-a30a-365862f7c4e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:56.074981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232aa8e-4f7c-4bff-a30a-365862f7c4e1 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:56.080373 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6cab3-2d0f-4b27-ae4e-e5332293add3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:56.081420 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6cab3-2d0f-4b27-ae4e-e5332293add3 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:56.081755 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6cab3-2d0f-4b27-ae4e-e5332293add3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:56.082075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6cab3-2d0f-4b27-ae4e-e5332293add3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:56.093618 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6cab3-2d0f-4b27-ae4e-e5332293add3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:56.095618 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6cab3-2d0f-4b27-ae4e-e5332293add3 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:56.117931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1118/2283] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:57.006699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e42ce-d2a3-4994-b76e-96d959dc93f9 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:57.008820 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b36e42ce-d2a3-4994-b76e-96d959dc93f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:57.039245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e42ce-d2a3-4994-b76e-96d959dc93f9 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:57.056272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0cf12b-0d2c-43c9-9bb3-9968fb0d52ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:57.057605 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cf12b-0d2c-43c9-9bb3-9968fb0d52ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:57.058314 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cf12b-0d2c-43c9-9bb3-9968fb0d52ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:57.058780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cf12b-0d2c-43c9-9bb3-9968fb0d52ee admin admin] PATH_INFO: `/v3/projects/df8ba1fefd5d4858b3ac59e61f9126ee` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:57.060333 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0cf12b-0d2c-43c9-9bb3-9968fb0d52ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=df8ba1fefd5d4858b3ac59e61f9126ee)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:57.063954 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0cf12b-0d2c-43c9-9bb3-9968fb0d52ee admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:57.117952 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:57.223870 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7c0cf12b-0d2c-43c9-9bb3-9968fb0d52ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df8ba1fefd5d4858b3ac59e61f9126ee', 'request_id': 'req-7c0cf12b-0d2c-43c9-9bb3-9968fb0d52ee'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:57.237372 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7c0cf12b-0d2c-43c9-9bb3-9968fb0d52ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df8ba1fefd5d4858b3ac59e61f9126ee', 'request_id': 'req-7c0cf12b-0d2c-43c9-9bb3-9968fb0d52ee'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:57.241430 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7c0cf12b-0d2c-43c9-9bb3-9968fb0d52ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df8ba1fefd5d4858b3ac59e61f9126ee', 'request_id': 'req-7c0cf12b-0d2c-43c9-9bb3-9968fb0d52ee'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:57.407990 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7c0cf12b-0d2c-43c9-9bb3-9968fb0d52ee admin admin] The token cache is being invalidate because project df8ba1fefd5d4858b3ac59e61f9126ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:26:57.413447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7c0cf12b-0d2c-43c9-9bb3-9968fb0d52ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:57.413447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7c0cf12b-0d2c-43c9-9bb3-9968fb0d52ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:57.415721 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1166/2284] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:26:57 2022] DELETE /identity/v3/projects/df8ba1fefd5d4858b3ac59e61f9126ee => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:57.416460 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6cab3-2d0f-4b27-ae4e-e5332293add3 service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:57.432531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6cab3-2d0f-4b27-ae4e-e5332293add3 service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:57.553400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd47da5-69c4-44b2-b1b0-efcfc10c409c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:57.555165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd47da5-69c4-44b2-b1b0-efcfc10c409c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:57.555913 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd47da5-69c4-44b2-b1b0-efcfc10c409c admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:57.556870 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd47da5-69c4-44b2-b1b0-efcfc10c409c admin admin] PATH_INFO: `/v3/users/e3fadf38a754418097000036f15dddd4` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:57.560459 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd47da5-69c4-44b2-b1b0-efcfc10c409c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3fadf38a754418097000036f15dddd4)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:57.571369 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd47da5-69c4-44b2-b1b0-efcfc10c409c admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:57.990736 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-afd47da5-69c4-44b2-b1b0-efcfc10c409c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3fadf38a754418097000036f15dddd4'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:57.992078 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-afd47da5-69c4-44b2-b1b0-efcfc10c409c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3fadf38a754418097000036f15dddd4'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:58.004373 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-afd47da5-69c4-44b2-b1b0-efcfc10c409c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3fadf38a754418097000036f15dddd4'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:58.022791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-afd47da5-69c4-44b2-b1b0-efcfc10c409c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3fadf38a754418097000036f15dddd4'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:58.023781 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-afd47da5-69c4-44b2-b1b0-efcfc10c409c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3fadf38a754418097000036f15dddd4'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:58.194247 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1119/2285] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:26:57 2022] DELETE /identity/v3/users/e3fadf38a754418097000036f15dddd4 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:58.896565 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0cf12b-0d2c-43c9-9bb3-9968fb0d52ee admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:58.898636 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-7c0cf12b-0d2c-43c9-9bb3-9968fb0d52ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:58.920553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0cf12b-0d2c-43c9-9bb3-9968fb0d52ee admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:58.961461 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd47da5-69c4-44b2-b1b0-efcfc10c409c admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:58.961748 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-afd47da5-69c4-44b2-b1b0-efcfc10c409c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:59.062442 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5a2a7-7772-457f-aa7c-3955fbcb6cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:59.064575 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5a2a7-7772-457f-aa7c-3955fbcb6cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:59.065287 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5a2a7-7772-457f-aa7c-3955fbcb6cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:59.066210 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5a2a7-7772-457f-aa7c-3955fbcb6cc2 admin admin] PATH_INFO: `/v3/projects/8fffa930020c4eaf941cbfc854e55110` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:59.070388 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5a2a7-7772-457f-aa7c-3955fbcb6cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fffa930020c4eaf941cbfc854e55110)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:59.075644 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5a2a7-7772-457f-aa7c-3955fbcb6cc2 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:59.106093 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd47da5-69c4-44b2-b1b0-efcfc10c409c admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:59.136677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd03d76-2e07-4b03-a307-3d26800bb992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:59.136677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd03d76-2e07-4b03-a307-3d26800bb992 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:59.136677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd03d76-2e07-4b03-a307-3d26800bb992 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:59.136677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd03d76-2e07-4b03-a307-3d26800bb992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:59.139238 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-fcd03d76-2e07-4b03-a307-3d26800bb992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:59.262278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd03d76-2e07-4b03-a307-3d26800bb992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:59.265148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd03d76-2e07-4b03-a307-3d26800bb992 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:59.275203 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1120/2286] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:26:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:26:59.326383 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9ee5a2a7-7772-457f-aa7c-3955fbcb6cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fffa930020c4eaf941cbfc854e55110', 'request_id': 'req-9ee5a2a7-7772-457f-aa7c-3955fbcb6cc2'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:59.348658 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9ee5a2a7-7772-457f-aa7c-3955fbcb6cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fffa930020c4eaf941cbfc854e55110', 'request_id': 'req-9ee5a2a7-7772-457f-aa7c-3955fbcb6cc2'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:59.357689 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9ee5a2a7-7772-457f-aa7c-3955fbcb6cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fffa930020c4eaf941cbfc854e55110', 'request_id': 'req-9ee5a2a7-7772-457f-aa7c-3955fbcb6cc2'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:59.543682 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9ee5a2a7-7772-457f-aa7c-3955fbcb6cc2 admin admin] The token cache is being invalidate because project 8fffa930020c4eaf941cbfc854e55110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:26:59.544466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9ee5a2a7-7772-457f-aa7c-3955fbcb6cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:59.546030 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9ee5a2a7-7772-457f-aa7c-3955fbcb6cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:26:59.551714 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1167/2287] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:26:58 2022] DELETE /identity/v3/projects/8fffa930020c4eaf941cbfc854e55110 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:26:59.555095 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f916d-668c-4b08-9a91-f269ec11408b None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:59.555382 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f916d-668c-4b08-9a91-f269ec11408b None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:59.555667 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f916d-668c-4b08-9a91-f269ec11408b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:59.597454 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-286f916d-668c-4b08-9a91-f269ec11408b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:59.599022 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-286f916d-668c-4b08-9a91-f269ec11408b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:59.725358 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1121/2288] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:59.735368 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b6470-ec25-4deb-b0f0-8cb7051a74c1 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:59.735783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b6470-ec25-4deb-b0f0-8cb7051a74c1 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:59.736298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b6470-ec25-4deb-b0f0-8cb7051a74c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:59.767354 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-f36b6470-ec25-4deb-b0f0-8cb7051a74c1 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:26:59.774959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f36b6470-ec25-4deb-b0f0-8cb7051a74c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:26:59.787493 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1168/2289] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:26:59.792620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f916d-668c-4b08-9a91-f269ec11408b None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:59.807623 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f916d-668c-4b08-9a91-f269ec11408b None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:59.823388 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1caa765-2e1f-478c-bdab-30d50f6e1a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:59.824793 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caa765-2e1f-478c-bdab-30d50f6e1a04 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:59.827609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caa765-2e1f-478c-bdab-30d50f6e1a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:59.827609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caa765-2e1f-478c-bdab-30d50f6e1a04 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:59.829382 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1caa765-2e1f-478c-bdab-30d50f6e1a04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:26:59.830152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1caa765-2e1f-478c-bdab-30d50f6e1a04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:59.834692 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1caa765-2e1f-478c-bdab-30d50f6e1a04 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:26:59.869457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1122/2290] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:26:59.870464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b6470-ec25-4deb-b0f0-8cb7051a74c1 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:26:59.898173 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b6470-ec25-4deb-b0f0-8cb7051a74c1 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:26:59.899768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:59.906416 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2739bc8-e535-4ba3-90f2-1145cbd775f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:26:59.909646 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2739bc8-e535-4ba3-90f2-1145cbd775f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:26:59.910249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2739bc8-e535-4ba3-90f2-1145cbd775f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:26:59.910680 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2739bc8-e535-4ba3-90f2-1145cbd775f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:26:59.912230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2739bc8-e535-4ba3-90f2-1145cbd775f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:26:59.915371 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2739bc8-e535-4ba3-90f2-1145cbd775f5 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:00.014166 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:00.067474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1169/2291] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:26:59 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:27:00.075997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1caa765-2e1f-478c-bdab-30d50f6e1a04 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:00.111741 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1caa765-2e1f-478c-bdab-30d50f6e1a04 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:00.257106 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39746f0-08ea-4837-a954-3dcb8d985f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:00.258390 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39746f0-08ea-4837-a954-3dcb8d985f0d admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:00.258999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39746f0-08ea-4837-a954-3dcb8d985f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:00.259784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39746f0-08ea-4837-a954-3dcb8d985f0d admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:00.261076 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39746f0-08ea-4837-a954-3dcb8d985f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:00.268354 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39746f0-08ea-4837-a954-3dcb8d985f0d admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:00.424177 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1123/2292] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:27:00 2022] POST /identity/v3/users => generated 289 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:00.430416 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2739bc8-e535-4ba3-90f2-1145cbd775f5 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:00.467205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2739bc8-e535-4ba3-90f2-1145cbd775f5 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:00.474329 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110c3e6-a674-4f3b-823a-2b227b1bbbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:00.475145 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110c3e6-a674-4f3b-823a-2b227b1bbbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:00.475548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110c3e6-a674-4f3b-823a-2b227b1bbbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:00.475941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110c3e6-a674-4f3b-823a-2b227b1bbbd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:00.476995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110c3e6-a674-4f3b-823a-2b227b1bbbd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:00.478558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110c3e6-a674-4f3b-823a-2b227b1bbbd9 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:00.503559 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1170/2293] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:00.514784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39746f0-08ea-4837-a954-3dcb8d985f0d admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:00.528599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39746f0-08ea-4837-a954-3dcb8d985f0d admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:00.539676 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae42f6-91d4-431f-a3b5-1e8e073ad577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:00.540540 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae42f6-91d4-431f-a3b5-1e8e073ad577 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:00.540846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae42f6-91d4-431f-a3b5-1e8e073ad577 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:00.541549 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae42f6-91d4-431f-a3b5-1e8e073ad577 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:00.544586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae42f6-91d4-431f-a3b5-1e8e073ad577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:00.546505 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae42f6-91d4-431f-a3b5-1e8e073ad577 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:00.566900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1124/2294] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:27:00.574214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110c3e6-a674-4f3b-823a-2b227b1bbbd9 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:00.590973 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110c3e6-a674-4f3b-823a-2b227b1bbbd9 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:00.600378 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a9dd3-81d2-4faa-8ad0-81209a5ac05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:00.601533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a9dd3-81d2-4faa-8ad0-81209a5ac05b admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:00.602079 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a9dd3-81d2-4faa-8ad0-81209a5ac05b admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:00.602580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a9dd3-81d2-4faa-8ad0-81209a5ac05b admin admin] PATH_INFO: `/v3/projects/7ef3343dc6334838a98aa7a8b05bd8a9/users/e04984d9f69e4701951b65b15bf49ca1/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:00.630567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a9dd3-81d2-4faa-8ad0-81209a5ac05b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef3343dc6334838a98aa7a8b05bd8a9, user_id=e04984d9f69e4701951b65b15bf49ca1, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:00.630567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a9dd3-81d2-4faa-8ad0-81209a5ac05b admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:00.848272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1171/2295] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:00 2022] PUT /identity/v3/projects/7ef3343dc6334838a98aa7a8b05bd8a9/users/e04984d9f69e4701951b65b15bf49ca1/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:00.864459 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3fde2-2a9d-4e98-b4ad-f2bc002531ba None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:00.864931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3fde2-2a9d-4e98-b4ad-f2bc002531ba None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:00.867326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3fde2-2a9d-4e98-b4ad-f2bc002531ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:00.976579 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-30d3fde2-2a9d-4e98-b4ad-f2bc002531ba None None] MFA Rules not processed for user `e04984d9f69e4701951b65b15bf49ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:00.981978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-30d3fde2-2a9d-4e98-b4ad-f2bc002531ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:01.089163 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1125/2296] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:27:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:01.096011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a9dd3-81d2-4faa-8ad0-81209a5ac05b admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:01.207433 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a9dd3-81d2-4faa-8ad0-81209a5ac05b admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:01.216254 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e52496-5b3b-48bc-867b-43389cb352c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:01.225354 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e52496-5b3b-48bc-867b-43389cb352c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:01.225354 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e52496-5b3b-48bc-867b-43389cb352c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:01.225354 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e52496-5b3b-48bc-867b-43389cb352c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:01.225354 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e52496-5b3b-48bc-867b-43389cb352c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:01.225354 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e52496-5b3b-48bc-867b-43389cb352c0 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:01.396133 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1172/2297] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:27:01 2022] POST /identity/v3/projects => generated 377 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:01.398246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3fde2-2a9d-4e98-b4ad-f2bc002531ba None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:01.413798 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3fde2-2a9d-4e98-b4ad-f2bc002531ba None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:01.520353 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63018c99-a3a8-4244-8cc1-c26bc9ebbd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:01.521352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63018c99-a3a8-4244-8cc1-c26bc9ebbd6b admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:01.522099 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63018c99-a3a8-4244-8cc1-c26bc9ebbd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:01.522556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63018c99-a3a8-4244-8cc1-c26bc9ebbd6b admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:01.523980 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63018c99-a3a8-4244-8cc1-c26bc9ebbd6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:01.527216 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63018c99-a3a8-4244-8cc1-c26bc9ebbd6b admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:01.624469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e52496-5b3b-48bc-867b-43389cb352c0 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:01.627884 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-92e52496-5b3b-48bc-867b-43389cb352c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:01.715324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e52496-5b3b-48bc-867b-43389cb352c0 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:01.725215 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205c4b6-3c65-4a95-a253-19a5eecebb05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:01.726432 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205c4b6-3c65-4a95-a253-19a5eecebb05 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:01.726895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205c4b6-3c65-4a95-a253-19a5eecebb05 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:01.727199 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205c4b6-3c65-4a95-a253-19a5eecebb05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:01.729672 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-0205c4b6-3c65-4a95-a253-19a5eecebb05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:01.743728 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1126/2298] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:27:01 2022] POST /identity/v3/users => generated 289 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:01.745116 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63018c99-a3a8-4244-8cc1-c26bc9ebbd6b admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:01.766669 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63018c99-a3a8-4244-8cc1-c26bc9ebbd6b admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:01.784110 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69cfc1-4c86-4a76-8176-6eb567740ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:01.785175 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69cfc1-4c86-4a76-8176-6eb567740ddb admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:01.785652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69cfc1-4c86-4a76-8176-6eb567740ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:01.786059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69cfc1-4c86-4a76-8176-6eb567740ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:01.787380 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69cfc1-4c86-4a76-8176-6eb567740ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:01.790875 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69cfc1-4c86-4a76-8176-6eb567740ddb admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:01.809647 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1127/2299] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:01.811475 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69cfc1-4c86-4a76-8176-6eb567740ddb admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:01.832578 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69cfc1-4c86-4a76-8176-6eb567740ddb admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:01.840199 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966b533-ec23-475a-9458-7b4d70e2fe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:01.840838 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966b533-ec23-475a-9458-7b4d70e2fe5e admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:01.841124 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966b533-ec23-475a-9458-7b4d70e2fe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:01.841409 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966b533-ec23-475a-9458-7b4d70e2fe5e admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:01.842123 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966b533-ec23-475a-9458-7b4d70e2fe5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:01.845013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966b533-ec23-475a-9458-7b4d70e2fe5e admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:01.854357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205c4b6-3c65-4a95-a253-19a5eecebb05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:01.861088 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1128/2300] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:01.861179 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205c4b6-3c65-4a95-a253-19a5eecebb05 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:01.864472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966b533-ec23-475a-9458-7b4d70e2fe5e admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:01.884958 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1173/2301] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:27:01.893183 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966b533-ec23-475a-9458-7b4d70e2fe5e admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:01.900160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0613b0-983b-434b-ac15-7e6f230aa1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:01.901179 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0613b0-983b-434b-ac15-7e6f230aa1a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:01.901473 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0613b0-983b-434b-ac15-7e6f230aa1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:01.901722 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0613b0-983b-434b-ac15-7e6f230aa1a8 admin admin] PATH_INFO: `/v3/projects/164de5ea773e419ab87e1c5a5575576b/users/2404cfb5e17e471082e503af8fc9dbfa/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:01.924739 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0613b0-983b-434b-ac15-7e6f230aa1a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=164de5ea773e419ab87e1c5a5575576b, user_id=2404cfb5e17e471082e503af8fc9dbfa, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:01.929682 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0613b0-983b-434b-ac15-7e6f230aa1a8 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:02.101704 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1129/2302] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:01 2022] PUT /identity/v3/projects/164de5ea773e419ab87e1c5a5575576b/users/2404cfb5e17e471082e503af8fc9dbfa/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:02.115520 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eacd1-a549-4b34-a0f6-54a748034187 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:02.117401 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eacd1-a549-4b34-a0f6-54a748034187 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:02.118110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eacd1-a549-4b34-a0f6-54a748034187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:02.176440 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-577eacd1-a549-4b34-a0f6-54a748034187 None None] MFA Rules not processed for user `2404cfb5e17e471082e503af8fc9dbfa`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:02.178904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-577eacd1-a549-4b34-a0f6-54a748034187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:02.287104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1174/2303] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:27:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:27:02.290925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0613b0-983b-434b-ac15-7e6f230aa1a8 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:02.435807 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0613b0-983b-434b-ac15-7e6f230aa1a8 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:02.446838 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bddc5c-2906-44c6-8187-cb646868e499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:02.447920 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bddc5c-2906-44c6-8187-cb646868e499 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:02.448377 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bddc5c-2906-44c6-8187-cb646868e499 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:02.448827 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bddc5c-2906-44c6-8187-cb646868e499 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:02.449934 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bddc5c-2906-44c6-8187-cb646868e499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:02.455631 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bddc5c-2906-44c6-8187-cb646868e499 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:02.621279 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1130/2304] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:27:02 2022] POST /identity/v3/projects => generated 375 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:02.626307 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577eacd1-a549-4b34-a0f6-54a748034187 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:02.648724 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577eacd1-a549-4b34-a0f6-54a748034187 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:02.778359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b26c7-0f91-4ff4-8e92-753ee8c5b47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:02.781055 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b26c7-0f91-4ff4-8e92-753ee8c5b47f admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:02.781890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b26c7-0f91-4ff4-8e92-753ee8c5b47f admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:02.782682 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b26c7-0f91-4ff4-8e92-753ee8c5b47f admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:02.784108 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b26c7-0f91-4ff4-8e92-753ee8c5b47f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:02.789740 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b26c7-0f91-4ff4-8e92-753ee8c5b47f admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:02.976915 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bddc5c-2906-44c6-8187-cb646868e499 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:02.977241 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1175/2305] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:27:02 2022] POST /identity/v3/users => generated 294 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:02.997491 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bddc5c-2906-44c6-8187-cb646868e499 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:03.008734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc926a0-6fe1-4d2b-8b0d-afc2c1638a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:03.009294 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc926a0-6fe1-4d2b-8b0d-afc2c1638a1a admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:03.009916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc926a0-6fe1-4d2b-8b0d-afc2c1638a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:03.010118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc926a0-6fe1-4d2b-8b0d-afc2c1638a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:03.010713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc926a0-6fe1-4d2b-8b0d-afc2c1638a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:03.012663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc926a0-6fe1-4d2b-8b0d-afc2c1638a1a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:03.053670 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b26c7-0f91-4ff4-8e92-753ee8c5b47f admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:03.064215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1131/2306] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:03.075419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b26c7-0f91-4ff4-8e92-753ee8c5b47f admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:03.084702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1197a7a-b934-487f-95e4-08ef36651e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:03.085970 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1197a7a-b934-487f-95e4-08ef36651e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:03.088033 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1197a7a-b934-487f-95e4-08ef36651e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:03.089092 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1197a7a-b934-487f-95e4-08ef36651e13 admin admin] PATH_INFO: `/v3/projects/ab562408a07641ef91e03aa4669b5825/users/b7d111b91624437b8c8615535dc370c6/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:03.107112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:03.128596 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1197a7a-b934-487f-95e4-08ef36651e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab562408a07641ef91e03aa4669b5825, user_id=b7d111b91624437b8c8615535dc370c6, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:03.131420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1197a7a-b934-487f-95e4-08ef36651e13 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:03.179731 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:03.218303 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1176/2307] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:03 2022] PUT /identity/v3/projects/ab562408a07641ef91e03aa4669b5825/users/b7d111b91624437b8c8615535dc370c6/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:03.223680 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc926a0-6fe1-4d2b-8b0d-afc2c1638a1a admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:03.237631 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc926a0-6fe1-4d2b-8b0d-afc2c1638a1a admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:03.322130 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437e657-02db-497c-b06e-e3f77812abd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:03.324696 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437e657-02db-497c-b06e-e3f77812abd5 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:03.326428 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437e657-02db-497c-b06e-e3f77812abd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:03.328011 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437e657-02db-497c-b06e-e3f77812abd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:03.329175 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437e657-02db-497c-b06e-e3f77812abd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:03.332263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437e657-02db-497c-b06e-e3f77812abd5 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:03.346183 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1132/2308] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:03.353040 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1197a7a-b934-487f-95e4-08ef36651e13 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:03.374861 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1197a7a-b934-487f-95e4-08ef36651e13 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:03.385070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32324975-2489-440e-b5f6-b844d95afdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:03.386377 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32324975-2489-440e-b5f6-b844d95afdbc admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:03.387754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32324975-2489-440e-b5f6-b844d95afdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:03.388593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32324975-2489-440e-b5f6-b844d95afdbc admin admin] PATH_INFO: `/v3/projects/ab562408a07641ef91e03aa4669b5825/users/b7d111b91624437b8c8615535dc370c6/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:03.394380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32324975-2489-440e-b5f6-b844d95afdbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab562408a07641ef91e03aa4669b5825, user_id=b7d111b91624437b8c8615535dc370c6, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:03.400714 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32324975-2489-440e-b5f6-b844d95afdbc admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:03.443238 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1177/2309] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:03 2022] PUT /identity/v3/projects/ab562408a07641ef91e03aa4669b5825/users/b7d111b91624437b8c8615535dc370c6/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:27:03.446061 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f919e-a447-438e-8a27-08e9da914875 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:03.446599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f919e-a447-438e-8a27-08e9da914875 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:03.447043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f919e-a447-438e-8a27-08e9da914875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:03.502728 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-4f2f919e-a447-438e-8a27-08e9da914875 None None] MFA Rules not processed for user `b7d111b91624437b8c8615535dc370c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:03.504671 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-4f2f919e-a447-438e-8a27-08e9da914875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:03.705861 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1133/2310] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:27:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:03.725703 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32324975-2489-440e-b5f6-b844d95afdbc admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:03.735117 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-32324975-2489-440e-b5f6-b844d95afdbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:03.871039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32324975-2489-440e-b5f6-b844d95afdbc admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:03.880120 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67077273-c051-40b9-8dc2-752ed58e5f80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:03.881450 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67077273-c051-40b9-8dc2-752ed58e5f80 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:03.882733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67077273-c051-40b9-8dc2-752ed58e5f80 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:03.882733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67077273-c051-40b9-8dc2-752ed58e5f80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:03.985401 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67077273-c051-40b9-8dc2-752ed58e5f80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:03.987278 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67077273-c051-40b9-8dc2-752ed58e5f80 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:03.999761 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1178/2311] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:04.593111 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:05.417373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:06.120400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:07.980842 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f919e-a447-438e-8a27-08e9da914875 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:07.982163 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-4f2f919e-a447-438e-8a27-08e9da914875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:07.996233 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f919e-a447-438e-8a27-08e9da914875 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:08.001415 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d973f08-cc8c-419e-98cb-063d118980ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:08.002133 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d973f08-cc8c-419e-98cb-063d118980ed service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:08.002411 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d973f08-cc8c-419e-98cb-063d118980ed service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:08.002886 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d973f08-cc8c-419e-98cb-063d118980ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:08.116057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d973f08-cc8c-419e-98cb-063d118980ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:08.118115 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d973f08-cc8c-419e-98cb-063d118980ed service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:08.136374 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1134/2312] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:08.612244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f036a51-06ef-4371-8784-7fd64ea92168 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:08.612705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f036a51-06ef-4371-8784-7fd64ea92168 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:08.612812 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f036a51-06ef-4371-8784-7fd64ea92168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:08.629294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:08.669855 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-4f036a51-06ef-4371-8784-7fd64ea92168 None None] MFA Rules not processed for user `f45f65dd3a844cb583e42d837d2a58d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:08.671715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-4f036a51-06ef-4371-8784-7fd64ea92168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:08.792466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1179/2313] 10.222.0.79 () {58 vars in 967 bytes} [Fri Sep 2 21:27:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:27:08.806840 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d973f08-cc8c-419e-98cb-063d118980ed service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:08.808409 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-5d973f08-cc8c-419e-98cb-063d118980ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:08.926025 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d973f08-cc8c-419e-98cb-063d118980ed service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:08.939777 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01be5c-48db-43d7-b255-3dfde8b19824 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da2b1dc9dae413a8ee63ad67e840f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:08.939777 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01be5c-48db-43d7-b255-3dfde8b19824 service swift] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:08.939777 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01be5c-48db-43d7-b255-3dfde8b19824 service swift] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:08.939777 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01be5c-48db-43d7-b255-3dfde8b19824 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:08.959503 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01be5c-48db-43d7-b255-3dfde8b19824 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:08.962753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01be5c-48db-43d7-b255-3dfde8b19824 service swift] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:08.994868 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1135/2314] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Sep 2 21:27:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:27:10.097360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:10.994211 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f036a51-06ef-4371-8784-7fd64ea92168 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:11.012372 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f036a51-06ef-4371-8784-7fd64ea92168 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:11.018960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bdf01-a964-4bbc-b002-02978e67d936 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:11.020327 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bdf01-a964-4bbc-b002-02978e67d936 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:11.021039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bdf01-a964-4bbc-b002-02978e67d936 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:11.021626 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bdf01-a964-4bbc-b002-02978e67d936 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:11.037020 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bdf01-a964-4bbc-b002-02978e67d936 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:11.040210 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bdf01-a964-4bbc-b002-02978e67d936 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:11.079339 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1180/2315] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:11.994896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:12.750830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:14.467330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:14.708903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:16.194860 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:16.589290 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01be5c-48db-43d7-b255-3dfde8b19824 service swift] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:16.634359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:16.671689 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01be5c-48db-43d7-b255-3dfde8b19824 service swift] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:16.677542 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33546e7f-9957-4a0d-b186-6ccbb0869a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:16.684413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33546e7f-9957-4a0d-b186-6ccbb0869a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:16.684413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33546e7f-9957-4a0d-b186-6ccbb0869a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:16.684413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33546e7f-9957-4a0d-b186-6ccbb0869a1e admin admin] PATH_INFO: `/v3/users/e04984d9f69e4701951b65b15bf49ca1` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:16.684413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33546e7f-9957-4a0d-b186-6ccbb0869a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e04984d9f69e4701951b65b15bf49ca1)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:16.684413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33546e7f-9957-4a0d-b186-6ccbb0869a1e admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:17.079414 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-33546e7f-9957-4a0d-b186-6ccbb0869a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e04984d9f69e4701951b65b15bf49ca1'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:17.080151 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-33546e7f-9957-4a0d-b186-6ccbb0869a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e04984d9f69e4701951b65b15bf49ca1'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:17.091058 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-33546e7f-9957-4a0d-b186-6ccbb0869a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e04984d9f69e4701951b65b15bf49ca1'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:17.111012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-33546e7f-9957-4a0d-b186-6ccbb0869a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e04984d9f69e4701951b65b15bf49ca1'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:17.112919 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-33546e7f-9957-4a0d-b186-6ccbb0869a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e04984d9f69e4701951b65b15bf49ca1'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:17.348880 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1136/2316] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:27:16 2022] DELETE /identity/v3/users/e04984d9f69e4701951b65b15bf49ca1 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:17.352649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd513052-9f45-451b-8d0f-3d133175cfb6 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:17.356205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd513052-9f45-451b-8d0f-3d133175cfb6 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:17.356961 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd513052-9f45-451b-8d0f-3d133175cfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:17.393439 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-dd513052-9f45-451b-8d0f-3d133175cfb6 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:17.395031 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-dd513052-9f45-451b-8d0f-3d133175cfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:17.508155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1181/2317] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:17.519782 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33546e7f-9957-4a0d-b186-6ccbb0869a1e admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:17.525347 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-33546e7f-9957-4a0d-b186-6ccbb0869a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:17.595825 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33546e7f-9957-4a0d-b186-6ccbb0869a1e admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:17.599881 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f711c7-1ea6-4146-a763-f9a72cb72fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:17.606115 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f711c7-1ea6-4146-a763-f9a72cb72fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:17.606115 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f711c7-1ea6-4146-a763-f9a72cb72fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:17.606115 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f711c7-1ea6-4146-a763-f9a72cb72fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:17.615652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f711c7-1ea6-4146-a763-f9a72cb72fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:17.617261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f711c7-1ea6-4146-a763-f9a72cb72fc7 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:17.630226 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1137/2318] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:18.281180 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd513052-9f45-451b-8d0f-3d133175cfb6 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:18.283178 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-dd513052-9f45-451b-8d0f-3d133175cfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:18.297359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd513052-9f45-451b-8d0f-3d133175cfb6 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:18.303007 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2f088-a674-486d-bbd5-b93fa626f300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:18.303961 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2f088-a674-486d-bbd5-b93fa626f300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:18.304384 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2f088-a674-486d-bbd5-b93fa626f300 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:18.304834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2f088-a674-486d-bbd5-b93fa626f300 admin admin] PATH_INFO: `/v3/projects/7ef3343dc6334838a98aa7a8b05bd8a9` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:18.306817 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2f088-a674-486d-bbd5-b93fa626f300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ef3343dc6334838a98aa7a8b05bd8a9)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:18.310620 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2f088-a674-486d-bbd5-b93fa626f300 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:18.502005 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-97b2f088-a674-486d-bbd5-b93fa626f300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ef3343dc6334838a98aa7a8b05bd8a9', 'request_id': 'req-97b2f088-a674-486d-bbd5-b93fa626f300'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:18.509368 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-97b2f088-a674-486d-bbd5-b93fa626f300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ef3343dc6334838a98aa7a8b05bd8a9', 'request_id': 'req-97b2f088-a674-486d-bbd5-b93fa626f300'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:18.516460 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-97b2f088-a674-486d-bbd5-b93fa626f300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ef3343dc6334838a98aa7a8b05bd8a9', 'request_id': 'req-97b2f088-a674-486d-bbd5-b93fa626f300'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:18.520802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:18.618328 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b800e1-4d35-4aab-9f22-3eccfb08075b None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:18.618960 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b800e1-4d35-4aab-9f22-3eccfb08075b None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:18.619144 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b800e1-4d35-4aab-9f22-3eccfb08075b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:18.642599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-e6b800e1-4d35-4aab-9f22-3eccfb08075b None None] MFA Rules not processed for user `f99376abecf24499b39dacbc7926e8c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:18.643844 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e6b800e1-4d35-4aab-9f22-3eccfb08075b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:18.668037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:18.714561 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-97b2f088-a674-486d-bbd5-b93fa626f300 admin admin] The token cache is being invalidate because project 7ef3343dc6334838a98aa7a8b05bd8a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:27:18.714850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1138/2319] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:27:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:27:18.718145 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-97b2f088-a674-486d-bbd5-b93fa626f300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:18.718145 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-97b2f088-a674-486d-bbd5-b93fa626f300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:18.718496 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1182/2320] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:27:18 2022] DELETE /identity/v3/projects/7ef3343dc6334838a98aa7a8b05bd8a9 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:18.722788 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b800e1-4d35-4aab-9f22-3eccfb08075b None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:18.812990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b800e1-4d35-4aab-9f22-3eccfb08075b None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:18.818837 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d28f6b-e634-473c-a48a-6c678b7340be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:18.819534 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d28f6b-e634-473c-a48a-6c678b7340be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:18.819875 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d28f6b-e634-473c-a48a-6c678b7340be admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:18.820138 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d28f6b-e634-473c-a48a-6c678b7340be admin admin] PATH_INFO: `/v3/users/2404cfb5e17e471082e503af8fc9dbfa` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:18.821357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d28f6b-e634-473c-a48a-6c678b7340be admin admin] RBAC: Authorizing `identity:delete_user(user_id=2404cfb5e17e471082e503af8fc9dbfa)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:18.824437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d28f6b-e634-473c-a48a-6c678b7340be admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:19.180223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-78d28f6b-e634-473c-a48a-6c678b7340be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2404cfb5e17e471082e503af8fc9dbfa'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:19.181022 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-78d28f6b-e634-473c-a48a-6c678b7340be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2404cfb5e17e471082e503af8fc9dbfa'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:19.200105 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-78d28f6b-e634-473c-a48a-6c678b7340be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2404cfb5e17e471082e503af8fc9dbfa'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:19.214386 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-78d28f6b-e634-473c-a48a-6c678b7340be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2404cfb5e17e471082e503af8fc9dbfa'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:19.215156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-78d28f6b-e634-473c-a48a-6c678b7340be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2404cfb5e17e471082e503af8fc9dbfa'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:19.348780 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1139/2321] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:27:18 2022] DELETE /identity/v3/users/2404cfb5e17e471082e503af8fc9dbfa => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:20.050244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2f088-a674-486d-bbd5-b93fa626f300 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:20.051855 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-97b2f088-a674-486d-bbd5-b93fa626f300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:20.068924 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2f088-a674-486d-bbd5-b93fa626f300 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:20.152173 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d508fd-5653-4970-af41-1e6520e2d9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:20.152651 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d508fd-5653-4970-af41-1e6520e2d9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:20.152948 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d508fd-5653-4970-af41-1e6520e2d9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:20.153203 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d508fd-5653-4970-af41-1e6520e2d9ed admin admin] PATH_INFO: `/v3/projects/164de5ea773e419ab87e1c5a5575576b` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:20.155368 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d508fd-5653-4970-af41-1e6520e2d9ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=164de5ea773e419ab87e1c5a5575576b)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:20.157303 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d508fd-5653-4970-af41-1e6520e2d9ed admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:20.333009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-13d508fd-5653-4970-af41-1e6520e2d9ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '164de5ea773e419ab87e1c5a5575576b', 'request_id': 'req-13d508fd-5653-4970-af41-1e6520e2d9ed'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:20.340076 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-13d508fd-5653-4970-af41-1e6520e2d9ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '164de5ea773e419ab87e1c5a5575576b', 'request_id': 'req-13d508fd-5653-4970-af41-1e6520e2d9ed'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:20.347034 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-13d508fd-5653-4970-af41-1e6520e2d9ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '164de5ea773e419ab87e1c5a5575576b', 'request_id': 'req-13d508fd-5653-4970-af41-1e6520e2d9ed'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:20.483209 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-13d508fd-5653-4970-af41-1e6520e2d9ed admin admin] The token cache is being invalidate because project 164de5ea773e419ab87e1c5a5575576b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:27:20.483506 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-13d508fd-5653-4970-af41-1e6520e2d9ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:20.484168 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-13d508fd-5653-4970-af41-1e6520e2d9ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:20.486536 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1183/2322] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:27:20 2022] DELETE /identity/v3/projects/164de5ea773e419ab87e1c5a5575576b => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:20.490811 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d28f6b-e634-473c-a48a-6c678b7340be admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:20.492638 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-78d28f6b-e634-473c-a48a-6c678b7340be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:20.509750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d28f6b-e634-473c-a48a-6c678b7340be admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:20.574573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff0369-6549-4a96-b8dc-3f2455540f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:20.575548 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff0369-6549-4a96-b8dc-3f2455540f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:20.575887 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff0369-6549-4a96-b8dc-3f2455540f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:20.576224 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff0369-6549-4a96-b8dc-3f2455540f55 admin admin] PATH_INFO: `/v3/users/b7d111b91624437b8c8615535dc370c6` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:20.577789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff0369-6549-4a96-b8dc-3f2455540f55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d111b91624437b8c8615535dc370c6)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:20.580815 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff0369-6549-4a96-b8dc-3f2455540f55 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:20.878982 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d4ff0369-6549-4a96-b8dc-3f2455540f55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d111b91624437b8c8615535dc370c6'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:20.880690 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d4ff0369-6549-4a96-b8dc-3f2455540f55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d111b91624437b8c8615535dc370c6'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:20.893039 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d4ff0369-6549-4a96-b8dc-3f2455540f55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d111b91624437b8c8615535dc370c6'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:20.910796 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d4ff0369-6549-4a96-b8dc-3f2455540f55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d111b91624437b8c8615535dc370c6'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:20.911455 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d4ff0369-6549-4a96-b8dc-3f2455540f55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d111b91624437b8c8615535dc370c6'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:21.039498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1140/2323] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:27:20 2022] DELETE /identity/v3/users/b7d111b91624437b8c8615535dc370c6 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:21.170898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:21.282644 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:21.660573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d508fd-5653-4970-af41-1e6520e2d9ed admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:21.662400 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-13d508fd-5653-4970-af41-1e6520e2d9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:21.680039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d508fd-5653-4970-af41-1e6520e2d9ed admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:21.784833 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16da85-111e-433e-a21c-3cda683225ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:21.785987 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16da85-111e-433e-a21c-3cda683225ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:21.786529 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16da85-111e-433e-a21c-3cda683225ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:21.787118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16da85-111e-433e-a21c-3cda683225ed admin admin] PATH_INFO: `/v3/projects/ab562408a07641ef91e03aa4669b5825` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:21.789027 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16da85-111e-433e-a21c-3cda683225ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab562408a07641ef91e03aa4669b5825)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:21.792611 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16da85-111e-433e-a21c-3cda683225ed admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:22.000140 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9a16da85-111e-433e-a21c-3cda683225ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab562408a07641ef91e03aa4669b5825', 'request_id': 'req-9a16da85-111e-433e-a21c-3cda683225ed'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:22.010854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9a16da85-111e-433e-a21c-3cda683225ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab562408a07641ef91e03aa4669b5825', 'request_id': 'req-9a16da85-111e-433e-a21c-3cda683225ed'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:22.027005 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9a16da85-111e-433e-a21c-3cda683225ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab562408a07641ef91e03aa4669b5825', 'request_id': 'req-9a16da85-111e-433e-a21c-3cda683225ed'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:22.155074 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9a16da85-111e-433e-a21c-3cda683225ed admin admin] The token cache is being invalidate because project ab562408a07641ef91e03aa4669b5825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:27:22.155454 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9a16da85-111e-433e-a21c-3cda683225ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:22.156370 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9a16da85-111e-433e-a21c-3cda683225ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:27:22.162110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1184/2324] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:27:21 2022] DELETE /identity/v3/projects/ab562408a07641ef91e03aa4669b5825 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:22.163896 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820ee75-4c90-4661-9df8-5c3617f64a15 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:22.165119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820ee75-4c90-4661-9df8-5c3617f64a15 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:22.165119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820ee75-4c90-4661-9df8-5c3617f64a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:22.194601 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-a820ee75-4c90-4661-9df8-5c3617f64a15 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:22.198974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-a820ee75-4c90-4661-9df8-5c3617f64a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:22.321671 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1141/2325] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:22.321785 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee223f4-eaab-40f6-95b5-3e3a0e989ee2 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:22.321785 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee223f4-eaab-40f6-95b5-3e3a0e989ee2 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:22.321785 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee223f4-eaab-40f6-95b5-3e3a0e989ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:22.343515 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-cee223f4-eaab-40f6-95b5-3e3a0e989ee2 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:22.345605 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-cee223f4-eaab-40f6-95b5-3e3a0e989ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:22.364208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1185/2326] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:22.402624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820ee75-4c90-4661-9df8-5c3617f64a15 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:22.414822 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820ee75-4c90-4661-9df8-5c3617f64a15 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:22.420578 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3860b3-9372-4268-bbfb-b290efbdc5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:22.421196 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3860b3-9372-4268-bbfb-b290efbdc5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:22.421477 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3860b3-9372-4268-bbfb-b290efbdc5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:22.421759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3860b3-9372-4268-bbfb-b290efbdc5d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:22.422456 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3860b3-9372-4268-bbfb-b290efbdc5d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:27:22.422768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3860b3-9372-4268-bbfb-b290efbdc5d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:22.424646 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3860b3-9372-4268-bbfb-b290efbdc5d5 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:22.443269 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1142/2327] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:27:22.448124 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee223f4-eaab-40f6-95b5-3e3a0e989ee2 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:22.459078 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee223f4-eaab-40f6-95b5-3e3a0e989ee2 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:22.464561 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0417ee-3c7a-4f23-9100-d545cee2c901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:22.465326 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0417ee-3c7a-4f23-9100-d545cee2c901 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:22.466942 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0417ee-3c7a-4f23-9100-d545cee2c901 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:22.467343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0417ee-3c7a-4f23-9100-d545cee2c901 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:22.468211 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0417ee-3c7a-4f23-9100-d545cee2c901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:22.470418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0417ee-3c7a-4f23-9100-d545cee2c901 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:22.657113 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1186/2328] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:27:22 2022] POST /identity/v3/projects => generated 369 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:22.661475 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3860b3-9372-4268-bbfb-b290efbdc5d5 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:22.679936 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3860b3-9372-4268-bbfb-b290efbdc5d5 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:22.747980 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e48a0-324d-4940-a39b-2c2adf43b77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:22.748716 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e48a0-324d-4940-a39b-2c2adf43b77a admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:22.749044 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e48a0-324d-4940-a39b-2c2adf43b77a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:22.749331 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e48a0-324d-4940-a39b-2c2adf43b77a admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:22.750179 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e48a0-324d-4940-a39b-2c2adf43b77a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:22.752728 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e48a0-324d-4940-a39b-2c2adf43b77a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:22.831675 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:22.910152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1143/2329] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:27:22 2022] POST /identity/v3/users => generated 285 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:27:22.914470 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0417ee-3c7a-4f23-9100-d545cee2c901 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:22.931403 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0417ee-3c7a-4f23-9100-d545cee2c901 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:22.937437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:22.939198 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f82961-64bc-4411-84b5-e5485cb2d757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:22.940160 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f82961-64bc-4411-84b5-e5485cb2d757 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:22.941588 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f82961-64bc-4411-84b5-e5485cb2d757 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:22.942096 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f82961-64bc-4411-84b5-e5485cb2d757 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:22.943194 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f82961-64bc-4411-84b5-e5485cb2d757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:22.945415 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f82961-64bc-4411-84b5-e5485cb2d757 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:22.960658 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1187/2330] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:27:22.972433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e48a0-324d-4940-a39b-2c2adf43b77a admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:22.990434 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e48a0-324d-4940-a39b-2c2adf43b77a admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:23.005682 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a37dc2-9bc3-40b3-8827-71c04b4b66b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:23.006558 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a37dc2-9bc3-40b3-8827-71c04b4b66b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:23.012355 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a37dc2-9bc3-40b3-8827-71c04b4b66b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:23.013394 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a37dc2-9bc3-40b3-8827-71c04b4b66b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:23.014316 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a37dc2-9bc3-40b3-8827-71c04b4b66b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:23.016090 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a37dc2-9bc3-40b3-8827-71c04b4b66b5 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:23.038320 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1144/2331] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:27:23.041159 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f82961-64bc-4411-84b5-e5485cb2d757 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:23.053717 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f82961-64bc-4411-84b5-e5485cb2d757 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:23.058904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314748cf-1153-4354-9943-ef03fd3819ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:23.059791 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314748cf-1153-4354-9943-ef03fd3819ef admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:23.060135 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314748cf-1153-4354-9943-ef03fd3819ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:23.060420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314748cf-1153-4354-9943-ef03fd3819ef admin admin] PATH_INFO: `/v3/projects/23f3b996cbb5429a95d6d0a00509fd8f/users/c3ed0080d06f48bea759843a5554e305/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:23.080622 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314748cf-1153-4354-9943-ef03fd3819ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f3b996cbb5429a95d6d0a00509fd8f, user_id=c3ed0080d06f48bea759843a5554e305, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:23.083902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314748cf-1153-4354-9943-ef03fd3819ef admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:23.181911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1188/2332] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:27:23 2022] PUT /identity/v3/projects/23f3b996cbb5429a95d6d0a00509fd8f/users/c3ed0080d06f48bea759843a5554e305/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:27:23.198014 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e091e-44a7-4419-bfff-5ae89e326bef None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:23.198635 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e091e-44a7-4419-bfff-5ae89e326bef None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:23.198864 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e091e-44a7-4419-bfff-5ae89e326bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:23.241491 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-9b4e091e-44a7-4419-bfff-5ae89e326bef None None] MFA Rules not processed for user `c3ed0080d06f48bea759843a5554e305`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:27:23.242979 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-9b4e091e-44a7-4419-bfff-5ae89e326bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:23.341124 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1145/2333] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:27:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:27:23.360302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314748cf-1153-4354-9943-ef03fd3819ef admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:23.362230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-314748cf-1153-4354-9943-ef03fd3819ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:23.500731 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314748cf-1153-4354-9943-ef03fd3819ef admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:23.510666 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde6040-6444-4f18-9f0a-0bf3465cfbe8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72840602ec264a74855b601c8d1ddf89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:23.512267 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde6040-6444-4f18-9f0a-0bf3465cfbe8 service glance] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:23.513326 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde6040-6444-4f18-9f0a-0bf3465cfbe8 service glance] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:23.513772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde6040-6444-4f18-9f0a-0bf3465cfbe8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:23.529705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde6040-6444-4f18-9f0a-0bf3465cfbe8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:23.531752 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde6040-6444-4f18-9f0a-0bf3465cfbe8 service glance] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:23.548805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1189/2334] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:23.668664 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:25.337233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:26.565624 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:27.402527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:27.808504 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:28.819587 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:34.462233 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:36.697023 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e091e-44a7-4419-bfff-5ae89e326bef None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:36.698422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-9b4e091e-44a7-4419-bfff-5ae89e326bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:36.761150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e091e-44a7-4419-bfff-5ae89e326bef None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:36.765175 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4095dce-2699-4dfb-be87-ce8f44c936b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:36.765771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4095dce-2699-4dfb-be87-ce8f44c936b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:36.766078 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4095dce-2699-4dfb-be87-ce8f44c936b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:36.766355 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4095dce-2699-4dfb-be87-ce8f44c936b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:36.768283 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d4095dce-2699-4dfb-be87-ce8f44c936b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:36.848956 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4095dce-2699-4dfb-be87-ce8f44c936b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:36.850425 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4095dce-2699-4dfb-be87-ce8f44c936b3 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:36.862493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1146/2335] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:39.353844 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:DELETE=2,keystone:SELECT=56,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:40.467690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde6040-6444-4f18-9f0a-0bf3465cfbe8 service glance] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:27:40.483978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde6040-6444-4f18-9f0a-0bf3465cfbe8 service glance] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:27:40.489592 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996ae06-566c-4393-a6e5-6a4f639b8458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:27:40.490246 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996ae06-566c-4393-a6e5-6a4f639b8458 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:27:40.490553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996ae06-566c-4393-a6e5-6a4f639b8458 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:27:40.490837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996ae06-566c-4393-a6e5-6a4f639b8458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:27:40.492681 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-e996ae06-566c-4393-a6e5-6a4f639b8458 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:27:40.513181 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996ae06-566c-4393-a6e5-6a4f639b8458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:27:40.514697 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996ae06-566c-4393-a6e5-6a4f639b8458 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:27:40.530142 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1190/2336] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:27:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:27:46.857590 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=54 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:50.523845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=6 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:09.030628 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4095dce-2699-4dfb-be87-ce8f44c936b3 service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:09.032108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d4095dce-2699-4dfb-be87-ce8f44c936b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:09.049058 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4095dce-2699-4dfb-be87-ce8f44c936b3 service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:09.055343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86774207-21ce-405e-b1d9-d5974554a4d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:09.055981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86774207-21ce-405e-b1d9-d5974554a4d8 service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:09.056265 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86774207-21ce-405e-b1d9-d5974554a4d8 service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:09.056548 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86774207-21ce-405e-b1d9-d5974554a4d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:09.058599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-86774207-21ce-405e-b1d9-d5974554a4d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:09.125703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86774207-21ce-405e-b1d9-d5974554a4d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:09.127592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86774207-21ce-405e-b1d9-d5974554a4d8 service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:09.138679 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1147/2337] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:09 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:28:09.967585 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aebe18-4622-43eb-82a2-f69804bd26ea None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:09.968091 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aebe18-4622-43eb-82a2-f69804bd26ea None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:09.986316 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aebe18-4622-43eb-82a2-f69804bd26ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:09.987684 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-e4aebe18-4622-43eb-82a2-f69804bd26ea None None] MFA Rules not processed for user `f45f65dd3a844cb583e42d837d2a58d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:09.988890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-e4aebe18-4622-43eb-82a2-f69804bd26ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:10.049999 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1191/2338] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Sep 2 21:28:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:10.282074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86774207-21ce-405e-b1d9-d5974554a4d8 service nova] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:10.285589 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-86774207-21ce-405e-b1d9-d5974554a4d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:10.366591 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86774207-21ce-405e-b1d9-d5974554a4d8 service nova] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:10.373185 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451461a8-b1f2-413a-a9dc-9b231cef54db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da2b1dc9dae413a8ee63ad67e840f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:10.373770 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451461a8-b1f2-413a-a9dc-9b231cef54db service swift] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:10.374148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451461a8-b1f2-413a-a9dc-9b231cef54db service swift] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:10.376490 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451461a8-b1f2-413a-a9dc-9b231cef54db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:10.383727 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451461a8-b1f2-413a-a9dc-9b231cef54db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:10.385325 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451461a8-b1f2-413a-a9dc-9b231cef54db service swift] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:10.394814 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1148/2339] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Sep 2 21:28:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:28:14.536009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aebe18-4622-43eb-82a2-f69804bd26ea None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:14.683137 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aebe18-4622-43eb-82a2-f69804bd26ea None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:14.714371 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbff44-4e46-4978-950e-a79a2a7e6b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:14.715664 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbff44-4e46-4978-950e-a79a2a7e6b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:14.716139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbff44-4e46-4978-950e-a79a2a7e6b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:14.716292 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbff44-4e46-4978-950e-a79a2a7e6b89 admin admin] PATH_INFO: `/v3/users/c3ed0080d06f48bea759843a5554e305` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:14.718605 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbff44-4e46-4978-950e-a79a2a7e6b89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3ed0080d06f48bea759843a5554e305)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:14.736182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbff44-4e46-4978-950e-a79a2a7e6b89 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:15.203535 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-86cbff44-4e46-4978-950e-a79a2a7e6b89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3ed0080d06f48bea759843a5554e305'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:15.204987 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-86cbff44-4e46-4978-950e-a79a2a7e6b89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3ed0080d06f48bea759843a5554e305'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:15.236031 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-86cbff44-4e46-4978-950e-a79a2a7e6b89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3ed0080d06f48bea759843a5554e305'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:15.256529 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-86cbff44-4e46-4978-950e-a79a2a7e6b89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3ed0080d06f48bea759843a5554e305'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:15.258517 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-86cbff44-4e46-4978-950e-a79a2a7e6b89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3ed0080d06f48bea759843a5554e305'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:15.488821 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1192/2340] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:28:14 2022] DELETE /identity/v3/users/c3ed0080d06f48bea759843a5554e305 => generated 0 bytes in 954 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:28:15.493572 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c834a-e741-47f8-ade1-8b5b5fe033da None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:15.494667 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c834a-e741-47f8-ade1-8b5b5fe033da None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:15.495226 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c834a-e741-47f8-ade1-8b5b5fe033da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:15.520054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-938c834a-e741-47f8-ade1-8b5b5fe033da None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:15.521289 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-938c834a-e741-47f8-ade1-8b5b5fe033da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:15.613254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1149/2341] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:15.624311 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbff44-4e46-4978-950e-a79a2a7e6b89 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:15.626592 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-86cbff44-4e46-4978-950e-a79a2a7e6b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:15.659745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:15.696563 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbff44-4e46-4978-950e-a79a2a7e6b89 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:15.702132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55106a-1e40-487f-80ce-5ebaa75d9046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:15.703042 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55106a-1e40-487f-80ce-5ebaa75d9046 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:15.703433 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55106a-1e40-487f-80ce-5ebaa75d9046 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:15.703900 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55106a-1e40-487f-80ce-5ebaa75d9046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:15.717664 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55106a-1e40-487f-80ce-5ebaa75d9046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:15.719149 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55106a-1e40-487f-80ce-5ebaa75d9046 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:15.729778 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1193/2342] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:28:16.490639 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c834a-e741-47f8-ade1-8b5b5fe033da None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:16.492560 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-938c834a-e741-47f8-ade1-8b5b5fe033da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:16.510728 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c834a-e741-47f8-ade1-8b5b5fe033da None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:16.521314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8832db2-8edf-48d1-a446-411a2cb2288a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:16.523451 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8832db2-8edf-48d1-a446-411a2cb2288a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:16.524440 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8832db2-8edf-48d1-a446-411a2cb2288a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:16.525204 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8832db2-8edf-48d1-a446-411a2cb2288a admin admin] PATH_INFO: `/v3/projects/23f3b996cbb5429a95d6d0a00509fd8f` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:16.528421 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8832db2-8edf-48d1-a446-411a2cb2288a admin admin] RBAC: Authorizing `identity:delete_project(project_id=23f3b996cbb5429a95d6d0a00509fd8f)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:16.531766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8832db2-8edf-48d1-a446-411a2cb2288a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:16.585896 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:16.732776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f8832db2-8edf-48d1-a446-411a2cb2288a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23f3b996cbb5429a95d6d0a00509fd8f', 'request_id': 'req-f8832db2-8edf-48d1-a446-411a2cb2288a'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:16.743182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f8832db2-8edf-48d1-a446-411a2cb2288a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23f3b996cbb5429a95d6d0a00509fd8f', 'request_id': 'req-f8832db2-8edf-48d1-a446-411a2cb2288a'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:16.751428 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f8832db2-8edf-48d1-a446-411a2cb2288a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23f3b996cbb5429a95d6d0a00509fd8f', 'request_id': 'req-f8832db2-8edf-48d1-a446-411a2cb2288a'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:16.841230 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f8832db2-8edf-48d1-a446-411a2cb2288a admin admin] The token cache is being invalidate because project 23f3b996cbb5429a95d6d0a00509fd8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:28:16.841641 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f8832db2-8edf-48d1-a446-411a2cb2288a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:16.842632 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f8832db2-8edf-48d1-a446-411a2cb2288a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:16.844834 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1150/2343] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:28:16 2022] DELETE /identity/v3/projects/23f3b996cbb5429a95d6d0a00509fd8f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:28:16.850763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dd2b0-b841-4f2a-8825-758f7c3515b0 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:16.851466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dd2b0-b841-4f2a-8825-758f7c3515b0 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:16.851633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dd2b0-b841-4f2a-8825-758f7c3515b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:16.883052 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-ad5dd2b0-b841-4f2a-8825-758f7c3515b0 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:16.884375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ad5dd2b0-b841-4f2a-8825-758f7c3515b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:16.981501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1194/2344] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:28:17.001159 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8678fd-839d-4344-ab80-74b3ac979619 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:17.001455 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8678fd-839d-4344-ab80-74b3ac979619 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:17.001733 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8678fd-839d-4344-ab80-74b3ac979619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:17.029772 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-2a8678fd-839d-4344-ab80-74b3ac979619 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:17.031572 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-2a8678fd-839d-4344-ab80-74b3ac979619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:17.048170 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dd2b0-b841-4f2a-8825-758f7c3515b0 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:17.053497 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1151/2345] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:28:17.064770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dd2b0-b841-4f2a-8825-758f7c3515b0 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:17.077506 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d131c-a274-4cea-9438-5029e504db27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:17.078477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d131c-a274-4cea-9438-5029e504db27 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:17.078928 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d131c-a274-4cea-9438-5029e504db27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:17.079308 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d131c-a274-4cea-9438-5029e504db27 admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:17.080367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d131c-a274-4cea-9438-5029e504db27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:28:17.080784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d131c-a274-4cea-9438-5029e504db27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:17.082638 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d131c-a274-4cea-9438-5029e504db27 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:17.135560 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1195/2346] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:28:17.140812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8678fd-839d-4344-ab80-74b3ac979619 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:17.154425 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8678fd-839d-4344-ab80-74b3ac979619 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:17.176307 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc78c11-6479-4eaf-9490-41a49e991cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:17.178618 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc78c11-6479-4eaf-9490-41a49e991cfe admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:17.179238 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc78c11-6479-4eaf-9490-41a49e991cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:17.180241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc78c11-6479-4eaf-9490-41a49e991cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:17.181792 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc78c11-6479-4eaf-9490-41a49e991cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:17.187183 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc78c11-6479-4eaf-9490-41a49e991cfe admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:17.363561 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1152/2347] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:28:17 2022] POST /identity/v3/projects => generated 363 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:28:17.369030 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d131c-a274-4cea-9438-5029e504db27 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:17.385147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d131c-a274-4cea-9438-5029e504db27 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:17.518931 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9ef17-a7bb-4836-baee-ac31fa52cf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:17.520172 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9ef17-a7bb-4836-baee-ac31fa52cf20 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:17.520899 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9ef17-a7bb-4836-baee-ac31fa52cf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:17.521841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9ef17-a7bb-4836-baee-ac31fa52cf20 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:17.523385 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9ef17-a7bb-4836-baee-ac31fa52cf20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:17.529561 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9ef17-a7bb-4836-baee-ac31fa52cf20 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:17.630325 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1196/2348] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:28:17 2022] POST /identity/v3/users => generated 282 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:28:17.638561 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc78c11-6479-4eaf-9490-41a49e991cfe admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:17.652849 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc78c11-6479-4eaf-9490-41a49e991cfe admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:17.659917 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c907ddd-7e7b-425e-9819-7df37b42cbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:17.660824 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c907ddd-7e7b-425e-9819-7df37b42cbe0 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:17.661329 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c907ddd-7e7b-425e-9819-7df37b42cbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:17.661778 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c907ddd-7e7b-425e-9819-7df37b42cbe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:17.662659 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c907ddd-7e7b-425e-9819-7df37b42cbe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:17.664461 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c907ddd-7e7b-425e-9819-7df37b42cbe0 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:17.700284 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1153/2349] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:28:17.708526 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9ef17-a7bb-4836-baee-ac31fa52cf20 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:17.732300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9ef17-a7bb-4836-baee-ac31fa52cf20 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:17.753238 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab570b-936f-4b05-a8c4-36a669c4da97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:17.754345 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab570b-936f-4b05-a8c4-36a669c4da97 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:17.754801 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab570b-936f-4b05-a8c4-36a669c4da97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:17.755178 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab570b-936f-4b05-a8c4-36a669c4da97 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:17.756009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab570b-936f-4b05-a8c4-36a669c4da97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:17.759615 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab570b-936f-4b05-a8c4-36a669c4da97 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:17.794083 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1197/2350] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:28:17.800608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c907ddd-7e7b-425e-9819-7df37b42cbe0 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:17.831581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c907ddd-7e7b-425e-9819-7df37b42cbe0 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:17.840398 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049c3fc-cc4c-4524-b2fc-03d08f2f8c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:17.841690 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049c3fc-cc4c-4524-b2fc-03d08f2f8c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:17.842250 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049c3fc-cc4c-4524-b2fc-03d08f2f8c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:17.842693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049c3fc-cc4c-4524-b2fc-03d08f2f8c16 admin admin] PATH_INFO: `/v3/projects/3ce395c1bc344003bd703af8a22fb812/users/4ba22a32b85f4f7384165115acbb276e/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:17.879182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049c3fc-cc4c-4524-b2fc-03d08f2f8c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce395c1bc344003bd703af8a22fb812, user_id=4ba22a32b85f4f7384165115acbb276e, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:17.888213 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049c3fc-cc4c-4524-b2fc-03d08f2f8c16 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:18.011642 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1154/2351] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:28:17 2022] PUT /identity/v3/projects/3ce395c1bc344003bd703af8a22fb812/users/4ba22a32b85f4f7384165115acbb276e/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:18.110077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97937b-7c1a-4ada-aed4-82fa7c854fcd None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:18.111039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97937b-7c1a-4ada-aed4-82fa7c854fcd None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:18.111934 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97937b-7c1a-4ada-aed4-82fa7c854fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:18.202451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-ac97937b-7c1a-4ada-aed4-82fa7c854fcd None None] MFA Rules not processed for user `4ba22a32b85f4f7384165115acbb276e`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:18.203749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ac97937b-7c1a-4ada-aed4-82fa7c854fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:18.295518 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:18.405610 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1198/2352] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:28:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:18.424995 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049c3fc-cc4c-4524-b2fc-03d08f2f8c16 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:18.428027 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-0049c3fc-cc4c-4524-b2fc-03d08f2f8c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:18.553688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049c3fc-cc4c-4524-b2fc-03d08f2f8c16 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:18.559301 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb63a7-e44f-4428-8f3e-a256f5e17cc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:18.560161 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb63a7-e44f-4428-8f3e-a256f5e17cc3 service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:18.560682 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb63a7-e44f-4428-8f3e-a256f5e17cc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:18.561159 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb63a7-e44f-4428-8f3e-a256f5e17cc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:18.581547 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb63a7-e44f-4428-8f3e-a256f5e17cc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:18.584383 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb63a7-e44f-4428-8f3e-a256f5e17cc3 service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:18.605232 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1155/2353] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:28:27.618667 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97937b-7c1a-4ada-aed4-82fa7c854fcd None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:27.621766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ac97937b-7c1a-4ada-aed4-82fa7c854fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:27.818085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97937b-7c1a-4ada-aed4-82fa7c854fcd None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:27.824274 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7932c5-4ee3-4b33-9f17-6f884b471c01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:27.825257 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7932c5-4ee3-4b33-9f17-6f884b471c01 service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:27.825494 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7932c5-4ee3-4b33-9f17-6f884b471c01 service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:27.825702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7932c5-4ee3-4b33-9f17-6f884b471c01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:27.827828 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-3c7932c5-4ee3-4b33-9f17-6f884b471c01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:27.967694 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7932c5-4ee3-4b33-9f17-6f884b471c01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:27.976466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7932c5-4ee3-4b33-9f17-6f884b471c01 service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:27.995141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1199/2354] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:28:28.601067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=68,keystone:DELETE=6,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:30.021884 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb63a7-e44f-4428-8f3e-a256f5e17cc3 service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:30.024822 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-06cb63a7-e44f-4428-8f3e-a256f5e17cc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:30.191226 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb63a7-e44f-4428-8f3e-a256f5e17cc3 service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:30.195785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dbd75-34a1-45a4-99c6-9ab65bb32738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:30.197355 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dbd75-34a1-45a4-99c6-9ab65bb32738 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:30.197355 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dbd75-34a1-45a4-99c6-9ab65bb32738 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:30.197355 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dbd75-34a1-45a4-99c6-9ab65bb32738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:30.199510 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-027dbd75-34a1-45a4-99c6-9ab65bb32738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:30.216203 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027dbd75-34a1-45a4-99c6-9ab65bb32738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:30.218973 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027dbd75-34a1-45a4-99c6-9ab65bb32738 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:30.235169 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1156/2355] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:28:32.873987 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9000ab4-b653-42e5-98db-17206ef66b9e None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:32.874602 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9000ab4-b653-42e5-98db-17206ef66b9e None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:32.874602 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9000ab4-b653-42e5-98db-17206ef66b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:32.905056 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-c9000ab4-b653-42e5-98db-17206ef66b9e None None] MFA Rules not processed for user `f45f65dd3a844cb583e42d837d2a58d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:32.906703 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-c9000ab4-b653-42e5-98db-17206ef66b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:33.002026 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1200/2356] 10.222.0.79 () {58 vars in 967 bytes} [Fri Sep 2 21:28:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:28:33.022704 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dbd75-34a1-45a4-99c6-9ab65bb32738 service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:33.024828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-027dbd75-34a1-45a4-99c6-9ab65bb32738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:33.147125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dbd75-34a1-45a4-99c6-9ab65bb32738 service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:33.153892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee11532-d3fe-4d66-862e-751ea4463af5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da2b1dc9dae413a8ee63ad67e840f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:33.154521 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee11532-d3fe-4d66-862e-751ea4463af5 service swift] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:33.154799 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee11532-d3fe-4d66-862e-751ea4463af5 service swift] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:33.155141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee11532-d3fe-4d66-862e-751ea4463af5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:33.166232 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee11532-d3fe-4d66-862e-751ea4463af5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:33.169332 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee11532-d3fe-4d66-862e-751ea4463af5 service swift] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:33.179508 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1157/2357] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Sep 2 21:28:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:28:37.263092 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9000ab4-b653-42e5-98db-17206ef66b9e None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:37.264654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-c9000ab4-b653-42e5-98db-17206ef66b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:37.277707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:37.283430 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9000ab4-b653-42e5-98db-17206ef66b9e None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:37.293530 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60809ba8-7139-4d35-9a04-263baebc1a1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:37.294760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60809ba8-7139-4d35-9a04-263baebc1a1a service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:37.295224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60809ba8-7139-4d35-9a04-263baebc1a1a service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:37.295713 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60809ba8-7139-4d35-9a04-263baebc1a1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:37.300378 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-60809ba8-7139-4d35-9a04-263baebc1a1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:37.339800 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60809ba8-7139-4d35-9a04-263baebc1a1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:37.341730 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60809ba8-7139-4d35-9a04-263baebc1a1a service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:37.375510 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1201/2358] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:28:37.831905 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee11532-d3fe-4d66-862e-751ea4463af5 service swift] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:37.851034 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee11532-d3fe-4d66-862e-751ea4463af5 service swift] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:37.858234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf63131-19b5-4912-9cc8-8399df8dace5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:37.859135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf63131-19b5-4912-9cc8-8399df8dace5 service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:37.859609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf63131-19b5-4912-9cc8-8399df8dace5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:37.860079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf63131-19b5-4912-9cc8-8399df8dace5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:37.863365 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-bdf63131-19b5-4912-9cc8-8399df8dace5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:38.032697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf63131-19b5-4912-9cc8-8399df8dace5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:38.035540 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf63131-19b5-4912-9cc8-8399df8dace5 service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:38.047123 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1158/2359] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:28:38.913703 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67984a-fef8-4a04-8a68-c6bba7e37605 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:38.914295 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67984a-fef8-4a04-8a68-c6bba7e37605 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:38.915589 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67984a-fef8-4a04-8a68-c6bba7e37605 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:38.919191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1202/2360] 10.222.0.79 () {54 vars in 961 bytes} [Fri Sep 2 21:28:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:28:38.928323 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7571c-0f4a-4fb1-8d99-25d737edbfbb None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:38.929154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7571c-0f4a-4fb1-8d99-25d737edbfbb None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:38.929154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7571c-0f4a-4fb1-8d99-25d737edbfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:38.977477 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-b8f7571c-0f4a-4fb1-8d99-25d737edbfbb None None] MFA Rules not processed for user `aa0f9604ee2e43b4967cbdc779e63e71`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:38.980179 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-b8f7571c-0f4a-4fb1-8d99-25d737edbfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:39.076798 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:39.140919 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1159/2361] 10.222.0.79 () {58 vars in 1058 bytes} [Fri Sep 2 21:28:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:39.152845 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67984a-fef8-4a04-8a68-c6bba7e37605 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:39.171047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67984a-fef8-4a04-8a68-c6bba7e37605 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:39.178078 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc141565-647a-4206-b0df-b4f1452e333c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0f9604ee2e43b4967cbdc779e63e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:39.179152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc141565-647a-4206-b0df-b4f1452e333c service placement] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:39.179633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc141565-647a-4206-b0df-b4f1452e333c service placement] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:39.180650 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc141565-647a-4206-b0df-b4f1452e333c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:39.186614 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-cc141565-647a-4206-b0df-b4f1452e333c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:39.217969 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc141565-647a-4206-b0df-b4f1452e333c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:39.219644 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc141565-647a-4206-b0df-b4f1452e333c service placement] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:39.238025 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7571c-0f4a-4fb1-8d99-25d737edbfbb None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:39.238281 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-b8f7571c-0f4a-4fb1-8d99-25d737edbfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:39.253766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1203/2362] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:28:39.392842 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7571c-0f4a-4fb1-8d99-25d737edbfbb None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:39.399462 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda58d1d-3bd1-4d82-a1c1-13f1a092ae73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:39.400190 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda58d1d-3bd1-4d82-a1c1-13f1a092ae73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:39.401599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda58d1d-3bd1-4d82-a1c1-13f1a092ae73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:39.401912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda58d1d-3bd1-4d82-a1c1-13f1a092ae73 admin admin] PATH_INFO: `/v3/users/f99376abecf24499b39dacbc7926e8c0` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:39.403664 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda58d1d-3bd1-4d82-a1c1-13f1a092ae73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f99376abecf24499b39dacbc7926e8c0)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:39.406293 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda58d1d-3bd1-4d82-a1c1-13f1a092ae73 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:39.672516 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-bda58d1d-3bd1-4d82-a1c1-13f1a092ae73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f99376abecf24499b39dacbc7926e8c0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:39.673217 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-bda58d1d-3bd1-4d82-a1c1-13f1a092ae73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f99376abecf24499b39dacbc7926e8c0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:39.681100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-bda58d1d-3bd1-4d82-a1c1-13f1a092ae73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f99376abecf24499b39dacbc7926e8c0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:39.695283 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-bda58d1d-3bd1-4d82-a1c1-13f1a092ae73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f99376abecf24499b39dacbc7926e8c0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:39.696055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-bda58d1d-3bd1-4d82-a1c1-13f1a092ae73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f99376abecf24499b39dacbc7926e8c0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:39.817323 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1160/2363] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:28:39 2022] DELETE /identity/v3/users/f99376abecf24499b39dacbc7926e8c0 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:40.156910 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc141565-647a-4206-b0df-b4f1452e333c service placement] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:40.195759 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc141565-647a-4206-b0df-b4f1452e333c service placement] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:40.274666 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360662a-6d0d-4e26-b3f0-2bc0e1478f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:40.277616 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360662a-6d0d-4e26-b3f0-2bc0e1478f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:40.278024 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360662a-6d0d-4e26-b3f0-2bc0e1478f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:40.278457 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360662a-6d0d-4e26-b3f0-2bc0e1478f77 admin admin] PATH_INFO: `/v3/projects/00fbc2e7b83e496c9db6e8b0601ec81d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:40.279753 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360662a-6d0d-4e26-b3f0-2bc0e1478f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00fbc2e7b83e496c9db6e8b0601ec81d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:40.282049 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360662a-6d0d-4e26-b3f0-2bc0e1478f77 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:40.425118 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0360662a-6d0d-4e26-b3f0-2bc0e1478f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00fbc2e7b83e496c9db6e8b0601ec81d', 'request_id': 'req-0360662a-6d0d-4e26-b3f0-2bc0e1478f77'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:40.433042 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0360662a-6d0d-4e26-b3f0-2bc0e1478f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00fbc2e7b83e496c9db6e8b0601ec81d', 'request_id': 'req-0360662a-6d0d-4e26-b3f0-2bc0e1478f77'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:40.439450 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0360662a-6d0d-4e26-b3f0-2bc0e1478f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00fbc2e7b83e496c9db6e8b0601ec81d', 'request_id': 'req-0360662a-6d0d-4e26-b3f0-2bc0e1478f77'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:40.515910 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0360662a-6d0d-4e26-b3f0-2bc0e1478f77 admin admin] The token cache is being invalidate because project 00fbc2e7b83e496c9db6e8b0601ec81d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:28:40.516382 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0360662a-6d0d-4e26-b3f0-2bc0e1478f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:40.517195 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0360662a-6d0d-4e26-b3f0-2bc0e1478f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:40.524343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1204/2364] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:28:40 2022] DELETE /identity/v3/projects/00fbc2e7b83e496c9db6e8b0601ec81d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:40.527461 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b3927-b607-44c2-a5ce-e0267f8c5a0b None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:40.527965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b3927-b607-44c2-a5ce-e0267f8c5a0b None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:40.528151 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b3927-b607-44c2-a5ce-e0267f8c5a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:40.552981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-d17b3927-b607-44c2-a5ce-e0267f8c5a0b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:40.554016 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d17b3927-b607-44c2-a5ce-e0267f8c5a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:40.613496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:40.633607 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1161/2365] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:40.706172 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2415b-c777-4df0-a0c4-fe07319cb5c1 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:40.706707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2415b-c777-4df0-a0c4-fe07319cb5c1 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:40.707173 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2415b-c777-4df0-a0c4-fe07319cb5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:40.732419 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-cbd2415b-c777-4df0-a0c4-fe07319cb5c1 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:40.748833 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-cbd2415b-c777-4df0-a0c4-fe07319cb5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:40.748833 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1205/2366] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:40.752197 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b3927-b607-44c2-a5ce-e0267f8c5a0b None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:40.764348 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b3927-b607-44c2-a5ce-e0267f8c5a0b None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:40.769340 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9954bfc-d34f-4a6c-a2a5-e8aa5d1bd254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:40.770014 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9954bfc-d34f-4a6c-a2a5-e8aa5d1bd254 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:40.770451 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9954bfc-d34f-4a6c-a2a5-e8aa5d1bd254 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:40.770566 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9954bfc-d34f-4a6c-a2a5-e8aa5d1bd254 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:40.771237 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9954bfc-d34f-4a6c-a2a5-e8aa5d1bd254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:28:40.771556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9954bfc-d34f-4a6c-a2a5-e8aa5d1bd254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:40.773226 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9954bfc-d34f-4a6c-a2a5-e8aa5d1bd254 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:40.787038 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1162/2367] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:28:40.792177 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2415b-c777-4df0-a0c4-fe07319cb5c1 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:40.808443 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2415b-c777-4df0-a0c4-fe07319cb5c1 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:40.809128 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169141a-07f3-4a36-94b7-b93774d0151e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:40.809756 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169141a-07f3-4a36-94b7-b93774d0151e admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:40.810073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169141a-07f3-4a36-94b7-b93774d0151e admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:40.810347 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169141a-07f3-4a36-94b7-b93774d0151e admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:40.811047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169141a-07f3-4a36-94b7-b93774d0151e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:40.813047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169141a-07f3-4a36-94b7-b93774d0151e admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:40.907301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1206/2368] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:28:40 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:28:40.911497 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9954bfc-d34f-4a6c-a2a5-e8aa5d1bd254 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:40.922983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9954bfc-d34f-4a6c-a2a5-e8aa5d1bd254 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:40.994653 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81df23d-3dbe-4bd8-bc8a-3b02dd392d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:40.995339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81df23d-3dbe-4bd8-bc8a-3b02dd392d9f admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:40.995620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81df23d-3dbe-4bd8-bc8a-3b02dd392d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:40.995895 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81df23d-3dbe-4bd8-bc8a-3b02dd392d9f admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:40.996581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81df23d-3dbe-4bd8-bc8a-3b02dd392d9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:40.998534 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81df23d-3dbe-4bd8-bc8a-3b02dd392d9f admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:41.134402 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1163/2369] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:28:40 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:28:41.139364 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169141a-07f3-4a36-94b7-b93774d0151e admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:41.150048 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169141a-07f3-4a36-94b7-b93774d0151e admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:41.154753 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fac411-3ceb-467a-ad41-36beb1a96b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:41.155364 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fac411-3ceb-467a-ad41-36beb1a96b27 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:41.155646 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fac411-3ceb-467a-ad41-36beb1a96b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:41.155931 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fac411-3ceb-467a-ad41-36beb1a96b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:41.156579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fac411-3ceb-467a-ad41-36beb1a96b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:41.158277 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fac411-3ceb-467a-ad41-36beb1a96b27 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:41.169103 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1207/2370] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:28:41.179409 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81df23d-3dbe-4bd8-bc8a-3b02dd392d9f admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:41.191068 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81df23d-3dbe-4bd8-bc8a-3b02dd392d9f admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:41.196347 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb0338-18da-4b5c-b990-073023dc9594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:41.197075 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb0338-18da-4b5c-b990-073023dc9594 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:41.197992 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb0338-18da-4b5c-b990-073023dc9594 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:41.198279 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb0338-18da-4b5c-b990-073023dc9594 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:41.198956 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb0338-18da-4b5c-b990-073023dc9594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:41.201212 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb0338-18da-4b5c-b990-073023dc9594 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:41.213772 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1164/2371] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:28:41.218073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fac411-3ceb-467a-ad41-36beb1a96b27 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:41.229666 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fac411-3ceb-467a-ad41-36beb1a96b27 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:41.234260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6520eb-ad0d-43a0-9a89-41310255834a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:41.234968 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6520eb-ad0d-43a0-9a89-41310255834a admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:41.235247 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6520eb-ad0d-43a0-9a89-41310255834a admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:41.235537 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6520eb-ad0d-43a0-9a89-41310255834a admin admin] PATH_INFO: `/v3/projects/184566a121dd41218042897eeff2b216/users/1083cf32e76243ce9a88100374812ab7/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:41.251171 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6520eb-ad0d-43a0-9a89-41310255834a admin admin] RBAC: Authorizing `identity:create_grant(project_id=184566a121dd41218042897eeff2b216, user_id=1083cf32e76243ce9a88100374812ab7, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:41.253905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6520eb-ad0d-43a0-9a89-41310255834a admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:41.342387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1208/2372] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:28:41 2022] PUT /identity/v3/projects/184566a121dd41218042897eeff2b216/users/1083cf32e76243ce9a88100374812ab7/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:41.349404 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d84227-7302-4ee3-aac9-649c3e02f106 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:41.349692 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d84227-7302-4ee3-aac9-649c3e02f106 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:41.350022 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d84227-7302-4ee3-aac9-649c3e02f106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:41.371087 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-22d84227-7302-4ee3-aac9-649c3e02f106 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:41.372320 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-22d84227-7302-4ee3-aac9-649c3e02f106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:41.439049 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1165/2373] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:41.450344 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6520eb-ad0d-43a0-9a89-41310255834a admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:41.452270 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-fa6520eb-ad0d-43a0-9a89-41310255834a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:41.458975 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:41.521120 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6520eb-ad0d-43a0-9a89-41310255834a admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:41.525747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174fdda-70c4-4d6f-a47d-7b3a14ee60dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:41.526410 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174fdda-70c4-4d6f-a47d-7b3a14ee60dd service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:41.526690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174fdda-70c4-4d6f-a47d-7b3a14ee60dd service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:41.526971 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174fdda-70c4-4d6f-a47d-7b3a14ee60dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:41.536917 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174fdda-70c4-4d6f-a47d-7b3a14ee60dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:41.538433 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174fdda-70c4-4d6f-a47d-7b3a14ee60dd service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:41.549108 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1209/2374] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:28:46.625472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d84227-7302-4ee3-aac9-649c3e02f106 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:46.627142 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-22d84227-7302-4ee3-aac9-649c3e02f106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:46.660969 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d84227-7302-4ee3-aac9-649c3e02f106 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:46.678461 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965fcecc-e11e-4157-88c9-d751e803be6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:46.679349 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965fcecc-e11e-4157-88c9-d751e803be6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:46.680466 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965fcecc-e11e-4157-88c9-d751e803be6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:46.681150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965fcecc-e11e-4157-88c9-d751e803be6d admin admin] PATH_INFO: `/v3/users/7431e8c106ba4e2689c0aa1001bbafe7` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:46.685789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965fcecc-e11e-4157-88c9-d751e803be6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7431e8c106ba4e2689c0aa1001bbafe7)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:46.695320 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965fcecc-e11e-4157-88c9-d751e803be6d admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:47.047393 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-965fcecc-e11e-4157-88c9-d751e803be6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7431e8c106ba4e2689c0aa1001bbafe7'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:47.048634 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-965fcecc-e11e-4157-88c9-d751e803be6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7431e8c106ba4e2689c0aa1001bbafe7'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:47.051767 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:47.097959 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-965fcecc-e11e-4157-88c9-d751e803be6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7431e8c106ba4e2689c0aa1001bbafe7'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:47.151852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-965fcecc-e11e-4157-88c9-d751e803be6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7431e8c106ba4e2689c0aa1001bbafe7'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:47.153792 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-965fcecc-e11e-4157-88c9-d751e803be6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7431e8c106ba4e2689c0aa1001bbafe7'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:47.351001 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1166/2375] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:28:46 2022] DELETE /identity/v3/users/7431e8c106ba4e2689c0aa1001bbafe7 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:47.929035 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174fdda-70c4-4d6f-a47d-7b3a14ee60dd service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:47.969023 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174fdda-70c4-4d6f-a47d-7b3a14ee60dd service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:48.138030 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1fab5-e2fd-4174-8296-5c7f281dcbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:48.139615 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1fab5-e2fd-4174-8296-5c7f281dcbc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:48.140077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1fab5-e2fd-4174-8296-5c7f281dcbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:48.140680 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1fab5-e2fd-4174-8296-5c7f281dcbc9 admin admin] PATH_INFO: `/v3/projects/5f6a7d90bafa459f8a24d89a10132b78` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:48.142657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1fab5-e2fd-4174-8296-5c7f281dcbc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f6a7d90bafa459f8a24d89a10132b78)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:48.146473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1fab5-e2fd-4174-8296-5c7f281dcbc9 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:48.491291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e3f1fab5-e2fd-4174-8296-5c7f281dcbc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f6a7d90bafa459f8a24d89a10132b78', 'request_id': 'req-e3f1fab5-e2fd-4174-8296-5c7f281dcbc9'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:48.507239 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e3f1fab5-e2fd-4174-8296-5c7f281dcbc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f6a7d90bafa459f8a24d89a10132b78', 'request_id': 'req-e3f1fab5-e2fd-4174-8296-5c7f281dcbc9'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:48.519716 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e3f1fab5-e2fd-4174-8296-5c7f281dcbc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f6a7d90bafa459f8a24d89a10132b78', 'request_id': 'req-e3f1fab5-e2fd-4174-8296-5c7f281dcbc9'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:48.686254 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e3f1fab5-e2fd-4174-8296-5c7f281dcbc9 admin admin] The token cache is being invalidate because project 5f6a7d90bafa459f8a24d89a10132b78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:28:48.686254 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e3f1fab5-e2fd-4174-8296-5c7f281dcbc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:48.686254 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e3f1fab5-e2fd-4174-8296-5c7f281dcbc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:28:48.706355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1210/2376] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:28:47 2022] DELETE /identity/v3/projects/5f6a7d90bafa459f8a24d89a10132b78 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:51.033135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9185c2-a7d5-44f0-994c-57f7625dfe29 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:51.033720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9185c2-a7d5-44f0-994c-57f7625dfe29 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:51.034345 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9185c2-a7d5-44f0-994c-57f7625dfe29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:51.068481 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-4b9185c2-a7d5-44f0-994c-57f7625dfe29 None None] MFA Rules not processed for user `aa84378418324708b40f0791e2217ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:51.070543 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-4b9185c2-a7d5-44f0-994c-57f7625dfe29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:51.176504 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1167/2377] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:28:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:52.134346 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1fab5-e2fd-4174-8296-5c7f281dcbc9 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:52.136418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-e3f1fab5-e2fd-4174-8296-5c7f281dcbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:52.201538 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:52.228976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1fab5-e2fd-4174-8296-5c7f281dcbc9 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:52.236550 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e462c-b780-4794-80be-059de2490e3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:52.237162 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e462c-b780-4794-80be-059de2490e3d service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:52.237451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e462c-b780-4794-80be-059de2490e3d service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:52.237732 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e462c-b780-4794-80be-059de2490e3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:52.241167 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-692e462c-b780-4794-80be-059de2490e3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:52.257076 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e462c-b780-4794-80be-059de2490e3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:52.258920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e462c-b780-4794-80be-059de2490e3d service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:52.268648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1211/2378] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:28:52.364886 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d06da6-16eb-48d5-b795-45adde08caa5 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:52.365727 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d06da6-16eb-48d5-b795-45adde08caa5 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:52.376425 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d06da6-16eb-48d5-b795-45adde08caa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:52.408299 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-98d06da6-16eb-48d5-b795-45adde08caa5 None None] MFA Rules not processed for user `1083cf32e76243ce9a88100374812ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:52.410034 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-98d06da6-16eb-48d5-b795-45adde08caa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:52.542446 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1168/2379] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:28:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:52.548837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e462c-b780-4794-80be-059de2490e3d service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:52.551590 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-692e462c-b780-4794-80be-059de2490e3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:52.652677 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e462c-b780-4794-80be-059de2490e3d service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:52.667712 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbf650-1483-4974-9382-5f74929394e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:52.668641 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbf650-1483-4974-9382-5f74929394e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:52.669038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbf650-1483-4974-9382-5f74929394e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:52.669439 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbf650-1483-4974-9382-5f74929394e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:52.670500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fbf650-1483-4974-9382-5f74929394e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:52.676424 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fbf650-1483-4974-9382-5f74929394e5 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:52.808783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1212/2380] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:28:52 2022] POST /identity/v3/projects => generated 373 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:28:52.812510 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d06da6-16eb-48d5-b795-45adde08caa5 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:52.831883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d06da6-16eb-48d5-b795-45adde08caa5 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:52.944181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ffeeb-2981-433d-980d-465c3b8c4294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:52.944814 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ffeeb-2981-433d-980d-465c3b8c4294 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:52.945106 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ffeeb-2981-433d-980d-465c3b8c4294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:52.945483 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ffeeb-2981-433d-980d-465c3b8c4294 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:52.946707 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ffeeb-2981-433d-980d-465c3b8c4294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:52.948932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ffeeb-2981-433d-980d-465c3b8c4294 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:52.961267 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:53.067930 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbf650-1483-4974-9382-5f74929394e5 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:53.070032 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-45fbf650-1483-4974-9382-5f74929394e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:53.157838 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1169/2381] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:28:52 2022] POST /identity/v3/users => generated 293 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:28:53.157838 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ffeeb-2981-433d-980d-465c3b8c4294 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:53.171976 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ffeeb-2981-433d-980d-465c3b8c4294 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:53.177187 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e51d4-a826-465a-9282-b104c74479c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:53.178115 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e51d4-a826-465a-9282-b104c74479c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:53.178500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e51d4-a826-465a-9282-b104c74479c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:53.178873 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e51d4-a826-465a-9282-b104c74479c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:53.179681 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e51d4-a826-465a-9282-b104c74479c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:53.182788 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e51d4-a826-465a-9282-b104c74479c6 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:53.204980 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbf650-1483-4974-9382-5f74929394e5 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:53.206674 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1170/2382] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:28:53.210956 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e51d4-a826-465a-9282-b104c74479c6 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:53.214007 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db787418-abc5-40bb-90d7-01b08e483693 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0f9604ee2e43b4967cbdc779e63e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:53.214782 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db787418-abc5-40bb-90d7-01b08e483693 service placement] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:53.215167 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db787418-abc5-40bb-90d7-01b08e483693 service placement] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:53.215579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db787418-abc5-40bb-90d7-01b08e483693 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:53.218235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-db787418-abc5-40bb-90d7-01b08e483693 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:53.225928 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e51d4-a826-465a-9282-b104c74479c6 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:53.231781 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea751d-bb67-4650-b5d3-01275d4a4bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:53.237996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea751d-bb67-4650-b5d3-01275d4a4bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:53.237996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea751d-bb67-4650-b5d3-01275d4a4bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:53.237996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea751d-bb67-4650-b5d3-01275d4a4bc0 admin admin] PATH_INFO: `/v3/projects/bbbe8d91849e41e79f8a1489966c68f0/users/4061b6a81dfa4b9981ff1feec0781b9d/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:53.238299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db787418-abc5-40bb-90d7-01b08e483693 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:53.238299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db787418-abc5-40bb-90d7-01b08e483693 service placement] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:53.252000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea751d-bb67-4650-b5d3-01275d4a4bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbbe8d91849e41e79f8a1489966c68f0, user_id=4061b6a81dfa4b9981ff1feec0781b9d, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:53.255542 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea751d-bb67-4650-b5d3-01275d4a4bc0 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:53.272298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1213/2383] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:28:53.362528 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1171/2384] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:28:53 2022] PUT /identity/v3/projects/bbbe8d91849e41e79f8a1489966c68f0/users/4061b6a81dfa4b9981ff1feec0781b9d/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:28:53.374995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db787418-abc5-40bb-90d7-01b08e483693 service placement] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:53.405526 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db787418-abc5-40bb-90d7-01b08e483693 service placement] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:53.505252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:53.519548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8294f9-f0fc-412a-a608-8267a3ee5ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:53.520555 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8294f9-f0fc-412a-a608-8267a3ee5ffa admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:53.527306 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8294f9-f0fc-412a-a608-8267a3ee5ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:53.527306 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8294f9-f0fc-412a-a608-8267a3ee5ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:53.527306 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8294f9-f0fc-412a-a608-8267a3ee5ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:53.527306 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8294f9-f0fc-412a-a608-8267a3ee5ffa admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:53.542884 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1214/2385] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:28:53.547544 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea751d-bb67-4650-b5d3-01275d4a4bc0 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:53.565235 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea751d-bb67-4650-b5d3-01275d4a4bc0 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:53.580580 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d5567-d7e0-4e9b-bcce-e6956ad8496a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:53.582654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d5567-d7e0-4e9b-bcce-e6956ad8496a admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:53.583288 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d5567-d7e0-4e9b-bcce-e6956ad8496a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:53.583993 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d5567-d7e0-4e9b-bcce-e6956ad8496a admin admin] PATH_INFO: `/v3/projects/bbbe8d91849e41e79f8a1489966c68f0/users/4061b6a81dfa4b9981ff1feec0781b9d/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:53.591874 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d5567-d7e0-4e9b-bcce-e6956ad8496a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbbe8d91849e41e79f8a1489966c68f0, user_id=4061b6a81dfa4b9981ff1feec0781b9d, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:53.596176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d5567-d7e0-4e9b-bcce-e6956ad8496a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:53.618853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1172/2386] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:28:53 2022] PUT /identity/v3/projects/bbbe8d91849e41e79f8a1489966c68f0/users/4061b6a81dfa4b9981ff1feec0781b9d/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:28:53.798246 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeee2e7-183e-489b-b98d-360ddc76cab3 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:53.798543 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeee2e7-183e-489b-b98d-360ddc76cab3 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:53.798832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeee2e7-183e-489b-b98d-360ddc76cab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:53.830029 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-5eeee2e7-183e-489b-b98d-360ddc76cab3 None None] MFA Rules not processed for user `cceaf0c4877a4316af9d15c642c9dfc4`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:28:53.831360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-5eeee2e7-183e-489b-b98d-360ddc76cab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:53.936305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1215/2387] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:28:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:28:54.450963 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d5567-d7e0-4e9b-bcce-e6956ad8496a admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:28:54.580617 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d5567-d7e0-4e9b-bcce-e6956ad8496a admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:28:54.590746 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbd769-fa4b-427c-9f62-5a8a23517871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:28:54.592922 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbd769-fa4b-427c-9f62-5a8a23517871 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:28:54.593901 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbd769-fa4b-427c-9f62-5a8a23517871 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:28:54.594274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbd769-fa4b-427c-9f62-5a8a23517871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:28:54.596721 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-69fbd769-fa4b-427c-9f62-5a8a23517871 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:28:54.624333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbd769-fa4b-427c-9f62-5a8a23517871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:28:54.629784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbd769-fa4b-427c-9f62-5a8a23517871 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:28:54.652541 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1173/2388] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:28:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:29:01.831117 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272da3b4-bf23-469b-9141-5d92e1cab03b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:01.832246 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272da3b4-bf23-469b-9141-5d92e1cab03b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:01.832952 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272da3b4-bf23-469b-9141-5d92e1cab03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:01.886010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-272da3b4-bf23-469b-9141-5d92e1cab03b None None] MFA Rules not processed for user `c81bafbe3e444e84a7da18ac9d782479`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:01.887972 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-272da3b4-bf23-469b-9141-5d92e1cab03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:01.992799 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1216/2389] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:29:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:04.346493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fb9ed-aaa0-4246-8ede-7312a3a25703 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:04.347456 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fb9ed-aaa0-4246-8ede-7312a3a25703 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:04.347456 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fb9ed-aaa0-4246-8ede-7312a3a25703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:04.410442 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-300fb9ed-aaa0-4246-8ede-7312a3a25703 None None] MFA Rules not processed for user `4061b6a81dfa4b9981ff1feec0781b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:04.411829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-300fb9ed-aaa0-4246-8ede-7312a3a25703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:04.551372 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1174/2390] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:29:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:04.569117 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272da3b4-bf23-469b-9141-5d92e1cab03b None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:04.581238 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-272da3b4-bf23-469b-9141-5d92e1cab03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:04.855587 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272da3b4-bf23-469b-9141-5d92e1cab03b None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:04.881440 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308caa09-bbdc-4669-a84e-dd46fc98d4bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:04.884691 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308caa09-bbdc-4669-a84e-dd46fc98d4bd service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:04.885499 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308caa09-bbdc-4669-a84e-dd46fc98d4bd service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:04.889305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308caa09-bbdc-4669-a84e-dd46fc98d4bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:04.995408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:05.038285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308caa09-bbdc-4669-a84e-dd46fc98d4bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:05.041356 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308caa09-bbdc-4669-a84e-dd46fc98d4bd service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:05.061289 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1217/2391] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:29:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:29:05.785407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fb9ed-aaa0-4246-8ede-7312a3a25703 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:05.787704 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-300fb9ed-aaa0-4246-8ede-7312a3a25703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:05.806050 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fb9ed-aaa0-4246-8ede-7312a3a25703 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:05.816083 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155adce2-13d8-4bd5-8730-6e38bcd3350f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:05.817126 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155adce2-13d8-4bd5-8730-6e38bcd3350f service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:05.817573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155adce2-13d8-4bd5-8730-6e38bcd3350f service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:05.818247 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155adce2-13d8-4bd5-8730-6e38bcd3350f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:05.824358 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-155adce2-13d8-4bd5-8730-6e38bcd3350f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:05.843445 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155adce2-13d8-4bd5-8730-6e38bcd3350f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:05.845417 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155adce2-13d8-4bd5-8730-6e38bcd3350f service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:05.859158 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1175/2392] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:29:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:29:08.668523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308caa09-bbdc-4669-a84e-dd46fc98d4bd service nova] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:08.684068 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308caa09-bbdc-4669-a84e-dd46fc98d4bd service nova] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:08.697408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052239b-32b0-4a4e-91df-791d9f343527 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:08.698675 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052239b-32b0-4a4e-91df-791d9f343527 service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:08.699307 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052239b-32b0-4a4e-91df-791d9f343527 service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:08.699746 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052239b-32b0-4a4e-91df-791d9f343527 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:08.715154 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-c052239b-32b0-4a4e-91df-791d9f343527 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:08.732324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052239b-32b0-4a4e-91df-791d9f343527 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:08.735272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052239b-32b0-4a4e-91df-791d9f343527 service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:08.753775 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1218/2393] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:29:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:29:10.162561 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70bf5a-8686-4a8a-a2e4-808a8415cfae None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:10.168179 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70bf5a-8686-4a8a-a2e4-808a8415cfae None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:10.168779 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70bf5a-8686-4a8a-a2e4-808a8415cfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:10.205524 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-bc70bf5a-8686-4a8a-a2e4-808a8415cfae None None] MFA Rules not processed for user `1083cf32e76243ce9a88100374812ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:10.207851 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-bc70bf5a-8686-4a8a-a2e4-808a8415cfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:10.218254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1176/2394] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:29:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:18.546743 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052239b-32b0-4a4e-91df-791d9f343527 service nova] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:18.548277 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-c052239b-32b0-4a4e-91df-791d9f343527 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:18.634143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052239b-32b0-4a4e-91df-791d9f343527 service nova] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:18.639522 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb219d45-796a-4bd1-b0d1-ce6f6f69fcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:18.640158 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb219d45-796a-4bd1-b0d1-ce6f6f69fcd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:18.640445 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb219d45-796a-4bd1-b0d1-ce6f6f69fcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:18.640730 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb219d45-796a-4bd1-b0d1-ce6f6f69fcd9 admin admin] PATH_INFO: `/v3/users/4ba22a32b85f4f7384165115acbb276e` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:18.642010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb219d45-796a-4bd1-b0d1-ce6f6f69fcd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba22a32b85f4f7384165115acbb276e)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:18.644298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb219d45-796a-4bd1-b0d1-ce6f6f69fcd9 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:18.912072 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-fb219d45-796a-4bd1-b0d1-ce6f6f69fcd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba22a32b85f4f7384165115acbb276e'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:18.914332 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-fb219d45-796a-4bd1-b0d1-ce6f6f69fcd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba22a32b85f4f7384165115acbb276e'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:18.935417 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-fb219d45-796a-4bd1-b0d1-ce6f6f69fcd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba22a32b85f4f7384165115acbb276e'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:18.946640 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-fb219d45-796a-4bd1-b0d1-ce6f6f69fcd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba22a32b85f4f7384165115acbb276e'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:18.947082 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-fb219d45-796a-4bd1-b0d1-ce6f6f69fcd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba22a32b85f4f7384165115acbb276e'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:19.105046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1219/2395] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:29:18 2022] DELETE /identity/v3/users/4ba22a32b85f4f7384165115acbb276e => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:19.111156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750f309-9e82-48a8-898b-88f7a5593b9f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:19.111721 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750f309-9e82-48a8-898b-88f7a5593b9f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:19.111721 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750f309-9e82-48a8-898b-88f7a5593b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:19.133557 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-7750f309-9e82-48a8-898b-88f7a5593b9f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:19.135277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-7750f309-9e82-48a8-898b-88f7a5593b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:19.143984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:19.215578 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1177/2396] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:19.228136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb219d45-796a-4bd1-b0d1-ce6f6f69fcd9 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:19.229855 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-fb219d45-796a-4bd1-b0d1-ce6f6f69fcd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:19.289167 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:19.305451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb219d45-796a-4bd1-b0d1-ce6f6f69fcd9 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:19.309200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b2315-59fd-4f9d-a350-7bdcda0e66ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:19.309860 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b2315-59fd-4f9d-a350-7bdcda0e66ac service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:19.310148 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b2315-59fd-4f9d-a350-7bdcda0e66ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:19.310440 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b2315-59fd-4f9d-a350-7bdcda0e66ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:19.320410 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b2315-59fd-4f9d-a350-7bdcda0e66ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:19.321875 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b2315-59fd-4f9d-a350-7bdcda0e66ac service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:19.335207 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1220/2397] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:29:19.935184 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750f309-9e82-48a8-898b-88f7a5593b9f None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:19.936844 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-7750f309-9e82-48a8-898b-88f7a5593b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:19.959809 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750f309-9e82-48a8-898b-88f7a5593b9f None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:19.988344 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b4d66-d423-463c-a5f2-bdb47926d5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:19.990561 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b4d66-d423-463c-a5f2-bdb47926d5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:19.993436 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b4d66-d423-463c-a5f2-bdb47926d5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:19.995162 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b4d66-d423-463c-a5f2-bdb47926d5e3 admin admin] PATH_INFO: `/v3/projects/3ce395c1bc344003bd703af8a22fb812` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:19.997723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b4d66-d423-463c-a5f2-bdb47926d5e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce395c1bc344003bd703af8a22fb812)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:20.000412 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b4d66-d423-463c-a5f2-bdb47926d5e3 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:20.061968 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e0c79-d626-4667-904a-1bc2dc39a34a None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:20.063090 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e0c79-d626-4667-904a-1bc2dc39a34a None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:20.063090 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e0c79-d626-4667-904a-1bc2dc39a34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:20.104301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-949e0c79-d626-4667-904a-1bc2dc39a34a None None] MFA Rules not processed for user `f45f65dd3a844cb583e42d837d2a58d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:20.106103 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-949e0c79-d626-4667-904a-1bc2dc39a34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:20.198958 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1221/2398] 10.222.0.79 () {58 vars in 967 bytes} [Fri Sep 2 21:29:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:20.225012 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e0c79-d626-4667-904a-1bc2dc39a34a None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:20.232186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-949e0c79-d626-4667-904a-1bc2dc39a34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:20.353006 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-bd5b4d66-d423-463c-a5f2-bdb47926d5e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce395c1bc344003bd703af8a22fb812', 'request_id': 'req-bd5b4d66-d423-463c-a5f2-bdb47926d5e3'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:20.359957 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e0c79-d626-4667-904a-1bc2dc39a34a None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:20.365542 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-bd5b4d66-d423-463c-a5f2-bdb47926d5e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce395c1bc344003bd703af8a22fb812', 'request_id': 'req-bd5b4d66-d423-463c-a5f2-bdb47926d5e3'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:20.380386 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-bd5b4d66-d423-463c-a5f2-bdb47926d5e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce395c1bc344003bd703af8a22fb812', 'request_id': 'req-bd5b4d66-d423-463c-a5f2-bdb47926d5e3'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:20.468451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7f958-512e-4836-a02a-807eae7c4e53 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da2b1dc9dae413a8ee63ad67e840f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:20.469043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7f958-512e-4836-a02a-807eae7c4e53 service swift] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:20.469314 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7f958-512e-4836-a02a-807eae7c4e53 service swift] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:20.469588 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7f958-512e-4836-a02a-807eae7c4e53 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:20.505152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-bd5b4d66-d423-463c-a5f2-bdb47926d5e3 admin admin] The token cache is being invalidate because project 3ce395c1bc344003bd703af8a22fb812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:29:20.505744 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-bd5b4d66-d423-463c-a5f2-bdb47926d5e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:20.507938 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-bd5b4d66-d423-463c-a5f2-bdb47926d5e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:20.510122 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1178/2399] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:29:19 2022] DELETE /identity/v3/projects/3ce395c1bc344003bd703af8a22fb812 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:29:20.517302 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ee796-dbbb-4cf5-867a-d3b3b546d6ec None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:20.517593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ee796-dbbb-4cf5-867a-d3b3b546d6ec None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:20.521015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ee796-dbbb-4cf5-867a-d3b3b546d6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:20.534689 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:20.549175 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-3e8ee796-dbbb-4cf5-867a-d3b3b546d6ec None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:20.550457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-3e8ee796-dbbb-4cf5-867a-d3b3b546d6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:20.568488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7f958-512e-4836-a02a-807eae7c4e53 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:20.571090 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7f958-512e-4836-a02a-807eae7c4e53 service swift] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:20.590192 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1222/2400] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Sep 2 21:29:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:29:20.634315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1179/2401] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:20.643652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faa74f-9c77-45e7-920c-be8ab40886c3 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:20.643936 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faa74f-9c77-45e7-920c-be8ab40886c3 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:20.644210 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faa74f-9c77-45e7-920c-be8ab40886c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:20.667414 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-46faa74f-9c77-45e7-920c-be8ab40886c3 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:20.668894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-46faa74f-9c77-45e7-920c-be8ab40886c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:20.684258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1223/2402] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:20.686939 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ee796-dbbb-4cf5-867a-d3b3b546d6ec None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:20.700721 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ee796-dbbb-4cf5-867a-d3b3b546d6ec None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:20.706137 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51f6a3-721a-4419-8043-b41907601d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:20.706764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51f6a3-721a-4419-8043-b41907601d1f admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:20.708391 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51f6a3-721a-4419-8043-b41907601d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:20.708391 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51f6a3-721a-4419-8043-b41907601d1f admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:20.708391 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51f6a3-721a-4419-8043-b41907601d1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:29:20.708391 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51f6a3-721a-4419-8043-b41907601d1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:20.710799 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51f6a3-721a-4419-8043-b41907601d1f admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:20.733100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1180/2403] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:29:20.738156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46faa74f-9c77-45e7-920c-be8ab40886c3 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:20.749462 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46faa74f-9c77-45e7-920c-be8ab40886c3 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:20.755097 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea85870-f9e9-4e83-8765-aa222b35e68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:20.755709 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea85870-f9e9-4e83-8765-aa222b35e68f admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:20.756003 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea85870-f9e9-4e83-8765-aa222b35e68f admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:20.756292 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea85870-f9e9-4e83-8765-aa222b35e68f admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:20.757924 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea85870-f9e9-4e83-8765-aa222b35e68f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:20.759889 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea85870-f9e9-4e83-8765-aa222b35e68f admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:20.871678 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1224/2404] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:29:20 2022] POST /identity/v3/projects => generated 399 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:29:20.876775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51f6a3-721a-4419-8043-b41907601d1f admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:20.894521 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51f6a3-721a-4419-8043-b41907601d1f admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:20.923028 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:20.998500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bbad4-ba8e-418d-b8cd-02ab63e7a4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:20.998500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bbad4-ba8e-418d-b8cd-02ab63e7a4c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:20.998500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bbad4-ba8e-418d-b8cd-02ab63e7a4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:20.999348 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bbad4-ba8e-418d-b8cd-02ab63e7a4c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:21.000640 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483bbad4-ba8e-418d-b8cd-02ab63e7a4c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:21.004754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483bbad4-ba8e-418d-b8cd-02ab63e7a4c0 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:21.086567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1181/2405] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:29:20 2022] POST /identity/v3/users => generated 300 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:29:21.090871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea85870-f9e9-4e83-8765-aa222b35e68f admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:21.102888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea85870-f9e9-4e83-8765-aa222b35e68f admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:21.111548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eace3ef-7811-47fd-b4e5-70feb105180c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:21.112712 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eace3ef-7811-47fd-b4e5-70feb105180c admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:21.113223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eace3ef-7811-47fd-b4e5-70feb105180c admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:21.113577 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eace3ef-7811-47fd-b4e5-70feb105180c admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:21.114341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eace3ef-7811-47fd-b4e5-70feb105180c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:21.116668 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eace3ef-7811-47fd-b4e5-70feb105180c admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:21.128857 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1225/2406] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:29:21.134727 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bbad4-ba8e-418d-b8cd-02ab63e7a4c0 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:21.148205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bbad4-ba8e-418d-b8cd-02ab63e7a4c0 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:21.169322 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efc8ec-3bad-45e5-91e3-3027da07a9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:21.170245 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efc8ec-3bad-45e5-91e3-3027da07a9ab admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:21.170795 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efc8ec-3bad-45e5-91e3-3027da07a9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:21.170937 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efc8ec-3bad-45e5-91e3-3027da07a9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:21.171566 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efc8ec-3bad-45e5-91e3-3027da07a9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:21.173195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efc8ec-3bad-45e5-91e3-3027da07a9ab admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:21.190575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1182/2407] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:29:21.195673 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eace3ef-7811-47fd-b4e5-70feb105180c admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:21.207426 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eace3ef-7811-47fd-b4e5-70feb105180c admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:21.228237 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cd853-ffe9-4fcf-9d3f-bd08e3871e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:21.228237 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cd853-ffe9-4fcf-9d3f-bd08e3871e1f admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:21.228237 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cd853-ffe9-4fcf-9d3f-bd08e3871e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:21.228237 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cd853-ffe9-4fcf-9d3f-bd08e3871e1f admin admin] PATH_INFO: `/v3/projects/ee81b5de4355428d895cdb7a3177274e/users/10202d0d51fd499f922b2d23bda24f78/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:21.246645 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cd853-ffe9-4fcf-9d3f-bd08e3871e1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee81b5de4355428d895cdb7a3177274e, user_id=10202d0d51fd499f922b2d23bda24f78, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:21.268097 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cd853-ffe9-4fcf-9d3f-bd08e3871e1f admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:21.445604 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1226/2408] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:29:21 2022] PUT /identity/v3/projects/ee81b5de4355428d895cdb7a3177274e/users/10202d0d51fd499f922b2d23bda24f78/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:21.463372 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59850f66-221c-478c-a484-d00f956e51a2 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:21.463916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59850f66-221c-478c-a484-d00f956e51a2 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:21.463916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59850f66-221c-478c-a484-d00f956e51a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:21.499847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-59850f66-221c-478c-a484-d00f956e51a2 None None] MFA Rules not processed for user `10202d0d51fd499f922b2d23bda24f78`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:21.501073 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-59850f66-221c-478c-a484-d00f956e51a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:21.588086 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1183/2409] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:29:21 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:29:21.600745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cd853-ffe9-4fcf-9d3f-bd08e3871e1f admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:21.603069 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-557cd853-ffe9-4fcf-9d3f-bd08e3871e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:21.674762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cd853-ffe9-4fcf-9d3f-bd08e3871e1f admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:21.680496 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a3cbf-653d-481f-b232-d463a3fc80d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:21.681144 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a3cbf-653d-481f-b232-d463a3fc80d3 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:21.681552 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a3cbf-653d-481f-b232-d463a3fc80d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:21.682005 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a3cbf-653d-481f-b232-d463a3fc80d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:21.691983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a3cbf-653d-481f-b232-d463a3fc80d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:21.693442 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a3cbf-653d-481f-b232-d463a3fc80d3 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:21.707399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1227/2410] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:29:21 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:29:31.583211 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=57,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:31.603089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59850f66-221c-478c-a484-d00f956e51a2 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:31.615124 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a3cbf-653d-481f-b232-d463a3fc80d3 service cinder] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:31.617777 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-517a3cbf-653d-481f-b232-d463a3fc80d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:31.695002 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59850f66-221c-478c-a484-d00f956e51a2 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:31.702980 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b45aa-95b3-466c-9001-664395b28a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:31.703769 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b45aa-95b3-466c-9001-664395b28a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:31.704101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b45aa-95b3-466c-9001-664395b28a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:31.704427 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b45aa-95b3-466c-9001-664395b28a3b admin admin] PATH_INFO: `/v3/users/10202d0d51fd499f922b2d23bda24f78` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:31.705702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b45aa-95b3-466c-9001-664395b28a3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=10202d0d51fd499f922b2d23bda24f78)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:31.707883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b45aa-95b3-466c-9001-664395b28a3b admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:31.742450 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a3cbf-653d-481f-b232-d463a3fc80d3 service cinder] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:31.748086 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588f3d6-5a2c-400d-8b28-cf6a5cec3793 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0f9604ee2e43b4967cbdc779e63e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:31.748717 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588f3d6-5a2c-400d-8b28-cf6a5cec3793 service placement] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:31.748988 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588f3d6-5a2c-400d-8b28-cf6a5cec3793 service placement] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:31.749262 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588f3d6-5a2c-400d-8b28-cf6a5cec3793 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:31.751990 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-1588f3d6-5a2c-400d-8b28-cf6a5cec3793 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:31.765461 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588f3d6-5a2c-400d-8b28-cf6a5cec3793 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:31.767102 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588f3d6-5a2c-400d-8b28-cf6a5cec3793 service placement] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:31.778138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1228/2411] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:29:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:29:31.815157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588f3d6-5a2c-400d-8b28-cf6a5cec3793 service placement] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:31.815157 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-1588f3d6-5a2c-400d-8b28-cf6a5cec3793 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:31.823692 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:31.831482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588f3d6-5a2c-400d-8b28-cf6a5cec3793 service placement] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:31.838270 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be289d1-b66a-4ca4-b323-88550e983491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:31.843986 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be289d1-b66a-4ca4-b323-88550e983491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:31.843986 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be289d1-b66a-4ca4-b323-88550e983491 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:31.843986 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be289d1-b66a-4ca4-b323-88550e983491 admin admin] PATH_INFO: `/v3/users/b0884441f5744f09b23823752684fe08` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:31.843986 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be289d1-b66a-4ca4-b323-88550e983491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0884441f5744f09b23823752684fe08)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:31.843986 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be289d1-b66a-4ca4-b323-88550e983491 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:31.995587 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-342b45aa-95b3-466c-9001-664395b28a3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10202d0d51fd499f922b2d23bda24f78'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:31.996168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-342b45aa-95b3-466c-9001-664395b28a3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10202d0d51fd499f922b2d23bda24f78'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:32.003875 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-342b45aa-95b3-466c-9001-664395b28a3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10202d0d51fd499f922b2d23bda24f78'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:32.018592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-342b45aa-95b3-466c-9001-664395b28a3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10202d0d51fd499f922b2d23bda24f78'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:32.019456 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-342b45aa-95b3-466c-9001-664395b28a3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10202d0d51fd499f922b2d23bda24f78'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:32.204518 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1184/2412] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:29:31 2022] DELETE /identity/v3/users/10202d0d51fd499f922b2d23bda24f78 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:32.219846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887850c-0be6-438e-a20f-7f7bb44d3857 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:32.220135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887850c-0be6-438e-a20f-7f7bb44d3857 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:32.220577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887850c-0be6-438e-a20f-7f7bb44d3857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:32.243474 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-6887850c-0be6-438e-a20f-7f7bb44d3857 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:29:32.244725 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-6887850c-0be6-438e-a20f-7f7bb44d3857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:32.266303 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4be289d1-b66a-4ca4-b323-88550e983491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0884441f5744f09b23823752684fe08'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:32.267020 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4be289d1-b66a-4ca4-b323-88550e983491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0884441f5744f09b23823752684fe08'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:32.283251 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4be289d1-b66a-4ca4-b323-88550e983491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0884441f5744f09b23823752684fe08'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:32.292477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4be289d1-b66a-4ca4-b323-88550e983491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0884441f5744f09b23823752684fe08'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:32.292709 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4be289d1-b66a-4ca4-b323-88550e983491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0884441f5744f09b23823752684fe08'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:32.322971 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1185/2413] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:29:32.333312 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887850c-0be6-438e-a20f-7f7bb44d3857 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:32.338376 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-6887850c-0be6-438e-a20f-7f7bb44d3857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:32.359345 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:32.400688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887850c-0be6-438e-a20f-7f7bb44d3857 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:32.404522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90987caf-b730-4d3d-9eaf-554270af6c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:32.405129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90987caf-b730-4d3d-9eaf-554270af6c4a service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:32.405404 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90987caf-b730-4d3d-9eaf-554270af6c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:32.405678 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90987caf-b730-4d3d-9eaf-554270af6c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:32.416433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90987caf-b730-4d3d-9eaf-554270af6c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:32.417908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90987caf-b730-4d3d-9eaf-554270af6c4a service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:32.428982 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1186/2414] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:29:32.451353 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1229/2415] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:29:31 2022] DELETE /identity/v3/users/b0884441f5744f09b23823752684fe08 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:29:32.751428 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90987caf-b730-4d3d-9eaf-554270af6c4a service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:32.755145 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-90987caf-b730-4d3d-9eaf-554270af6c4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:32.772452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90987caf-b730-4d3d-9eaf-554270af6c4a service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:32.855470 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8bd87-ea6e-49d5-9669-14dc3342af17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:32.856271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8bd87-ea6e-49d5-9669-14dc3342af17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:32.856697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8bd87-ea6e-49d5-9669-14dc3342af17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:32.857101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8bd87-ea6e-49d5-9669-14dc3342af17 admin admin] PATH_INFO: `/v3/projects/2a715e1b8137477b9f39b1d6d8d0d268` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:32.858435 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8bd87-ea6e-49d5-9669-14dc3342af17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a715e1b8137477b9f39b1d6d8d0d268)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:32.860619 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8bd87-ea6e-49d5-9669-14dc3342af17 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:33.001024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-92e8bd87-ea6e-49d5-9669-14dc3342af17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a715e1b8137477b9f39b1d6d8d0d268', 'request_id': 'req-92e8bd87-ea6e-49d5-9669-14dc3342af17'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:33.009521 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-92e8bd87-ea6e-49d5-9669-14dc3342af17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a715e1b8137477b9f39b1d6d8d0d268', 'request_id': 'req-92e8bd87-ea6e-49d5-9669-14dc3342af17'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:33.014741 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-92e8bd87-ea6e-49d5-9669-14dc3342af17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a715e1b8137477b9f39b1d6d8d0d268', 'request_id': 'req-92e8bd87-ea6e-49d5-9669-14dc3342af17'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:33.026238 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be289d1-b66a-4ca4-b323-88550e983491 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:33.029698 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-4be289d1-b66a-4ca4-b323-88550e983491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:33.050188 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be289d1-b66a-4ca4-b323-88550e983491 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:33.119637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b3bbb-dd18-4c11-b570-bd69051d6614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:33.120309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b3bbb-dd18-4c11-b570-bd69051d6614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:33.120590 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b3bbb-dd18-4c11-b570-bd69051d6614 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:33.120889 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b3bbb-dd18-4c11-b570-bd69051d6614 admin admin] PATH_INFO: `/v3/projects/ee81b5de4355428d895cdb7a3177274e` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:33.122223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b3bbb-dd18-4c11-b570-bd69051d6614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee81b5de4355428d895cdb7a3177274e)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:33.124189 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b3bbb-dd18-4c11-b570-bd69051d6614 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:33.153656 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-92e8bd87-ea6e-49d5-9669-14dc3342af17 admin admin] The token cache is being invalidate because project 2a715e1b8137477b9f39b1d6d8d0d268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:29:33.169118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-92e8bd87-ea6e-49d5-9669-14dc3342af17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:33.169118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-92e8bd87-ea6e-49d5-9669-14dc3342af17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:33.169118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1187/2416] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:29:32 2022] DELETE /identity/v3/projects/2a715e1b8137477b9f39b1d6d8d0d268 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:33.169118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8bd87-ea6e-49d5-9669-14dc3342af17 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:33.169118 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-92e8bd87-ea6e-49d5-9669-14dc3342af17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:33.175355 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8bd87-ea6e-49d5-9669-14dc3342af17 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:33.180210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5649bb0-aac4-45f6-ba99-e76e25520361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:33.180848 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5649bb0-aac4-45f6-ba99-e76e25520361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:33.181127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5649bb0-aac4-45f6-ba99-e76e25520361 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:33.181412 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5649bb0-aac4-45f6-ba99-e76e25520361 admin admin] PATH_INFO: `/v3/users/64926cf65bab4ce8bdb4047f3b91da09` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:33.182627 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5649bb0-aac4-45f6-ba99-e76e25520361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64926cf65bab4ce8bdb4047f3b91da09)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:33.184708 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5649bb0-aac4-45f6-ba99-e76e25520361 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:33.337504 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e38b3bbb-dd18-4c11-b570-bd69051d6614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee81b5de4355428d895cdb7a3177274e', 'request_id': 'req-e38b3bbb-dd18-4c11-b570-bd69051d6614'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:33.344081 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e38b3bbb-dd18-4c11-b570-bd69051d6614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee81b5de4355428d895cdb7a3177274e', 'request_id': 'req-e38b3bbb-dd18-4c11-b570-bd69051d6614'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:33.350342 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e38b3bbb-dd18-4c11-b570-bd69051d6614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee81b5de4355428d895cdb7a3177274e', 'request_id': 'req-e38b3bbb-dd18-4c11-b570-bd69051d6614'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:33.572256 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e38b3bbb-dd18-4c11-b570-bd69051d6614 admin admin] The token cache is being invalidate because project ee81b5de4355428d895cdb7a3177274e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:29:33.572482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e38b3bbb-dd18-4c11-b570-bd69051d6614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:33.573066 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e38b3bbb-dd18-4c11-b570-bd69051d6614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:33.574781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1230/2417] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:29:33 2022] DELETE /identity/v3/projects/ee81b5de4355428d895cdb7a3177274e => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:33.628873 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d5649bb0-aac4-45f6-ba99-e76e25520361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64926cf65bab4ce8bdb4047f3b91da09'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:33.629746 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d5649bb0-aac4-45f6-ba99-e76e25520361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64926cf65bab4ce8bdb4047f3b91da09'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:33.632802 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:33.650987 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d5649bb0-aac4-45f6-ba99-e76e25520361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64926cf65bab4ce8bdb4047f3b91da09'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:33.669905 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d5649bb0-aac4-45f6-ba99-e76e25520361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64926cf65bab4ce8bdb4047f3b91da09'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:33.671322 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-d5649bb0-aac4-45f6-ba99-e76e25520361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64926cf65bab4ce8bdb4047f3b91da09'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:33.788234 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1188/2418] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:29:33 2022] DELETE /identity/v3/users/64926cf65bab4ce8bdb4047f3b91da09 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:29:34.088869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b3bbb-dd18-4c11-b570-bd69051d6614 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:34.091908 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-e38b3bbb-dd18-4c11-b570-bd69051d6614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:34.120994 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:34.213051 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b3bbb-dd18-4c11-b570-bd69051d6614 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:34.285366 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e3bd2-9c98-4236-af92-c2c1a32bd7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:34.286022 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e3bd2-9c98-4236-af92-c2c1a32bd7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:34.286022 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e3bd2-9c98-4236-af92-c2c1a32bd7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:34.286022 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e3bd2-9c98-4236-af92-c2c1a32bd7f4 admin admin] PATH_INFO: `/v3/projects/4e7e12bf88cf4600a747394aabd1b594` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:34.291368 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e3bd2-9c98-4236-af92-c2c1a32bd7f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e7e12bf88cf4600a747394aabd1b594)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:34.293514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e3bd2-9c98-4236-af92-c2c1a32bd7f4 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:34.456541 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-cf7e3bd2-9c98-4236-af92-c2c1a32bd7f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e7e12bf88cf4600a747394aabd1b594', 'request_id': 'req-cf7e3bd2-9c98-4236-af92-c2c1a32bd7f4'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:34.464429 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-cf7e3bd2-9c98-4236-af92-c2c1a32bd7f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e7e12bf88cf4600a747394aabd1b594', 'request_id': 'req-cf7e3bd2-9c98-4236-af92-c2c1a32bd7f4'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:34.470681 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-cf7e3bd2-9c98-4236-af92-c2c1a32bd7f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e7e12bf88cf4600a747394aabd1b594', 'request_id': 'req-cf7e3bd2-9c98-4236-af92-c2c1a32bd7f4'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:34.604474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-cf7e3bd2-9c98-4236-af92-c2c1a32bd7f4 admin admin] The token cache is being invalidate because project 4e7e12bf88cf4600a747394aabd1b594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:29:34.604796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-cf7e3bd2-9c98-4236-af92-c2c1a32bd7f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:34.605938 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-cf7e3bd2-9c98-4236-af92-c2c1a32bd7f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:29:34.611624 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1231/2419] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:29:34 2022] DELETE /identity/v3/projects/4e7e12bf88cf4600a747394aabd1b594 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:29:44.078299 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=12,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:45.153123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:56.900812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5649bb0-aac4-45f6-ba99-e76e25520361 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:29:56.902326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d5649bb0-aac4-45f6-ba99-e76e25520361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:56.967896 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5649bb0-aac4-45f6-ba99-e76e25520361 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:29:57.025055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae98248-a630-4eb6-88c3-1f4c128488a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:29:57.025827 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae98248-a630-4eb6-88c3-1f4c128488a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:29:57.026376 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae98248-a630-4eb6-88c3-1f4c128488a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:29:57.026654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae98248-a630-4eb6-88c3-1f4c128488a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:29:57.028427 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-bae98248-a630-4eb6-88c3-1f4c128488a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:29:57.106622 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae98248-a630-4eb6-88c3-1f4c128488a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:29:57.108196 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae98248-a630-4eb6-88c3-1f4c128488a1 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:29:57.127168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1189/2420] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:29:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:30:00.627982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e3bd2-9c98-4236-af92-c2c1a32bd7f4 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:00.629577 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-cf7e3bd2-9c98-4236-af92-c2c1a32bd7f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:00.740303 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e3bd2-9c98-4236-af92-c2c1a32bd7f4 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:00.746270 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b354fb2-94a3-40f0-9e19-a3751ccd9ed0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:00.746749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b354fb2-94a3-40f0-9e19-a3751ccd9ed0 service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:00.747031 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b354fb2-94a3-40f0-9e19-a3751ccd9ed0 service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:00.747307 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b354fb2-94a3-40f0-9e19-a3751ccd9ed0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:00.749350 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-9b354fb2-94a3-40f0-9e19-a3751ccd9ed0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:00.843280 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b354fb2-94a3-40f0-9e19-a3751ccd9ed0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:00.845082 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b354fb2-94a3-40f0-9e19-a3751ccd9ed0 service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:00.856233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1232/2421] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:30:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:30:07.118633 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=70 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:10.039482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4e45-1ecb-477e-993f-31e8570542e7 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:10.040113 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4e45-1ecb-477e-993f-31e8570542e7 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:10.040279 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4e45-1ecb-477e-993f-31e8570542e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:10.062967 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-009a4e45-1ecb-477e-993f-31e8570542e7 None None] MFA Rules not processed for user `e2940758d8424054bf3a68a42b79bb81`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:30:10.064586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-009a4e45-1ecb-477e-993f-31e8570542e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:10.072291 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1190/2422] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:30:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:30:10.851395 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=56 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:20.057014 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:28.395359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b354fb2-94a3-40f0-9e19-a3751ccd9ed0 service nova] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:28.396726 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-9b354fb2-94a3-40f0-9e19-a3751ccd9ed0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:28.442210 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b354fb2-94a3-40f0-9e19-a3751ccd9ed0 service nova] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:28.446066 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c147d-87e9-4ba9-9efa-e435245df838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:28.446743 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c147d-87e9-4ba9-9efa-e435245df838 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:28.447026 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c147d-87e9-4ba9-9efa-e435245df838 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:28.447328 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c147d-87e9-4ba9-9efa-e435245df838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:28.449491 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-c76c147d-87e9-4ba9-9efa-e435245df838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:28.560298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c147d-87e9-4ba9-9efa-e435245df838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:28.561738 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c147d-87e9-4ba9-9efa-e435245df838 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:28.583358 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1233/2423] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:30:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:30:33.239729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a4e45-1ecb-477e-993f-31e8570542e7 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:33.241006 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-009a4e45-1ecb-477e-993f-31e8570542e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:33.301606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a4e45-1ecb-477e-993f-31e8570542e7 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:33.306857 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351dc7ce-1b5b-4239-94ac-b9868bfb742e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:33.307877 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dc7ce-1b5b-4239-94ac-b9868bfb742e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:33.308227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dc7ce-1b5b-4239-94ac-b9868bfb742e admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:33.308583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dc7ce-1b5b-4239-94ac-b9868bfb742e admin admin] PATH_INFO: `/v3/users/c81bafbe3e444e84a7da18ac9d782479` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:33.310136 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351dc7ce-1b5b-4239-94ac-b9868bfb742e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c81bafbe3e444e84a7da18ac9d782479)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:33.312573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351dc7ce-1b5b-4239-94ac-b9868bfb742e admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:33.611153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-351dc7ce-1b5b-4239-94ac-b9868bfb742e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c81bafbe3e444e84a7da18ac9d782479'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:33.615374 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-351dc7ce-1b5b-4239-94ac-b9868bfb742e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c81bafbe3e444e84a7da18ac9d782479'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:33.625138 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-351dc7ce-1b5b-4239-94ac-b9868bfb742e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c81bafbe3e444e84a7da18ac9d782479'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:33.646921 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-351dc7ce-1b5b-4239-94ac-b9868bfb742e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c81bafbe3e444e84a7da18ac9d782479'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:33.648439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-351dc7ce-1b5b-4239-94ac-b9868bfb742e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c81bafbe3e444e84a7da18ac9d782479'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:33.791250 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1191/2424] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:30:33 2022] DELETE /identity/v3/users/c81bafbe3e444e84a7da18ac9d782479 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:30:34.147171 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c147d-87e9-4ba9-9efa-e435245df838 service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:34.163316 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c147d-87e9-4ba9-9efa-e435245df838 service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:34.253592 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44cfd7-5638-4ff0-a1c4-188d7c461237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:34.254474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44cfd7-5638-4ff0-a1c4-188d7c461237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:34.254759 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44cfd7-5638-4ff0-a1c4-188d7c461237 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:34.255037 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44cfd7-5638-4ff0-a1c4-188d7c461237 admin admin] PATH_INFO: `/v3/projects/347df6259a3e48fcbdcbb3f895d38bd4` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:34.256437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44cfd7-5638-4ff0-a1c4-188d7c461237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=347df6259a3e48fcbdcbb3f895d38bd4)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:34.258597 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44cfd7-5638-4ff0-a1c4-188d7c461237 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:34.286902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:34.510448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2d44cfd7-5638-4ff0-a1c4-188d7c461237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '347df6259a3e48fcbdcbb3f895d38bd4', 'request_id': 'req-2d44cfd7-5638-4ff0-a1c4-188d7c461237'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:34.517476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2d44cfd7-5638-4ff0-a1c4-188d7c461237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '347df6259a3e48fcbdcbb3f895d38bd4', 'request_id': 'req-2d44cfd7-5638-4ff0-a1c4-188d7c461237'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:34.523555 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2d44cfd7-5638-4ff0-a1c4-188d7c461237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '347df6259a3e48fcbdcbb3f895d38bd4', 'request_id': 'req-2d44cfd7-5638-4ff0-a1c4-188d7c461237'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:34.700711 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2d44cfd7-5638-4ff0-a1c4-188d7c461237 admin admin] The token cache is being invalidate because project 347df6259a3e48fcbdcbb3f895d38bd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:30:34.701045 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2d44cfd7-5638-4ff0-a1c4-188d7c461237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:34.710379 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-2d44cfd7-5638-4ff0-a1c4-188d7c461237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:34.710379 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1234/2425] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:30:34 2022] DELETE /identity/v3/projects/347df6259a3e48fcbdcbb3f895d38bd4 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:30:34.710837 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1db4c-e762-4eaf-b898-0b44f031037e None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:34.711285 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1db4c-e762-4eaf-b898-0b44f031037e None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:34.711285 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1db4c-e762-4eaf-b898-0b44f031037e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:34.789351 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-94e1db4c-e762-4eaf-b898-0b44f031037e None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:30:34.790644 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-94e1db4c-e762-4eaf-b898-0b44f031037e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:34.861440 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1192/2426] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:30:34.869940 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9273e8-c32f-4e10-bc11-92c2e93b420b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:34.870326 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9273e8-c32f-4e10-bc11-92c2e93b420b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:34.870684 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9273e8-c32f-4e10-bc11-92c2e93b420b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:34.900056 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-8a9273e8-c32f-4e10-bc11-92c2e93b420b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:30:34.901390 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-8a9273e8-c32f-4e10-bc11-92c2e93b420b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:34.916205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1235/2427] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:30:34.920646 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1db4c-e762-4eaf-b898-0b44f031037e None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:34.935224 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1db4c-e762-4eaf-b898-0b44f031037e None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:34.942305 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db28ff-5048-43b9-aacd-b8e8b0346f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:34.943069 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db28ff-5048-43b9-aacd-b8e8b0346f36 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:34.943418 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db28ff-5048-43b9-aacd-b8e8b0346f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:34.943920 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db28ff-5048-43b9-aacd-b8e8b0346f36 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:34.944724 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db28ff-5048-43b9-aacd-b8e8b0346f36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:30:34.945126 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db28ff-5048-43b9-aacd-b8e8b0346f36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:34.947475 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db28ff-5048-43b9-aacd-b8e8b0346f36 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:34.967842 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1193/2428] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:30:34.972281 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9273e8-c32f-4e10-bc11-92c2e93b420b None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:34.984601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9273e8-c32f-4e10-bc11-92c2e93b420b None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:34.990922 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62add62-0714-4f3e-85af-cac01b02228a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:34.991916 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62add62-0714-4f3e-85af-cac01b02228a admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:34.992357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62add62-0714-4f3e-85af-cac01b02228a admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:34.992642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62add62-0714-4f3e-85af-cac01b02228a admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:34.993305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62add62-0714-4f3e-85af-cac01b02228a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:34.995560 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62add62-0714-4f3e-85af-cac01b02228a admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:35.248607 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1236/2429] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:30:34 2022] POST /identity/v3/projects => generated 381 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:30:35.254261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db28ff-5048-43b9-aacd-b8e8b0346f36 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:35.259776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:35.266418 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db28ff-5048-43b9-aacd-b8e8b0346f36 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:35.347193 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c1ae1-7dfe-4238-a90f-a2b6fea0069a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:35.348024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c1ae1-7dfe-4238-a90f-a2b6fea0069a admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:35.348473 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c1ae1-7dfe-4238-a90f-a2b6fea0069a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:35.349034 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c1ae1-7dfe-4238-a90f-a2b6fea0069a admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:35.349781 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c1ae1-7dfe-4238-a90f-a2b6fea0069a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:35.353033 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c1ae1-7dfe-4238-a90f-a2b6fea0069a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:35.560121 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1194/2430] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:30:35 2022] POST /identity/v3/users => generated 291 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:30:35.564473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62add62-0714-4f3e-85af-cac01b02228a admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:35.582333 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62add62-0714-4f3e-85af-cac01b02228a admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:35.588907 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736b5c6-7d26-4001-87cb-25bbd8c9fca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:35.589642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736b5c6-7d26-4001-87cb-25bbd8c9fca4 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:35.590601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736b5c6-7d26-4001-87cb-25bbd8c9fca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:35.591345 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736b5c6-7d26-4001-87cb-25bbd8c9fca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:35.591857 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736b5c6-7d26-4001-87cb-25bbd8c9fca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:35.593568 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736b5c6-7d26-4001-87cb-25bbd8c9fca4 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:35.611439 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1237/2431] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:30:35.615462 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c1ae1-7dfe-4238-a90f-a2b6fea0069a admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:35.626779 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c1ae1-7dfe-4238-a90f-a2b6fea0069a admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:35.631588 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813850e-fa21-4040-a8e4-2196a3a20296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:35.633278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813850e-fa21-4040-a8e4-2196a3a20296 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:35.633278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813850e-fa21-4040-a8e4-2196a3a20296 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:35.633278 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813850e-fa21-4040-a8e4-2196a3a20296 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:35.633548 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813850e-fa21-4040-a8e4-2196a3a20296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:35.635035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813850e-fa21-4040-a8e4-2196a3a20296 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:35.648256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1195/2432] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:30:35.663597 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736b5c6-7d26-4001-87cb-25bbd8c9fca4 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:35.675721 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736b5c6-7d26-4001-87cb-25bbd8c9fca4 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:35.680521 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96de418-c12d-4427-9d20-f769def9234f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:35.681199 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96de418-c12d-4427-9d20-f769def9234f admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:35.681492 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96de418-c12d-4427-9d20-f769def9234f admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:35.681773 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96de418-c12d-4427-9d20-f769def9234f admin admin] PATH_INFO: `/v3/projects/e6982b8239ca40d7b02c399eefdebdbb/users/f91cf8e5d13b451ba2a3e3857474bdd0/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:35.699744 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96de418-c12d-4427-9d20-f769def9234f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6982b8239ca40d7b02c399eefdebdbb, user_id=f91cf8e5d13b451ba2a3e3857474bdd0, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:35.702508 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96de418-c12d-4427-9d20-f769def9234f admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:35.882470 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bc38f-aa16-4023-a172-6e86ab9f22c1 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:35.883360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bc38f-aa16-4023-a172-6e86ab9f22c1 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:35.883360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bc38f-aa16-4023-a172-6e86ab9f22c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:35.885697 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1238/2433] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:30:35 2022] PUT /identity/v3/projects/e6982b8239ca40d7b02c399eefdebdbb/users/f91cf8e5d13b451ba2a3e3857474bdd0/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:30:35.926024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-1e2bc38f-aa16-4023-a172-6e86ab9f22c1 None None] MFA Rules not processed for user `f91cf8e5d13b451ba2a3e3857474bdd0`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:30:35.928143 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-1e2bc38f-aa16-4023-a172-6e86ab9f22c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:36.019324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1196/2434] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:30:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:30:36.024596 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96de418-c12d-4427-9d20-f769def9234f admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:36.113278 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96de418-c12d-4427-9d20-f769def9234f admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:36.119580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85b7b9-e67c-4470-a002-56180bf1fb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:36.120232 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85b7b9-e67c-4470-a002-56180bf1fb22 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:36.120509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85b7b9-e67c-4470-a002-56180bf1fb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:36.120787 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85b7b9-e67c-4470-a002-56180bf1fb22 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:36.121655 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85b7b9-e67c-4470-a002-56180bf1fb22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:36.124192 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85b7b9-e67c-4470-a002-56180bf1fb22 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:36.305214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1239/2435] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:30:36 2022] POST /identity/v3/projects => generated 381 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:30:36.309711 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bc38f-aa16-4023-a172-6e86ab9f22c1 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:36.322515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bc38f-aa16-4023-a172-6e86ab9f22c1 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:36.428129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c630a-e113-44b1-8487-9a64da92c902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:36.429082 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c630a-e113-44b1-8487-9a64da92c902 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:36.429717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c630a-e113-44b1-8487-9a64da92c902 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:36.430046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c630a-e113-44b1-8487-9a64da92c902 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:36.431596 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c630a-e113-44b1-8487-9a64da92c902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:36.434651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c630a-e113-44b1-8487-9a64da92c902 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:36.697864 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:36.714045 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1197/2436] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:30:36 2022] POST /identity/v3/users => generated 297 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:30:36.717987 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85b7b9-e67c-4470-a002-56180bf1fb22 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:36.732378 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85b7b9-e67c-4470-a002-56180bf1fb22 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:36.742060 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebaf5fa-592a-41b0-aa5a-be4b9dfa009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:36.743067 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebaf5fa-592a-41b0-aa5a-be4b9dfa009f admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:36.743714 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebaf5fa-592a-41b0-aa5a-be4b9dfa009f admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:36.744094 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebaf5fa-592a-41b0-aa5a-be4b9dfa009f admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:36.744966 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebaf5fa-592a-41b0-aa5a-be4b9dfa009f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:36.747764 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebaf5fa-592a-41b0-aa5a-be4b9dfa009f admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:36.765606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1240/2437] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:30:36.769184 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c630a-e113-44b1-8487-9a64da92c902 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:36.784138 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c630a-e113-44b1-8487-9a64da92c902 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:36.796100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1f866-6b28-4586-9c6e-f91c3c3e53bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:36.796955 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1f866-6b28-4586-9c6e-f91c3c3e53bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:36.797247 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1f866-6b28-4586-9c6e-f91c3c3e53bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:36.797539 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1f866-6b28-4586-9c6e-f91c3c3e53bf admin admin] PATH_INFO: `/v3/projects/1405982b068442afa131f24b5bff7b43/users/2a1dd150758745dfb81b48ed6b319f93/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:36.819465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1f866-6b28-4586-9c6e-f91c3c3e53bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1405982b068442afa131f24b5bff7b43, user_id=2a1dd150758745dfb81b48ed6b319f93, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:36.822254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1f866-6b28-4586-9c6e-f91c3c3e53bf admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:37.012806 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1198/2438] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:30:36 2022] PUT /identity/v3/projects/1405982b068442afa131f24b5bff7b43/users/2a1dd150758745dfb81b48ed6b319f93/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:30:37.013551 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebaf5fa-592a-41b0-aa5a-be4b9dfa009f admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:37.034493 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebaf5fa-592a-41b0-aa5a-be4b9dfa009f admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:37.056455 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:37.121249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83266d0c-9c7b-4cd0-be62-871cfeed3c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:37.122434 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83266d0c-9c7b-4cd0-be62-871cfeed3c4d admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:37.122925 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83266d0c-9c7b-4cd0-be62-871cfeed3c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:37.123351 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83266d0c-9c7b-4cd0-be62-871cfeed3c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:37.124690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83266d0c-9c7b-4cd0-be62-871cfeed3c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:37.126203 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83266d0c-9c7b-4cd0-be62-871cfeed3c4d admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:37.141939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1241/2439] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:30:37.146161 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1f866-6b28-4586-9c6e-f91c3c3e53bf admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:37.158927 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1f866-6b28-4586-9c6e-f91c3c3e53bf admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:37.170715 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9ce7a-b83b-4e67-8a5b-b877f656cb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:37.171470 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9ce7a-b83b-4e67-8a5b-b877f656cb0b admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:37.171758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9ce7a-b83b-4e67-8a5b-b877f656cb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:37.172102 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9ce7a-b83b-4e67-8a5b-b877f656cb0b admin admin] PATH_INFO: `/v3/projects/1405982b068442afa131f24b5bff7b43/users/2a1dd150758745dfb81b48ed6b319f93/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:37.174807 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9ce7a-b83b-4e67-8a5b-b877f656cb0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1405982b068442afa131f24b5bff7b43, user_id=2a1dd150758745dfb81b48ed6b319f93, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:37.178952 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9ce7a-b83b-4e67-8a5b-b877f656cb0b admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:37.193350 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1199/2440] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:30:37 2022] PUT /identity/v3/projects/1405982b068442afa131f24b5bff7b43/users/2a1dd150758745dfb81b48ed6b319f93/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:30:37.204951 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f0fdf-f0c2-4e20-bfba-6376c0e7bd43 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:37.205252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f0fdf-f0c2-4e20-bfba-6376c0e7bd43 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:37.205539 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f0fdf-f0c2-4e20-bfba-6376c0e7bd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:37.250203 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-7a5f0fdf-f0c2-4e20-bfba-6376c0e7bd43 None None] MFA Rules not processed for user `2a1dd150758745dfb81b48ed6b319f93`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:30:37.250203 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-7a5f0fdf-f0c2-4e20-bfba-6376c0e7bd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:37.355573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1242/2441] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:30:37 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:30:37.363021 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9ce7a-b83b-4e67-8a5b-b877f656cb0b admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:37.365367 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-77d9ce7a-b83b-4e67-8a5b-b877f656cb0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:37.469316 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9ce7a-b83b-4e67-8a5b-b877f656cb0b admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:37.474354 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed0726-3f7c-41a0-b68c-1880352db26a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:37.475524 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed0726-3f7c-41a0-b68c-1880352db26a service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:37.475524 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed0726-3f7c-41a0-b68c-1880352db26a service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:37.475710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed0726-3f7c-41a0-b68c-1880352db26a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:37.492746 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed0726-3f7c-41a0-b68c-1880352db26a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:37.495082 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed0726-3f7c-41a0-b68c-1880352db26a service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:37.510406 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1200/2442] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:30:37 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:30:37.836063 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f0fdf-f0c2-4e20-bfba-6376c0e7bd43 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:37.853172 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f0fdf-f0c2-4e20-bfba-6376c0e7bd43 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:37.860031 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f318a9d-06d1-48d7-b370-8e1b703b75b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:37.860673 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f318a9d-06d1-48d7-b370-8e1b703b75b9 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:37.860976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f318a9d-06d1-48d7-b370-8e1b703b75b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:37.861262 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f318a9d-06d1-48d7-b370-8e1b703b75b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:37.946712 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f318a9d-06d1-48d7-b370-8e1b703b75b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:37.948520 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f318a9d-06d1-48d7-b370-8e1b703b75b9 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:37.959974 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1243/2443] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:30:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:30:40.788546 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1910b-fb9b-4558-a0d1-dc42df2340e4 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:40.789186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1910b-fb9b-4558-a0d1-dc42df2340e4 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:40.789186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1910b-fb9b-4558-a0d1-dc42df2340e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:40.824354 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-66e1910b-fb9b-4558-a0d1-dc42df2340e4 None None] MFA Rules not processed for user `f45f65dd3a844cb583e42d837d2a58d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:30:40.825981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-66e1910b-fb9b-4558-a0d1-dc42df2340e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:40.908587 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1201/2444] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Sep 2 21:30:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:30:41.107460 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f318a9d-06d1-48d7-b370-8e1b703b75b9 service cinder] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:41.108927 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-6f318a9d-06d1-48d7-b370-8e1b703b75b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:41.168117 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:41.213116 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f318a9d-06d1-48d7-b370-8e1b703b75b9 service cinder] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:41.220101 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c96c6-f5e0-4e1d-8469-c98b3b683edc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da2b1dc9dae413a8ee63ad67e840f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:41.220758 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c96c6-f5e0-4e1d-8469-c98b3b683edc service swift] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:41.221051 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c96c6-f5e0-4e1d-8469-c98b3b683edc service swift] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:41.221362 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c96c6-f5e0-4e1d-8469-c98b3b683edc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:41.231158 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c96c6-f5e0-4e1d-8469-c98b3b683edc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:41.234064 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c96c6-f5e0-4e1d-8469-c98b3b683edc service swift] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:41.243134 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1244/2445] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Sep 2 21:30:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:30:50.901371 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=73,keystone:INSERT=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:51.313036 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=15 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:52.557642 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1910b-fb9b-4558-a0d1-dc42df2340e4 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:52.632410 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1910b-fb9b-4558-a0d1-dc42df2340e4 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:52.637830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44ae00-fccb-436a-9b19-65f251be51ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:52.638482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44ae00-fccb-436a-9b19-65f251be51ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:52.638760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44ae00-fccb-436a-9b19-65f251be51ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:52.639037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44ae00-fccb-436a-9b19-65f251be51ae admin admin] PATH_INFO: `/v3/users/f91cf8e5d13b451ba2a3e3857474bdd0` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:52.640198 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44ae00-fccb-436a-9b19-65f251be51ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=f91cf8e5d13b451ba2a3e3857474bdd0)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:52.642242 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44ae00-fccb-436a-9b19-65f251be51ae admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:53.226800 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-8b44ae00-fccb-436a-9b19-65f251be51ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f91cf8e5d13b451ba2a3e3857474bdd0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:53.228434 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-8b44ae00-fccb-436a-9b19-65f251be51ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f91cf8e5d13b451ba2a3e3857474bdd0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:53.238797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-8b44ae00-fccb-436a-9b19-65f251be51ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f91cf8e5d13b451ba2a3e3857474bdd0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:53.252418 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-8b44ae00-fccb-436a-9b19-65f251be51ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f91cf8e5d13b451ba2a3e3857474bdd0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:53.253502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-8b44ae00-fccb-436a-9b19-65f251be51ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f91cf8e5d13b451ba2a3e3857474bdd0'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:53.411421 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1202/2446] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:30:52 2022] DELETE /identity/v3/users/f91cf8e5d13b451ba2a3e3857474bdd0 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:30:53.421329 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be559749-2be9-4cbe-bbcb-2a8e8d378955 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:53.421329 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be559749-2be9-4cbe-bbcb-2a8e8d378955 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:53.421329 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be559749-2be9-4cbe-bbcb-2a8e8d378955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:53.449382 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-be559749-2be9-4cbe-bbcb-2a8e8d378955 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:30:53.450903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-be559749-2be9-4cbe-bbcb-2a8e8d378955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:53.544676 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1245/2447] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:30:53.554654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44ae00-fccb-436a-9b19-65f251be51ae admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:53.556247 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8b44ae00-fccb-436a-9b19-65f251be51ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:53.648246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44ae00-fccb-436a-9b19-65f251be51ae admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:53.652909 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c25e28-e2d2-494c-9ca4-de466f3e288c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:53.653792 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c25e28-e2d2-494c-9ca4-de466f3e288c service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:53.654151 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c25e28-e2d2-494c-9ca4-de466f3e288c service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:53.654484 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c25e28-e2d2-494c-9ca4-de466f3e288c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:53.664701 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c25e28-e2d2-494c-9ca4-de466f3e288c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:53.666101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c25e28-e2d2-494c-9ca4-de466f3e288c service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:53.678335 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1203/2448] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:30:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:30:54.682370 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be559749-2be9-4cbe-bbcb-2a8e8d378955 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:54.684622 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-be559749-2be9-4cbe-bbcb-2a8e8d378955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:54.700094 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be559749-2be9-4cbe-bbcb-2a8e8d378955 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:54.708263 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8a0b3-2dbf-4c82-b45c-0a8e455daf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:54.708489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8a0b3-2dbf-4c82-b45c-0a8e455daf5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:54.708780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8a0b3-2dbf-4c82-b45c-0a8e455daf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:54.709059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8a0b3-2dbf-4c82-b45c-0a8e455daf5f admin admin] PATH_INFO: `/v3/projects/e6982b8239ca40d7b02c399eefdebdbb` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:54.710321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8a0b3-2dbf-4c82-b45c-0a8e455daf5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6982b8239ca40d7b02c399eefdebdbb)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:54.714866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8a0b3-2dbf-4c82-b45c-0a8e455daf5f admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:54.862057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-85c8a0b3-2dbf-4c82-b45c-0a8e455daf5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6982b8239ca40d7b02c399eefdebdbb', 'request_id': 'req-85c8a0b3-2dbf-4c82-b45c-0a8e455daf5f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:54.869174 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-85c8a0b3-2dbf-4c82-b45c-0a8e455daf5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6982b8239ca40d7b02c399eefdebdbb', 'request_id': 'req-85c8a0b3-2dbf-4c82-b45c-0a8e455daf5f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:54.877443 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-85c8a0b3-2dbf-4c82-b45c-0a8e455daf5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6982b8239ca40d7b02c399eefdebdbb', 'request_id': 'req-85c8a0b3-2dbf-4c82-b45c-0a8e455daf5f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:54.970288 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-85c8a0b3-2dbf-4c82-b45c-0a8e455daf5f admin admin] The token cache is being invalidate because project e6982b8239ca40d7b02c399eefdebdbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:30:54.970507 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-85c8a0b3-2dbf-4c82-b45c-0a8e455daf5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:54.971188 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-85c8a0b3-2dbf-4c82-b45c-0a8e455daf5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:54.972747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1246/2449] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:30:54 2022] DELETE /identity/v3/projects/e6982b8239ca40d7b02c399eefdebdbb => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:30:54.977522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c25e28-e2d2-494c-9ca4-de466f3e288c service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:54.985847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:54.993870 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c25e28-e2d2-494c-9ca4-de466f3e288c service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:55.064779 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f04626-e1e4-4300-9518-9aa1344c5e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:55.065459 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f04626-e1e4-4300-9518-9aa1344c5e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:55.065787 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f04626-e1e4-4300-9518-9aa1344c5e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:55.066112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f04626-e1e4-4300-9518-9aa1344c5e26 admin admin] PATH_INFO: `/v3/users/2a1dd150758745dfb81b48ed6b319f93` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:55.067604 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f04626-e1e4-4300-9518-9aa1344c5e26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1dd150758745dfb81b48ed6b319f93)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:55.069343 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f04626-e1e4-4300-9518-9aa1344c5e26 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:55.361043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f0f04626-e1e4-4300-9518-9aa1344c5e26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1dd150758745dfb81b48ed6b319f93'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:55.362002 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f0f04626-e1e4-4300-9518-9aa1344c5e26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1dd150758745dfb81b48ed6b319f93'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:55.373761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f0f04626-e1e4-4300-9518-9aa1344c5e26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1dd150758745dfb81b48ed6b319f93'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:55.389396 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f0f04626-e1e4-4300-9518-9aa1344c5e26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1dd150758745dfb81b48ed6b319f93'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:55.390438 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f0f04626-e1e4-4300-9518-9aa1344c5e26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1dd150758745dfb81b48ed6b319f93'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:55.559345 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1204/2450] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:30:54 2022] DELETE /identity/v3/users/2a1dd150758745dfb81b48ed6b319f93 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:30:56.109043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8a0b3-2dbf-4c82-b45c-0a8e455daf5f admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:56.109043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-85c8a0b3-2dbf-4c82-b45c-0a8e455daf5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:56.126616 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8a0b3-2dbf-4c82-b45c-0a8e455daf5f admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:56.203955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac0efa-262c-4bf1-abe0-30e150b1d413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:56.204610 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac0efa-262c-4bf1-abe0-30e150b1d413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:56.204901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac0efa-262c-4bf1-abe0-30e150b1d413 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:56.205364 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac0efa-262c-4bf1-abe0-30e150b1d413 admin admin] PATH_INFO: `/v3/projects/1405982b068442afa131f24b5bff7b43` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:56.206597 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac0efa-262c-4bf1-abe0-30e150b1d413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1405982b068442afa131f24b5bff7b43)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:56.208715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac0efa-262c-4bf1-abe0-30e150b1d413 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:56.326010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:56.369706 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c8ac0efa-262c-4bf1-abe0-30e150b1d413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1405982b068442afa131f24b5bff7b43', 'request_id': 'req-c8ac0efa-262c-4bf1-abe0-30e150b1d413'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:56.371480 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c8ac0efa-262c-4bf1-abe0-30e150b1d413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1405982b068442afa131f24b5bff7b43', 'request_id': 'req-c8ac0efa-262c-4bf1-abe0-30e150b1d413'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:56.379495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c8ac0efa-262c-4bf1-abe0-30e150b1d413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1405982b068442afa131f24b5bff7b43', 'request_id': 'req-c8ac0efa-262c-4bf1-abe0-30e150b1d413'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:56.484541 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c8ac0efa-262c-4bf1-abe0-30e150b1d413 admin admin] The token cache is being invalidate because project 1405982b068442afa131f24b5bff7b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:30:56.484843 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c8ac0efa-262c-4bf1-abe0-30e150b1d413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:56.485620 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c8ac0efa-262c-4bf1-abe0-30e150b1d413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:30:56.487203 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1247/2451] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:30:56 2022] DELETE /identity/v3/projects/1405982b068442afa131f24b5bff7b43 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:30:56.492609 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e9dfb-da06-426f-9dea-bb029ba99096 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:56.493238 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e9dfb-da06-426f-9dea-bb029ba99096 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:56.493373 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e9dfb-da06-426f-9dea-bb029ba99096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:56.514223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-9f5e9dfb-da06-426f-9dea-bb029ba99096 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:30:56.515469 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-9f5e9dfb-da06-426f-9dea-bb029ba99096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:56.622889 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1205/2452] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:30:56.631287 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b2d68-bdf2-4e53-95d6-5cd673820f5d None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:56.631604 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b2d68-bdf2-4e53-95d6-5cd673820f5d None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:56.631902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b2d68-bdf2-4e53-95d6-5cd673820f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:56.658643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-337b2d68-bdf2-4e53-95d6-5cd673820f5d None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:30:56.660952 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-337b2d68-bdf2-4e53-95d6-5cd673820f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:56.677297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1248/2453] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:30:56.684638 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e9dfb-da06-426f-9dea-bb029ba99096 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:56.704557 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e9dfb-da06-426f-9dea-bb029ba99096 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:56.721522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ad474-156f-40ab-b412-3bda3a98fb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:56.722359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ad474-156f-40ab-b412-3bda3a98fb7a admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:56.722649 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ad474-156f-40ab-b412-3bda3a98fb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:56.722925 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ad474-156f-40ab-b412-3bda3a98fb7a admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:56.723625 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ad474-156f-40ab-b412-3bda3a98fb7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:30:56.723991 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ad474-156f-40ab-b412-3bda3a98fb7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:56.725648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ad474-156f-40ab-b412-3bda3a98fb7a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:56.750392 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1206/2454] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:30:56.752725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b2d68-bdf2-4e53-95d6-5cd673820f5d None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:56.769548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b2d68-bdf2-4e53-95d6-5cd673820f5d None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:56.775312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3ac8a-b4b4-4fb0-a405-b47cfa71f1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:56.775958 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3ac8a-b4b4-4fb0-a405-b47cfa71f1e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:56.776315 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3ac8a-b4b4-4fb0-a405-b47cfa71f1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:56.777059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3ac8a-b4b4-4fb0-a405-b47cfa71f1e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:56.778681 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3ac8a-b4b4-4fb0-a405-b47cfa71f1e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:56.780456 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3ac8a-b4b4-4fb0-a405-b47cfa71f1e3 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:56.893284 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1249/2455] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:30:56 2022] POST /identity/v3/projects => generated 369 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:30:56.898718 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ad474-156f-40ab-b412-3bda3a98fb7a admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:56.924565 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ad474-156f-40ab-b412-3bda3a98fb7a admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:56.930302 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:57.006888 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439062ef-8727-42b4-b9ba-45c8a2726b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:57.007510 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439062ef-8727-42b4-b9ba-45c8a2726b01 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:57.007795 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439062ef-8727-42b4-b9ba-45c8a2726b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:57.008098 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439062ef-8727-42b4-b9ba-45c8a2726b01 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:57.008820 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439062ef-8727-42b4-b9ba-45c8a2726b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:57.011540 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439062ef-8727-42b4-b9ba-45c8a2726b01 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:57.124769 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1207/2456] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:30:56 2022] POST /identity/v3/users => generated 285 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:30:57.128776 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3ac8a-b4b4-4fb0-a405-b47cfa71f1e3 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:57.144519 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3ac8a-b4b4-4fb0-a405-b47cfa71f1e3 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:57.162001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2464e-ce3a-413d-826e-afc5b0e69d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:57.162645 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2464e-ce3a-413d-826e-afc5b0e69d8e admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:57.162933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2464e-ce3a-413d-826e-afc5b0e69d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:57.163214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2464e-ce3a-413d-826e-afc5b0e69d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:57.163882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2464e-ce3a-413d-826e-afc5b0e69d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:57.165511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2464e-ce3a-413d-826e-afc5b0e69d8e admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:57.190444 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1250/2457] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:30:57.194985 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439062ef-8727-42b4-b9ba-45c8a2726b01 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:57.220558 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439062ef-8727-42b4-b9ba-45c8a2726b01 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:57.224210 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c47a42-a65c-46ce-89df-b4f8732fc036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:57.224859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c47a42-a65c-46ce-89df-b4f8732fc036 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:57.225141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c47a42-a65c-46ce-89df-b4f8732fc036 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:57.225425 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c47a42-a65c-46ce-89df-b4f8732fc036 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:57.226189 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c47a42-a65c-46ce-89df-b4f8732fc036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:57.227809 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c47a42-a65c-46ce-89df-b4f8732fc036 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:57.241435 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1208/2458] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:30:57.245330 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2464e-ce3a-413d-826e-afc5b0e69d8e admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:57.259987 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2464e-ce3a-413d-826e-afc5b0e69d8e admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:57.265383 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a5a97-ee08-4210-b769-692cffa7dcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:57.265959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a5a97-ee08-4210-b769-692cffa7dcbd admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:57.266476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a5a97-ee08-4210-b769-692cffa7dcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:57.266740 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a5a97-ee08-4210-b769-692cffa7dcbd admin admin] PATH_INFO: `/v3/projects/2c2cb83b345e4bb098077423f2641ec0/users/456bd7a527494134bb4ce01e630b3ca4/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:57.288548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a5a97-ee08-4210-b769-692cffa7dcbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c2cb83b345e4bb098077423f2641ec0, user_id=456bd7a527494134bb4ce01e630b3ca4, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:57.291350 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a5a97-ee08-4210-b769-692cffa7dcbd admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:57.374239 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1251/2459] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:30:57 2022] PUT /identity/v3/projects/2c2cb83b345e4bb098077423f2641ec0/users/456bd7a527494134bb4ce01e630b3ca4/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:30:57.386371 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0f928-49cf-44ca-8555-1bb1cf8ac826 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:57.386838 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0f928-49cf-44ca-8555-1bb1cf8ac826 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:57.387169 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0f928-49cf-44ca-8555-1bb1cf8ac826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:57.419983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-3ee0f928-49cf-44ca-8555-1bb1cf8ac826 None None] MFA Rules not processed for user `456bd7a527494134bb4ce01e630b3ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:30:57.421375 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-3ee0f928-49cf-44ca-8555-1bb1cf8ac826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:57.510352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1209/2460] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:30:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:30:57.516339 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a5a97-ee08-4210-b769-692cffa7dcbd admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:57.599699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a5a97-ee08-4210-b769-692cffa7dcbd admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:57.606634 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3191e3-4822-4c53-a7fd-f76ed74badd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:57.607274 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3191e3-4822-4c53-a7fd-f76ed74badd5 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:57.607560 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3191e3-4822-4c53-a7fd-f76ed74badd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:57.607839 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3191e3-4822-4c53-a7fd-f76ed74badd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:57.608511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3191e3-4822-4c53-a7fd-f76ed74badd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:57.610562 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3191e3-4822-4c53-a7fd-f76ed74badd5 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:57.724492 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1252/2461] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:30:57 2022] POST /identity/v3/projects => generated 369 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:30:57.729121 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0f928-49cf-44ca-8555-1bb1cf8ac826 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:57.741573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0f928-49cf-44ca-8555-1bb1cf8ac826 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:57.817119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d963b68-5f26-4f99-8682-433c78fc9e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:57.817760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d963b68-5f26-4f99-8682-433c78fc9e1a admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:57.818082 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d963b68-5f26-4f99-8682-433c78fc9e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:57.818368 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d963b68-5f26-4f99-8682-433c78fc9e1a admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:57.819036 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d963b68-5f26-4f99-8682-433c78fc9e1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:57.821017 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d963b68-5f26-4f99-8682-433c78fc9e1a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:57.944513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1210/2462] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:30:57 2022] POST /identity/v3/users => generated 291 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:30:57.948357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3191e3-4822-4c53-a7fd-f76ed74badd5 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:57.959846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3191e3-4822-4c53-a7fd-f76ed74badd5 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:57.966647 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1847dd-4201-4010-9f55-0d69bb820933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:57.972577 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1847dd-4201-4010-9f55-0d69bb820933 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:57.972577 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1847dd-4201-4010-9f55-0d69bb820933 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:57.972577 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1847dd-4201-4010-9f55-0d69bb820933 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:57.972577 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1847dd-4201-4010-9f55-0d69bb820933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:57.974159 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1847dd-4201-4010-9f55-0d69bb820933 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:57.994084 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1253/2463] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:30:57.996472 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d963b68-5f26-4f99-8682-433c78fc9e1a admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:58.011333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d963b68-5f26-4f99-8682-433c78fc9e1a admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:58.017514 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7797511-bab2-4471-86d5-c20c6db8d7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:58.018309 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7797511-bab2-4471-86d5-c20c6db8d7ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:58.018674 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7797511-bab2-4471-86d5-c20c6db8d7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:58.019026 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7797511-bab2-4471-86d5-c20c6db8d7ad admin admin] PATH_INFO: `/v3/projects/06d3a41b3c024cf8a4396a15b790ddf9/users/0524e121e7644cd0b84ce65aa9021f17/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:58.024023 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:58.051560 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7797511-bab2-4471-86d5-c20c6db8d7ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d3a41b3c024cf8a4396a15b790ddf9, user_id=0524e121e7644cd0b84ce65aa9021f17, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:58.054506 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7797511-bab2-4471-86d5-c20c6db8d7ad admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:58.147553 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1211/2464] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:30:57 2022] PUT /identity/v3/projects/06d3a41b3c024cf8a4396a15b790ddf9/users/0524e121e7644cd0b84ce65aa9021f17/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:30:58.156002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1847dd-4201-4010-9f55-0d69bb820933 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:58.167929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1847dd-4201-4010-9f55-0d69bb820933 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:58.199217 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:58.249985 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eda9c3-2e92-4b66-8d37-dcc3269c9199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:58.250882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eda9c3-2e92-4b66-8d37-dcc3269c9199 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:58.251369 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eda9c3-2e92-4b66-8d37-dcc3269c9199 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:58.251728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eda9c3-2e92-4b66-8d37-dcc3269c9199 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:58.252555 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eda9c3-2e92-4b66-8d37-dcc3269c9199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:58.254868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eda9c3-2e92-4b66-8d37-dcc3269c9199 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:58.267098 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1254/2465] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:30:58.271123 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7797511-bab2-4471-86d5-c20c6db8d7ad admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:58.283421 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7797511-bab2-4471-86d5-c20c6db8d7ad admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:58.288841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f7ccc-18b8-4beb-b3f8-3512e71000bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:58.289548 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f7ccc-18b8-4beb-b3f8-3512e71000bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:58.289863 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f7ccc-18b8-4beb-b3f8-3512e71000bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:58.290183 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f7ccc-18b8-4beb-b3f8-3512e71000bd admin admin] PATH_INFO: `/v3/projects/06d3a41b3c024cf8a4396a15b790ddf9/users/0524e121e7644cd0b84ce65aa9021f17/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:58.292821 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f7ccc-18b8-4beb-b3f8-3512e71000bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d3a41b3c024cf8a4396a15b790ddf9, user_id=0524e121e7644cd0b84ce65aa9021f17, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:58.295619 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f7ccc-18b8-4beb-b3f8-3512e71000bd admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:58.308991 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1212/2466] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:30:58 2022] PUT /identity/v3/projects/06d3a41b3c024cf8a4396a15b790ddf9/users/0524e121e7644cd0b84ce65aa9021f17/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:30:58.321639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5011d-02a0-4e6c-83f3-f01168e93fdb None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:58.323455 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5011d-02a0-4e6c-83f3-f01168e93fdb None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:58.323455 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5011d-02a0-4e6c-83f3-f01168e93fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:58.355803 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-fae5011d-02a0-4e6c-83f3-f01168e93fdb None None] MFA Rules not processed for user `0524e121e7644cd0b84ce65aa9021f17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:30:58.357125 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-fae5011d-02a0-4e6c-83f3-f01168e93fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:58.438431 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1255/2467] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:30:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:30:58.451129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f7ccc-18b8-4beb-b3f8-3512e71000bd admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:58.452834 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-407f7ccc-18b8-4beb-b3f8-3512e71000bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:58.546405 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f7ccc-18b8-4beb-b3f8-3512e71000bd admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:58.551673 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6455b-dad1-4f17-b3ba-53cb6df5500d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:58.552597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6455b-dad1-4f17-b3ba-53cb6df5500d service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:58.552938 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6455b-dad1-4f17-b3ba-53cb6df5500d service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:58.553317 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6455b-dad1-4f17-b3ba-53cb6df5500d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:58.566366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6455b-dad1-4f17-b3ba-53cb6df5500d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:58.567808 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6455b-dad1-4f17-b3ba-53cb6df5500d service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:58.578677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1213/2468] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:30:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:30:59.482952 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5011d-02a0-4e6c-83f3-f01168e93fdb None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:59.486094 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-fae5011d-02a0-4e6c-83f3-f01168e93fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:59.616744 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5011d-02a0-4e6c-83f3-f01168e93fdb None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:59.627698 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1f0e3-218a-4d1e-b055-425c9bdf4c7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0f9604ee2e43b4967cbdc779e63e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:59.629028 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1f0e3-218a-4d1e-b055-425c9bdf4c7c service placement] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:59.629498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1f0e3-218a-4d1e-b055-425c9bdf4c7c service placement] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:59.629996 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1f0e3-218a-4d1e-b055-425c9bdf4c7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:59.632964 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-def1f0e3-218a-4d1e-b055-425c9bdf4c7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:59.653001 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6455b-dad1-4f17-b3ba-53cb6df5500d service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:59.653617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1f0e3-218a-4d1e-b055-425c9bdf4c7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:59.654617 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-9ef6455b-dad1-4f17-b3ba-53cb6df5500d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:30:59.655567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1f0e3-218a-4d1e-b055-425c9bdf4c7c service placement] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:59.667332 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1256/2469] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:30:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:30:59.677878 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6455b-dad1-4f17-b3ba-53cb6df5500d service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:59.681498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9c6c4-ffcf-411c-937b-c5a6cf9bba0d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0f9604ee2e43b4967cbdc779e63e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:59.682154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9c6c4-ffcf-411c-937b-c5a6cf9bba0d service placement] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:59.683045 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9c6c4-ffcf-411c-937b-c5a6cf9bba0d service placement] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:59.683468 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9c6c4-ffcf-411c-937b-c5a6cf9bba0d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:59.697090 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9c6c4-ffcf-411c-937b-c5a6cf9bba0d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:59.699518 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9c6c4-ffcf-411c-937b-c5a6cf9bba0d service placement] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:30:59.711586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1214/2470] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:30:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:30:59.741773 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1f0e3-218a-4d1e-b055-425c9bdf4c7c service placement] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:30:59.770771 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:59.834704 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1f0e3-218a-4d1e-b055-425c9bdf4c7c service placement] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:30:59.842488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312d3ea-0154-4b6c-b4a2-3fb7408968ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:30:59.843129 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312d3ea-0154-4b6c-b4a2-3fb7408968ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:30:59.843418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312d3ea-0154-4b6c-b4a2-3fb7408968ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:30:59.843693 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312d3ea-0154-4b6c-b4a2-3fb7408968ac admin admin] PATH_INFO: `/v3/users/456bd7a527494134bb4ce01e630b3ca4` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:30:59.844897 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312d3ea-0154-4b6c-b4a2-3fb7408968ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=456bd7a527494134bb4ce01e630b3ca4)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:30:59.847027 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312d3ea-0154-4b6c-b4a2-3fb7408968ac admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:00.041479 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-8312d3ea-0154-4b6c-b4a2-3fb7408968ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '456bd7a527494134bb4ce01e630b3ca4'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:00.042566 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-8312d3ea-0154-4b6c-b4a2-3fb7408968ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '456bd7a527494134bb4ce01e630b3ca4'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:00.055698 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-8312d3ea-0154-4b6c-b4a2-3fb7408968ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '456bd7a527494134bb4ce01e630b3ca4'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:00.063834 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-8312d3ea-0154-4b6c-b4a2-3fb7408968ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '456bd7a527494134bb4ce01e630b3ca4'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:00.064943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-8312d3ea-0154-4b6c-b4a2-3fb7408968ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '456bd7a527494134bb4ce01e630b3ca4'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:00.158645 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1257/2471] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:30:59 2022] DELETE /identity/v3/users/456bd7a527494134bb4ce01e630b3ca4 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:31:00.163949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad436890-bd07-44c8-9ffe-6cf8d2ec47ce None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:00.164256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad436890-bd07-44c8-9ffe-6cf8d2ec47ce None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:00.164570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad436890-bd07-44c8-9ffe-6cf8d2ec47ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:00.185714 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-ad436890-bd07-44c8-9ffe-6cf8d2ec47ce None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:00.186955 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ad436890-bd07-44c8-9ffe-6cf8d2ec47ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:00.262159 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1215/2472] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:31:00.272323 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312d3ea-0154-4b6c-b4a2-3fb7408968ac admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:00.280638 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-8312d3ea-0154-4b6c-b4a2-3fb7408968ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:00.335399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312d3ea-0154-4b6c-b4a2-3fb7408968ac admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:00.339695 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a842c-eccb-4837-97c9-0c674afe0f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:00.340317 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a842c-eccb-4837-97c9-0c674afe0f96 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:00.340593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a842c-eccb-4837-97c9-0c674afe0f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:00.340865 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a842c-eccb-4837-97c9-0c674afe0f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:00.351529 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a842c-eccb-4837-97c9-0c674afe0f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:00.352987 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a842c-eccb-4837-97c9-0c674afe0f96 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:00.364561 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1258/2473] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:31:00.925392 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad436890-bd07-44c8-9ffe-6cf8d2ec47ce None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:00.926817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ad436890-bd07-44c8-9ffe-6cf8d2ec47ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:00.942014 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad436890-bd07-44c8-9ffe-6cf8d2ec47ce None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:00.948766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96eea6-03fb-4dcc-b35d-ed6e2ed64b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:00.949800 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96eea6-03fb-4dcc-b35d-ed6e2ed64b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:00.950166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96eea6-03fb-4dcc-b35d-ed6e2ed64b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:00.950568 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96eea6-03fb-4dcc-b35d-ed6e2ed64b98 admin admin] PATH_INFO: `/v3/projects/2c2cb83b345e4bb098077423f2641ec0` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:00.952002 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96eea6-03fb-4dcc-b35d-ed6e2ed64b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c2cb83b345e4bb098077423f2641ec0)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:00.954139 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96eea6-03fb-4dcc-b35d-ed6e2ed64b98 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:01.114324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:01.125130 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-9e96eea6-03fb-4dcc-b35d-ed6e2ed64b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c2cb83b345e4bb098077423f2641ec0', 'request_id': 'req-9e96eea6-03fb-4dcc-b35d-ed6e2ed64b98'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:01.131771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-9e96eea6-03fb-4dcc-b35d-ed6e2ed64b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c2cb83b345e4bb098077423f2641ec0', 'request_id': 'req-9e96eea6-03fb-4dcc-b35d-ed6e2ed64b98'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:01.139950 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-9e96eea6-03fb-4dcc-b35d-ed6e2ed64b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c2cb83b345e4bb098077423f2641ec0', 'request_id': 'req-9e96eea6-03fb-4dcc-b35d-ed6e2ed64b98'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:01.249615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-9e96eea6-03fb-4dcc-b35d-ed6e2ed64b98 admin admin] The token cache is being invalidate because project 2c2cb83b345e4bb098077423f2641ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:31:01.250094 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-9e96eea6-03fb-4dcc-b35d-ed6e2ed64b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:01.250837 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-9e96eea6-03fb-4dcc-b35d-ed6e2ed64b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:01.252734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1216/2474] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:31:00 2022] DELETE /identity/v3/projects/2c2cb83b345e4bb098077423f2641ec0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:01.258194 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a842c-eccb-4837-97c9-0c674afe0f96 service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:01.273544 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a842c-eccb-4837-97c9-0c674afe0f96 service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:01.327817 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:01.360499 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb4ef6-84e7-44d5-aa29-18182b53178f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:01.364375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb4ef6-84e7-44d5-aa29-18182b53178f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:01.364375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb4ef6-84e7-44d5-aa29-18182b53178f admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:01.364375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb4ef6-84e7-44d5-aa29-18182b53178f admin admin] PATH_INFO: `/v3/users/0524e121e7644cd0b84ce65aa9021f17` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:01.364375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb4ef6-84e7-44d5-aa29-18182b53178f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0524e121e7644cd0b84ce65aa9021f17)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:01.365213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb4ef6-84e7-44d5-aa29-18182b53178f admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:01.716222 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-36eb4ef6-84e7-44d5-aa29-18182b53178f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0524e121e7644cd0b84ce65aa9021f17'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:01.717215 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-36eb4ef6-84e7-44d5-aa29-18182b53178f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0524e121e7644cd0b84ce65aa9021f17'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:01.734261 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-36eb4ef6-84e7-44d5-aa29-18182b53178f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0524e121e7644cd0b84ce65aa9021f17'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:01.743501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-36eb4ef6-84e7-44d5-aa29-18182b53178f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0524e121e7644cd0b84ce65aa9021f17'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:01.744361 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-36eb4ef6-84e7-44d5-aa29-18182b53178f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0524e121e7644cd0b84ce65aa9021f17'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:01.881417 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1259/2475] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:31:01 2022] DELETE /identity/v3/users/0524e121e7644cd0b84ce65aa9021f17 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:02.641603 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96eea6-03fb-4dcc-b35d-ed6e2ed64b98 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:02.643629 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-9e96eea6-03fb-4dcc-b35d-ed6e2ed64b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:02.664144 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96eea6-03fb-4dcc-b35d-ed6e2ed64b98 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:02.733999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359c479-a80e-4980-9ab6-a81e7544d17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:02.734729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359c479-a80e-4980-9ab6-a81e7544d17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:02.735086 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359c479-a80e-4980-9ab6-a81e7544d17c admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:02.735437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359c479-a80e-4980-9ab6-a81e7544d17c admin admin] PATH_INFO: `/v3/projects/06d3a41b3c024cf8a4396a15b790ddf9` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:02.736662 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359c479-a80e-4980-9ab6-a81e7544d17c admin admin] RBAC: Authorizing `identity:delete_project(project_id=06d3a41b3c024cf8a4396a15b790ddf9)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:02.738952 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359c479-a80e-4980-9ab6-a81e7544d17c admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:02.866551 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-0359c479-a80e-4980-9ab6-a81e7544d17c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d3a41b3c024cf8a4396a15b790ddf9', 'request_id': 'req-0359c479-a80e-4980-9ab6-a81e7544d17c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:02.873289 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-0359c479-a80e-4980-9ab6-a81e7544d17c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d3a41b3c024cf8a4396a15b790ddf9', 'request_id': 'req-0359c479-a80e-4980-9ab6-a81e7544d17c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:02.879831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-0359c479-a80e-4980-9ab6-a81e7544d17c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d3a41b3c024cf8a4396a15b790ddf9', 'request_id': 'req-0359c479-a80e-4980-9ab6-a81e7544d17c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:02.991045 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-0359c479-a80e-4980-9ab6-a81e7544d17c admin admin] The token cache is being invalidate because project 06d3a41b3c024cf8a4396a15b790ddf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:31:02.991330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-0359c479-a80e-4980-9ab6-a81e7544d17c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:02.994172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-0359c479-a80e-4980-9ab6-a81e7544d17c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:02.994172 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1217/2476] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:31:02 2022] DELETE /identity/v3/projects/06d3a41b3c024cf8a4396a15b790ddf9 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:02.998781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a56a0-1c62-499d-a42b-16913b9c31d6 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:02.999247 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a56a0-1c62-499d-a42b-16913b9c31d6 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:02.999341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a56a0-1c62-499d-a42b-16913b9c31d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:03.020010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-741a56a0-1c62-499d-a42b-16913b9c31d6 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:03.021234 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-741a56a0-1c62-499d-a42b-16913b9c31d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:03.082644 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1260/2477] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:03.091717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fa085-b969-41ee-b0de-e8593078874b None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:03.092009 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fa085-b969-41ee-b0de-e8593078874b None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:03.092292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fa085-b969-41ee-b0de-e8593078874b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:03.114739 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-7e1fa085-b969-41ee-b0de-e8593078874b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:03.120709 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-7e1fa085-b969-41ee-b0de-e8593078874b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:03.125008 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1218/2478] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:03.129766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a56a0-1c62-499d-a42b-16913b9c31d6 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:03.140716 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a56a0-1c62-499d-a42b-16913b9c31d6 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:03.145422 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ea432-f0cf-425e-b9ab-39fa93f3c49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:03.146312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ea432-f0cf-425e-b9ab-39fa93f3c49e admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:03.146574 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ea432-f0cf-425e-b9ab-39fa93f3c49e admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:03.146896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ea432-f0cf-425e-b9ab-39fa93f3c49e admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:03.147543 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ea432-f0cf-425e-b9ab-39fa93f3c49e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:31:03.147856 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ea432-f0cf-425e-b9ab-39fa93f3c49e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:03.149474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ea432-f0cf-425e-b9ab-39fa93f3c49e admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:03.163158 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1261/2479] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:31:03.168092 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fa085-b969-41ee-b0de-e8593078874b None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:03.177956 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fa085-b969-41ee-b0de-e8593078874b None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:03.183816 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb9954-a9d1-4783-aa09-ff8622c91b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:03.184474 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb9954-a9d1-4783-aa09-ff8622c91b3a admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:03.184761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb9954-a9d1-4783-aa09-ff8622c91b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:03.185040 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb9954-a9d1-4783-aa09-ff8622c91b3a admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:03.185687 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb9954-a9d1-4783-aa09-ff8622c91b3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:03.187653 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb9954-a9d1-4783-aa09-ff8622c91b3a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:03.360249 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1219/2480] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:31:03 2022] POST /identity/v3/projects => generated 367 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:31:03.364577 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ea432-f0cf-425e-b9ab-39fa93f3c49e admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:03.377017 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ea432-f0cf-425e-b9ab-39fa93f3c49e admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:03.434665 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:03.452303 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c578f58-dfb3-4c14-b571-b07c362d1fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:03.452953 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c578f58-dfb3-4c14-b571-b07c362d1fce admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:03.453236 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c578f58-dfb3-4c14-b571-b07c362d1fce admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:03.453507 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c578f58-dfb3-4c14-b571-b07c362d1fce admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:03.454185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c578f58-dfb3-4c14-b571-b07c362d1fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:03.456485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c578f58-dfb3-4c14-b571-b07c362d1fce admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:03.609308 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1262/2481] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:31:03 2022] POST /identity/v3/users => generated 284 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:31:03.613519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb9954-a9d1-4783-aa09-ff8622c91b3a admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:03.624668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb9954-a9d1-4783-aa09-ff8622c91b3a admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:03.646793 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871fb32-3607-40b0-adc6-2f1912a722c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:03.646793 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871fb32-3607-40b0-adc6-2f1912a722c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:03.646793 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871fb32-3607-40b0-adc6-2f1912a722c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:03.646793 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871fb32-3607-40b0-adc6-2f1912a722c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:03.647850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871fb32-3607-40b0-adc6-2f1912a722c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:03.647850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871fb32-3607-40b0-adc6-2f1912a722c0 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:03.652425 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1220/2482] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:31:03.654282 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c578f58-dfb3-4c14-b571-b07c362d1fce admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:03.664926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c578f58-dfb3-4c14-b571-b07c362d1fce admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:03.670635 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ffc76-14b2-4780-b5a1-bdd9f178c3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:03.671281 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ffc76-14b2-4780-b5a1-bdd9f178c3cc admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:03.671563 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ffc76-14b2-4780-b5a1-bdd9f178c3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:03.671847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ffc76-14b2-4780-b5a1-bdd9f178c3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:03.672499 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ffc76-14b2-4780-b5a1-bdd9f178c3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:03.674173 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ffc76-14b2-4780-b5a1-bdd9f178c3cc admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:03.689914 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1263/2483] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:31:03.695787 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871fb32-3607-40b0-adc6-2f1912a722c0 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:03.713471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871fb32-3607-40b0-adc6-2f1912a722c0 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:03.719190 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806491d-a721-44c2-9625-98e37c599096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:03.719723 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806491d-a721-44c2-9625-98e37c599096 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:03.720006 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806491d-a721-44c2-9625-98e37c599096 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:03.720333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806491d-a721-44c2-9625-98e37c599096 admin admin] PATH_INFO: `/v3/projects/318bafbcde0944868bfb29b3fd545622/users/215e487e421a4f9fa8c2fb8bfaf37705/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:03.736171 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:03.741096 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806491d-a721-44c2-9625-98e37c599096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=318bafbcde0944868bfb29b3fd545622, user_id=215e487e421a4f9fa8c2fb8bfaf37705, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:03.743789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806491d-a721-44c2-9625-98e37c599096 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:03.916954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1221/2484] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:31:03 2022] PUT /identity/v3/projects/318bafbcde0944868bfb29b3fd545622/users/215e487e421a4f9fa8c2fb8bfaf37705/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:03.919405 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d6663-b264-48f7-a4a8-b099f9fb1101 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:03.919695 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d6663-b264-48f7-a4a8-b099f9fb1101 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:03.919974 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d6663-b264-48f7-a4a8-b099f9fb1101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:03.950557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-b34d6663-b264-48f7-a4a8-b099f9fb1101 None None] MFA Rules not processed for user `215e487e421a4f9fa8c2fb8bfaf37705`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:03.951970 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b34d6663-b264-48f7-a4a8-b099f9fb1101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:04.025265 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d1ca1-ccdb-4202-88a5-0c81ec3ee855 None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:04.025265 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d1ca1-ccdb-4202-88a5-0c81ec3ee855 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:04.025265 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d1ca1-ccdb-4202-88a5-0c81ec3ee855 None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:04.025265 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1222/2485] 10.222.0.79 () {54 vars in 921 bytes} [Fri Sep 2 21:31:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:31:04.025784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1264/2486] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:04.031442 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d1ca1-ccdb-4202-88a5-0c81ec3ee855 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:04.033667 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bf79e-6ac6-4167-8e17-2d7a46f079e2 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:04.034141 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bf79e-6ac6-4167-8e17-2d7a46f079e2 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:04.034778 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bf79e-6ac6-4167-8e17-2d7a46f079e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:04.074268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-644bf79e-6ac6-4167-8e17-2d7a46f079e2 None None] MFA Rules not processed for user `632071470f7d409ab7b0129d120320c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:04.075788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-644bf79e-6ac6-4167-8e17-2d7a46f079e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:04.137135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d1ca1-ccdb-4202-88a5-0c81ec3ee855 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:04.144532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cad2b9-34e6-4251-93d1-893e6fb66b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:04.145557 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cad2b9-34e6-4251-93d1-893e6fb66b60 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:04.145862 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cad2b9-34e6-4251-93d1-893e6fb66b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:04.146208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cad2b9-34e6-4251-93d1-893e6fb66b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:04.146879 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cad2b9-34e6-4251-93d1-893e6fb66b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:04.148810 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cad2b9-34e6-4251-93d1-893e6fb66b60 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:04.211494 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1265/2487] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Sep 2 21:31:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:04.224130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644bf79e-6ac6-4167-8e17-2d7a46f079e2 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:04.225597 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-644bf79e-6ac6-4167-8e17-2d7a46f079e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:04.289632 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644bf79e-6ac6-4167-8e17-2d7a46f079e2 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:04.293965 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74935f94-8163-4ef4-8507-f7ace19823b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72840602ec264a74855b601c8d1ddf89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:04.294595 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74935f94-8163-4ef4-8507-f7ace19823b2 service glance] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:04.294879 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74935f94-8163-4ef4-8507-f7ace19823b2 service glance] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:04.295158 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74935f94-8163-4ef4-8507-f7ace19823b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:04.306480 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74935f94-8163-4ef4-8507-f7ace19823b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:04.308004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74935f94-8163-4ef4-8507-f7ace19823b2 service glance] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:04.320167 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1266/2488] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:31:04.332944 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1223/2489] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:31:04 2022] POST /identity/v3/projects => generated 363 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:31:04.337075 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74935f94-8163-4ef4-8507-f7ace19823b2 service glance] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:04.348704 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74935f94-8163-4ef4-8507-f7ace19823b2 service glance] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:04.416139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4041e69-70cf-4293-ae0f-1c0a178c11c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:04.422821 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4041e69-70cf-4293-ae0f-1c0a178c11c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:04.422821 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4041e69-70cf-4293-ae0f-1c0a178c11c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:04.422821 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4041e69-70cf-4293-ae0f-1c0a178c11c4 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:04.422821 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4041e69-70cf-4293-ae0f-1c0a178c11c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:04.422821 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4041e69-70cf-4293-ae0f-1c0a178c11c4 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:04.535831 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1267/2490] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:31:04 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:31:04.537046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cad2b9-34e6-4251-93d1-893e6fb66b60 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:04.551329 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cad2b9-34e6-4251-93d1-893e6fb66b60 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:04.556347 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7db946-0160-483b-88c7-31257ec9df59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:04.556980 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7db946-0160-483b-88c7-31257ec9df59 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:04.557272 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7db946-0160-483b-88c7-31257ec9df59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:04.557633 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7db946-0160-483b-88c7-31257ec9df59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:04.558434 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7db946-0160-483b-88c7-31257ec9df59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:04.560044 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7db946-0160-483b-88c7-31257ec9df59 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:04.570662 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1224/2491] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:31:04.576110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4041e69-70cf-4293-ae0f-1c0a178c11c4 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:04.582795 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87cf60-f68d-4a32-99e3-9648a81f87fa None None] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:04.584777 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87cf60-f68d-4a32-99e3-9648a81f87fa None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:04.584777 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87cf60-f68d-4a32-99e3-9648a81f87fa None None] PATH_INFO: `/` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:04.584777 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1225/2492] 10.222.0.79 () {54 vars in 921 bytes} [Fri Sep 2 21:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:31:04.586635 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4041e69-70cf-4293-ae0f-1c0a178c11c4 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:04.590465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98376fb7-04fb-4bac-9549-4d022d534230 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:04.590752 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98376fb7-04fb-4bac-9549-4d022d534230 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:04.591030 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98376fb7-04fb-4bac-9549-4d022d534230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:04.592567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af7f0c-ebac-4269-9d2a-af8bbde87117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:04.593247 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af7f0c-ebac-4269-9d2a-af8bbde87117 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:04.593535 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af7f0c-ebac-4269-9d2a-af8bbde87117 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:04.593963 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af7f0c-ebac-4269-9d2a-af8bbde87117 admin admin] PATH_INFO: `/v3/projects/9d29bc0e05ae4a28bef0df1b9d3e19aa/users/9d1cc5870acb4450ab9d93ec806e6549/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:04.610908 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af7f0c-ebac-4269-9d2a-af8bbde87117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d29bc0e05ae4a28bef0df1b9d3e19aa, user_id=9d1cc5870acb4450ab9d93ec806e6549, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:04.612355 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-98376fb7-04fb-4bac-9549-4d022d534230 None None] MFA Rules not processed for user `aefaf6998acc4434aab62b9625bd25fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:04.613581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-98376fb7-04fb-4bac-9549-4d022d534230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:04.613725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af7f0c-ebac-4269-9d2a-af8bbde87117 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:04.671106 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1226/2493] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Sep 2 21:31:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:31:04.692556 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98376fb7-04fb-4bac-9549-4d022d534230 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:04.694083 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-98376fb7-04fb-4bac-9549-4d022d534230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:04.708676 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98376fb7-04fb-4bac-9549-4d022d534230 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:04.714484 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c27f7-2ee3-461e-881a-218cccd93d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:04.718395 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c27f7-2ee3-461e-881a-218cccd93d6c service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:04.718395 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c27f7-2ee3-461e-881a-218cccd93d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:04.718395 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c27f7-2ee3-461e-881a-218cccd93d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:04.723966 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c27f7-2ee3-461e-881a-218cccd93d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:04.725358 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c27f7-2ee3-461e-881a-218cccd93d6c service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:04.733790 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1227/2494] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:31:04.770790 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1268/2495] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:31:04 2022] PUT /identity/v3/projects/9d29bc0e05ae4a28bef0df1b9d3e19aa/users/9d1cc5870acb4450ab9d93ec806e6549/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:04.775006 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c27f7-2ee3-461e-881a-218cccd93d6c service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:04.787333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c27f7-2ee3-461e-881a-218cccd93d6c service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:04.832356 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9af5d-2834-4302-b3ed-fd243abfe076 None None] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:04.833393 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9af5d-2834-4302-b3ed-fd243abfe076 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:04.833917 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9af5d-2834-4302-b3ed-fd243abfe076 None None] PATH_INFO: `/` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:04.840634 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1269/2496] 10.222.0.79 () {54 vars in 921 bytes} [Fri Sep 2 21:31:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 02 21:31:04.844433 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d265c-c594-4fa3-8a70-fc275fe9c8b1 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:04.844893 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d265c-c594-4fa3-8a70-fc275fe9c8b1 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:04.845273 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d265c-c594-4fa3-8a70-fc275fe9c8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:04.868836 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-731d265c-c594-4fa3-8a70-fc275fe9c8b1 None None] MFA Rules not processed for user `632071470f7d409ab7b0129d120320c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:04.882044 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-731d265c-c594-4fa3-8a70-fc275fe9c8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:04.882275 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d73ec-e7f5-406f-a943-ce3afec4fc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:04.882275 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d73ec-e7f5-406f-a943-ce3afec4fc51 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:04.882275 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d73ec-e7f5-406f-a943-ce3afec4fc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:04.882275 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d73ec-e7f5-406f-a943-ce3afec4fc51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:04.882917 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d73ec-e7f5-406f-a943-ce3afec4fc51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:04.884337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d73ec-e7f5-406f-a943-ce3afec4fc51 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:04.897135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1228/2497] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:31:04.903044 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d73ec-e7f5-406f-a943-ce3afec4fc51 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:04.913046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d73ec-e7f5-406f-a943-ce3afec4fc51 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:04.919262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0e62d-47a5-4c6d-9507-2073bab6d80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:04.919923 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0e62d-47a5-4c6d-9507-2073bab6d80b admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:04.920306 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0e62d-47a5-4c6d-9507-2073bab6d80b admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:04.920494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0e62d-47a5-4c6d-9507-2073bab6d80b admin admin] PATH_INFO: `/v3/projects/9d29bc0e05ae4a28bef0df1b9d3e19aa/users/9d1cc5870acb4450ab9d93ec806e6549/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:04.922914 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0e62d-47a5-4c6d-9507-2073bab6d80b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d29bc0e05ae4a28bef0df1b9d3e19aa, user_id=9d1cc5870acb4450ab9d93ec806e6549, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:04.925566 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0e62d-47a5-4c6d-9507-2073bab6d80b admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:04.944475 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1229/2498] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:31:04 2022] PUT /identity/v3/projects/9d29bc0e05ae4a28bef0df1b9d3e19aa/users/9d1cc5870acb4450ab9d93ec806e6549/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:04.946870 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1270/2499] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Sep 2 21:31:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:31:04.959057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d265c-c594-4fa3-8a70-fc275fe9c8b1 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:04.959307 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7d55c-ff10-4062-8d4e-e8da93bef522 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:04.959462 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7d55c-ff10-4062-8d4e-e8da93bef522 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:04.959923 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7d55c-ff10-4062-8d4e-e8da93bef522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:04.960656 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-731d265c-c594-4fa3-8a70-fc275fe9c8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:05.006071 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-d8e7d55c-ff10-4062-8d4e-e8da93bef522 None None] MFA Rules not processed for user `9d1cc5870acb4450ab9d93ec806e6549`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:05.008026 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d8e7d55c-ff10-4062-8d4e-e8da93bef522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:05.030106 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d265c-c594-4fa3-8a70-fc275fe9c8b1 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:05.093589 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27e20f-0ad4-4e38-9d2c-67de668b10cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:05.093589 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27e20f-0ad4-4e38-9d2c-67de668b10cc service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:05.094006 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27e20f-0ad4-4e38-9d2c-67de668b10cc service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:05.094006 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27e20f-0ad4-4e38-9d2c-67de668b10cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:05.108420 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1230/2500] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:05.125142 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:05.134213 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7d55c-ff10-4062-8d4e-e8da93bef522 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:05.134213 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d8e7d55c-ff10-4062-8d4e-e8da93bef522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:05.192422 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27e20f-0ad4-4e38-9d2c-67de668b10cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:05.193923 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27e20f-0ad4-4e38-9d2c-67de668b10cc service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:05.202899 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7d55c-ff10-4062-8d4e-e8da93bef522 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:05.206612 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1271/2501] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:31:05.206848 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df82290-3917-4b9d-9754-4b1884a4983f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:05.207491 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df82290-3917-4b9d-9754-4b1884a4983f service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:05.207778 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df82290-3917-4b9d-9754-4b1884a4983f service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:05.208094 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df82290-3917-4b9d-9754-4b1884a4983f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:05.222777 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df82290-3917-4b9d-9754-4b1884a4983f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:05.223136 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df82290-3917-4b9d-9754-4b1884a4983f service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:05.236156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1231/2502] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:05 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:31:05.300936 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:05.641110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27e20f-0ad4-4e38-9d2c-67de668b10cc service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:05.651534 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27e20f-0ad4-4e38-9d2c-67de668b10cc service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:05.657334 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f973347-4dc0-4179-b113-b832f9fae617 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:05.657437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f973347-4dc0-4179-b113-b832f9fae617 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:05.657658 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f973347-4dc0-4179-b113-b832f9fae617 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:05.657981 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f973347-4dc0-4179-b113-b832f9fae617 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:05.730637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f973347-4dc0-4179-b113-b832f9fae617 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:05.732840 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f973347-4dc0-4179-b113-b832f9fae617 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:05.744133 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1272/2503] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:31:06.334833 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:06.914874 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df82290-3917-4b9d-9754-4b1884a4983f service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:06.926013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df82290-3917-4b9d-9754-4b1884a4983f service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:06.930195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e441f8-097d-40ae-a3cf-e20eba4b036a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:06.930811 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e441f8-097d-40ae-a3cf-e20eba4b036a service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:06.931095 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e441f8-097d-40ae-a3cf-e20eba4b036a service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:06.931407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e441f8-097d-40ae-a3cf-e20eba4b036a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:06.933937 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-61e441f8-097d-40ae-a3cf-e20eba4b036a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:07.014863 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e441f8-097d-40ae-a3cf-e20eba4b036a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:07.016708 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e441f8-097d-40ae-a3cf-e20eba4b036a service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:07.031517 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1232/2504] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:31:08.745489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb3f06-7ab9-487c-9975-5ddd7882dce5 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:08.747178 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb3f06-7ab9-487c-9975-5ddd7882dce5 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:08.749967 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb3f06-7ab9-487c-9975-5ddd7882dce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:08.771971 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-dfdb3f06-7ab9-487c-9975-5ddd7882dce5 None None] MFA Rules not processed for user `f45f65dd3a844cb583e42d837d2a58d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:08.772479 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-dfdb3f06-7ab9-487c-9975-5ddd7882dce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:08.791652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:08.840190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1273/2505] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Sep 2 21:31:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:08.852807 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e441f8-097d-40ae-a3cf-e20eba4b036a service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:08.855774 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-61e441f8-097d-40ae-a3cf-e20eba4b036a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:08.866696 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:08.954439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e441f8-097d-40ae-a3cf-e20eba4b036a service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:08.961430 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6589a9-c0b9-4dfd-b24c-1e7fa2a10e1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da2b1dc9dae413a8ee63ad67e840f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:08.962360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6589a9-c0b9-4dfd-b24c-1e7fa2a10e1b service swift] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:08.962733 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6589a9-c0b9-4dfd-b24c-1e7fa2a10e1b service swift] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:08.963148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6589a9-c0b9-4dfd-b24c-1e7fa2a10e1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:08.973447 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6589a9-c0b9-4dfd-b24c-1e7fa2a10e1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:08.975145 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6589a9-c0b9-4dfd-b24c-1e7fa2a10e1b service swift] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:08.986277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1233/2506] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Sep 2 21:31:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:31:13.187715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb3f06-7ab9-487c-9975-5ddd7882dce5 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:13.189533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-dfdb3f06-7ab9-487c-9975-5ddd7882dce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:13.210811 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb3f06-7ab9-487c-9975-5ddd7882dce5 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:13.219113 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d91e3e-4fa9-4fb9-b1fd-8526af727ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:13.219949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d91e3e-4fa9-4fb9-b1fd-8526af727ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:13.220362 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d91e3e-4fa9-4fb9-b1fd-8526af727ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:13.220648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d91e3e-4fa9-4fb9-b1fd-8526af727ae2 admin admin] PATH_INFO: `/v3/users/cceaf0c4877a4316af9d15c642c9dfc4` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:13.221998 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d91e3e-4fa9-4fb9-b1fd-8526af727ae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cceaf0c4877a4316af9d15c642c9dfc4)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:13.224641 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d91e3e-4fa9-4fb9-b1fd-8526af727ae2 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:13.565062 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-01d91e3e-4fa9-4fb9-b1fd-8526af727ae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cceaf0c4877a4316af9d15c642c9dfc4'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:13.566142 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-01d91e3e-4fa9-4fb9-b1fd-8526af727ae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cceaf0c4877a4316af9d15c642c9dfc4'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:13.595153 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-01d91e3e-4fa9-4fb9-b1fd-8526af727ae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cceaf0c4877a4316af9d15c642c9dfc4'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:13.604817 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-01d91e3e-4fa9-4fb9-b1fd-8526af727ae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cceaf0c4877a4316af9d15c642c9dfc4'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:13.607533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-01d91e3e-4fa9-4fb9-b1fd-8526af727ae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cceaf0c4877a4316af9d15c642c9dfc4'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:13.763244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1274/2507] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:31:13 2022] DELETE /identity/v3/users/cceaf0c4877a4316af9d15c642c9dfc4 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:14.261465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6589a9-c0b9-4dfd-b24c-1e7fa2a10e1b service swift] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:14.277016 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6589a9-c0b9-4dfd-b24c-1e7fa2a10e1b service swift] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:14.374516 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f59ef4-db7e-4d63-acaa-e36738c524ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:14.376746 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f59ef4-db7e-4d63-acaa-e36738c524ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:14.377123 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f59ef4-db7e-4d63-acaa-e36738c524ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:14.377434 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f59ef4-db7e-4d63-acaa-e36738c524ca admin admin] PATH_INFO: `/v3/projects/a7b20efaf7e440f9bbf2a1a0df19c556` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:14.378823 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f59ef4-db7e-4d63-acaa-e36738c524ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7b20efaf7e440f9bbf2a1a0df19c556)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:14.380782 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f59ef4-db7e-4d63-acaa-e36738c524ca admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:14.645683 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-20f59ef4-db7e-4d63-acaa-e36738c524ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'request_id': 'req-20f59ef4-db7e-4d63-acaa-e36738c524ca'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:14.656711 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-20f59ef4-db7e-4d63-acaa-e36738c524ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'request_id': 'req-20f59ef4-db7e-4d63-acaa-e36738c524ca'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:14.683709 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-20f59ef4-db7e-4d63-acaa-e36738c524ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'request_id': 'req-20f59ef4-db7e-4d63-acaa-e36738c524ca'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:14.701260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d91e3e-4fa9-4fb9-b1fd-8526af727ae2 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:14.703780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-01d91e3e-4fa9-4fb9-b1fd-8526af727ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:14.738788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d91e3e-4fa9-4fb9-b1fd-8526af727ae2 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:14.829052 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f7e2c-85e6-4e53-ad19-c909cd3b9183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:14.832916 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f7e2c-85e6-4e53-ad19-c909cd3b9183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:14.832916 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f7e2c-85e6-4e53-ad19-c909cd3b9183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:14.832916 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f7e2c-85e6-4e53-ad19-c909cd3b9183 admin admin] PATH_INFO: `/v3/users/215e487e421a4f9fa8c2fb8bfaf37705` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:14.834747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f7e2c-85e6-4e53-ad19-c909cd3b9183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=215e487e421a4f9fa8c2fb8bfaf37705)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:14.835878 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f7e2c-85e6-4e53-ad19-c909cd3b9183 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:15.002856 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-20f59ef4-db7e-4d63-acaa-e36738c524ca admin admin] The token cache is being invalidate because project a7b20efaf7e440f9bbf2a1a0df19c556 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:31:15.023415 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-20f59ef4-db7e-4d63-acaa-e36738c524ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:15.023415 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-20f59ef4-db7e-4d63-acaa-e36738c524ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:15.023415 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1234/2508] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:31:14 2022] DELETE /identity/v3/projects/a7b20efaf7e440f9bbf2a1a0df19c556 => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:15.023415 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab89f2a-2b70-46c9-a9a5-46396730a7af None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:15.023415 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab89f2a-2b70-46c9-a9a5-46396730a7af None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:15.023415 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab89f2a-2b70-46c9-a9a5-46396730a7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:15.070898 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-8ab89f2a-2b70-46c9-a9a5-46396730a7af None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:15.072952 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8ab89f2a-2b70-46c9-a9a5-46396730a7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:15.106271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1235/2509] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:31:15.121121 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69502192-86aa-454b-91f2-90b060fca249 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:15.121916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69502192-86aa-454b-91f2-90b060fca249 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:15.122093 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69502192-86aa-454b-91f2-90b060fca249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:15.156737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-69502192-86aa-454b-91f2-90b060fca249 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:15.156737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-69502192-86aa-454b-91f2-90b060fca249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:15.166477 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1236/2510] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:31:15.168078 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69502192-86aa-454b-91f2-90b060fca249 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:15.183482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69502192-86aa-454b-91f2-90b060fca249 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:15.189150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b266f3-36eb-42c5-b944-59670fbddce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:15.189932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b266f3-36eb-42c5-b944-59670fbddce0 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:15.190282 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b266f3-36eb-42c5-b944-59670fbddce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:15.190808 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b266f3-36eb-42c5-b944-59670fbddce0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:15.191549 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b266f3-36eb-42c5-b944-59670fbddce0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:31:15.191918 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b266f3-36eb-42c5-b944-59670fbddce0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:15.193639 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b266f3-36eb-42c5-b944-59670fbddce0 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:15.210538 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:15.217686 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1237/2511] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:31:15.222640 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b266f3-36eb-42c5-b944-59670fbddce0 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:15.235854 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b266f3-36eb-42c5-b944-59670fbddce0 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:15.243854 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4062b4f-b1ba-40df-8ab5-82274cf9097b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:15.245147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4062b4f-b1ba-40df-8ab5-82274cf9097b admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:15.245708 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4062b4f-b1ba-40df-8ab5-82274cf9097b admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:15.246223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4062b4f-b1ba-40df-8ab5-82274cf9097b admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:15.247011 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4062b4f-b1ba-40df-8ab5-82274cf9097b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:15.251121 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4062b4f-b1ba-40df-8ab5-82274cf9097b admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:15.441959 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:15.458609 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-ec2f7e2c-85e6-4e53-ad19-c909cd3b9183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '215e487e421a4f9fa8c2fb8bfaf37705'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:15.459509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-ec2f7e2c-85e6-4e53-ad19-c909cd3b9183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '215e487e421a4f9fa8c2fb8bfaf37705'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:15.484543 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-ec2f7e2c-85e6-4e53-ad19-c909cd3b9183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '215e487e421a4f9fa8c2fb8bfaf37705'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:15.493337 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-ec2f7e2c-85e6-4e53-ad19-c909cd3b9183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '215e487e421a4f9fa8c2fb8bfaf37705'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:15.495688 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-ec2f7e2c-85e6-4e53-ad19-c909cd3b9183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '215e487e421a4f9fa8c2fb8bfaf37705'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:15.564465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1238/2512] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:31:15 2022] POST /identity/v3/projects => generated 385 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:31:15.565611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4062b4f-b1ba-40df-8ab5-82274cf9097b admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:15.567448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-a4062b4f-b1ba-40df-8ab5-82274cf9097b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:15.682631 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4062b4f-b1ba-40df-8ab5-82274cf9097b admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:15.691129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba31c31-eeb4-4e29-9928-29055b32d0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:15.695858 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba31c31-eeb4-4e29-9928-29055b32d0fd admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:15.696328 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba31c31-eeb4-4e29-9928-29055b32d0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:15.696787 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba31c31-eeb4-4e29-9928-29055b32d0fd admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:15.699142 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba31c31-eeb4-4e29-9928-29055b32d0fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:15.701377 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba31c31-eeb4-4e29-9928-29055b32d0fd admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:15.720511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1275/2513] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:31:14 2022] DELETE /identity/v3/users/215e487e421a4f9fa8c2fb8bfaf37705 => generated 0 bytes in 1020 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:31:15.726674 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28bb6c-d4b3-4965-8a23-9723d72b6df7 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:15.727509 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28bb6c-d4b3-4965-8a23-9723d72b6df7 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:15.728147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28bb6c-d4b3-4965-8a23-9723d72b6df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:15.767657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-1f28bb6c-d4b3-4965-8a23-9723d72b6df7 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:15.769099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-1f28bb6c-d4b3-4965-8a23-9723d72b6df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:15.907435 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1276/2514] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:15.920515 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28bb6c-d4b3-4965-8a23-9723d72b6df7 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:15.924470 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-1f28bb6c-d4b3-4965-8a23-9723d72b6df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:16.035266 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28bb6c-d4b3-4965-8a23-9723d72b6df7 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:16.039435 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1239/2515] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:31:15 2022] POST /identity/v3/users => generated 293 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:31:16.040974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba31c31-eeb4-4e29-9928-29055b32d0fd admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:16.043123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a2085-2261-4675-b27e-f77978c2c650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:16.044105 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a2085-2261-4675-b27e-f77978c2c650 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:16.044625 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a2085-2261-4675-b27e-f77978c2c650 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:16.045121 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a2085-2261-4675-b27e-f77978c2c650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:16.064785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba31c31-eeb4-4e29-9928-29055b32d0fd admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:16.075877 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9d624-8228-47ca-ae99-74e61a605cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:16.075877 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9d624-8228-47ca-ae99-74e61a605cdf admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:16.089745 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9d624-8228-47ca-ae99-74e61a605cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:16.089745 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9d624-8228-47ca-ae99-74e61a605cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:16.089745 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9d624-8228-47ca-ae99-74e61a605cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:16.089745 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9d624-8228-47ca-ae99-74e61a605cdf admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:16.090372 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a2085-2261-4675-b27e-f77978c2c650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:16.092426 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a2085-2261-4675-b27e-f77978c2c650 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:16.137921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1277/2516] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:31:16.167742 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1240/2517] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:31:16.169247 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a2085-2261-4675-b27e-f77978c2c650 service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:16.190217 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a2085-2261-4675-b27e-f77978c2c650 service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:16.214863 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadade38-bd71-4f04-af36-7bb77d918f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:16.215681 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadade38-bd71-4f04-af36-7bb77d918f2f admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:16.216151 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadade38-bd71-4f04-af36-7bb77d918f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:16.217216 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadade38-bd71-4f04-af36-7bb77d918f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:16.227725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadade38-bd71-4f04-af36-7bb77d918f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:16.229772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadade38-bd71-4f04-af36-7bb77d918f2f admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:16.262314 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1278/2518] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:31:16.268147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9d624-8228-47ca-ae99-74e61a605cdf admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:16.288277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9d624-8228-47ca-ae99-74e61a605cdf admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:16.315252 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2893a-201e-4df6-bc89-d7b68465f6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:16.316504 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2893a-201e-4df6-bc89-d7b68465f6af admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:16.316982 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2893a-201e-4df6-bc89-d7b68465f6af admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:16.317769 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2893a-201e-4df6-bc89-d7b68465f6af admin admin] PATH_INFO: `/v3/projects/d0e4c1f5dfdb49abb0ca5ca324976acb/users/e343f998e5e34447bd2b5f0a2627bbdf/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:16.378816 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2893a-201e-4df6-bc89-d7b68465f6af admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0e4c1f5dfdb49abb0ca5ca324976acb, user_id=e343f998e5e34447bd2b5f0a2627bbdf, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:16.382257 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2893a-201e-4df6-bc89-d7b68465f6af admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:16.916548 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1241/2519] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:31:16 2022] PUT /identity/v3/projects/d0e4c1f5dfdb49abb0ca5ca324976acb/users/e343f998e5e34447bd2b5f0a2627bbdf/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:31:16.927271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d633b5a-90f1-436c-a472-9b7b2dbff5c5 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:16.927271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d633b5a-90f1-436c-a472-9b7b2dbff5c5 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:16.927271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d633b5a-90f1-436c-a472-9b7b2dbff5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:16.952632 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-8d633b5a-90f1-436c-a472-9b7b2dbff5c5 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:16.953933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-8d633b5a-90f1-436c-a472-9b7b2dbff5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:17.112191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1279/2520] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:17.131180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2893a-201e-4df6-bc89-d7b68465f6af admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:17.234600 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2893a-201e-4df6-bc89-d7b68465f6af admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:17.238462 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b656d3-60c0-46df-8f38-151be8acefb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:17.239114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b656d3-60c0-46df-8f38-151be8acefb4 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:17.239420 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b656d3-60c0-46df-8f38-151be8acefb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:17.239811 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b656d3-60c0-46df-8f38-151be8acefb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:17.266216 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b656d3-60c0-46df-8f38-151be8acefb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:17.267770 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b656d3-60c0-46df-8f38-151be8acefb4 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:17.286237 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1242/2521] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:31:17.693049 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d633b5a-90f1-436c-a472-9b7b2dbff5c5 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:17.695030 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-8d633b5a-90f1-436c-a472-9b7b2dbff5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:17.708506 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d633b5a-90f1-436c-a472-9b7b2dbff5c5 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:17.715555 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52596bff-e6b6-4e50-acc4-12af3aef8835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:17.716388 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52596bff-e6b6-4e50-acc4-12af3aef8835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:17.716794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52596bff-e6b6-4e50-acc4-12af3aef8835 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:17.717751 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52596bff-e6b6-4e50-acc4-12af3aef8835 admin admin] PATH_INFO: `/v3/projects/318bafbcde0944868bfb29b3fd545622` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:17.724208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52596bff-e6b6-4e50-acc4-12af3aef8835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=318bafbcde0944868bfb29b3fd545622)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:17.724208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52596bff-e6b6-4e50-acc4-12af3aef8835 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:17.912219 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-52596bff-e6b6-4e50-acc4-12af3aef8835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '318bafbcde0944868bfb29b3fd545622', 'request_id': 'req-52596bff-e6b6-4e50-acc4-12af3aef8835'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:17.918658 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-52596bff-e6b6-4e50-acc4-12af3aef8835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '318bafbcde0944868bfb29b3fd545622', 'request_id': 'req-52596bff-e6b6-4e50-acc4-12af3aef8835'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:17.924406 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-52596bff-e6b6-4e50-acc4-12af3aef8835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '318bafbcde0944868bfb29b3fd545622', 'request_id': 'req-52596bff-e6b6-4e50-acc4-12af3aef8835'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:18.083295 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:18.091492 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-52596bff-e6b6-4e50-acc4-12af3aef8835 admin admin] The token cache is being invalidate because project 318bafbcde0944868bfb29b3fd545622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:31:18.096235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-52596bff-e6b6-4e50-acc4-12af3aef8835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:18.096235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-52596bff-e6b6-4e50-acc4-12af3aef8835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:18.096235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1280/2522] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:31:17 2022] DELETE /identity/v3/projects/318bafbcde0944868bfb29b3fd545622 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:18.098492 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b656d3-60c0-46df-8f38-151be8acefb4 service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:18.109553 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b656d3-60c0-46df-8f38-151be8acefb4 service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:18.147633 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:18.178971 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a449f0-b2c4-4a44-9c6d-e3778b9d7136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:18.179306 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a449f0-b2c4-4a44-9c6d-e3778b9d7136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:18.179593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a449f0-b2c4-4a44-9c6d-e3778b9d7136 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:18.179874 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a449f0-b2c4-4a44-9c6d-e3778b9d7136 admin admin] PATH_INFO: `/v3/users/9d1cc5870acb4450ab9d93ec806e6549` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:18.182085 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a449f0-b2c4-4a44-9c6d-e3778b9d7136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d1cc5870acb4450ab9d93ec806e6549)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:18.184357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a449f0-b2c4-4a44-9c6d-e3778b9d7136 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:18.510580 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a5a449f0-b2c4-4a44-9c6d-e3778b9d7136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d1cc5870acb4450ab9d93ec806e6549'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:18.511493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a5a449f0-b2c4-4a44-9c6d-e3778b9d7136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d1cc5870acb4450ab9d93ec806e6549'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:18.520215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a5a449f0-b2c4-4a44-9c6d-e3778b9d7136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d1cc5870acb4450ab9d93ec806e6549'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:18.536156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a5a449f0-b2c4-4a44-9c6d-e3778b9d7136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d1cc5870acb4450ab9d93ec806e6549'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:18.543757 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a5a449f0-b2c4-4a44-9c6d-e3778b9d7136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d1cc5870acb4450ab9d93ec806e6549'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:18.637659 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1243/2523] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:31:18 2022] DELETE /identity/v3/users/9d1cc5870acb4450ab9d93ec806e6549 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:19.289087 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52596bff-e6b6-4e50-acc4-12af3aef8835 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:19.291282 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-52596bff-e6b6-4e50-acc4-12af3aef8835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:19.306721 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52596bff-e6b6-4e50-acc4-12af3aef8835 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:19.396227 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a4a5e-b63a-47f3-8f86-e8f2acba59cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:19.398281 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a4a5e-b63a-47f3-8f86-e8f2acba59cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:19.399045 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a4a5e-b63a-47f3-8f86-e8f2acba59cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:19.399805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a4a5e-b63a-47f3-8f86-e8f2acba59cb admin admin] PATH_INFO: `/v3/projects/9d29bc0e05ae4a28bef0df1b9d3e19aa` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:19.402581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a4a5e-b63a-47f3-8f86-e8f2acba59cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d29bc0e05ae4a28bef0df1b9d3e19aa)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:19.404553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a4a5e-b63a-47f3-8f86-e8f2acba59cb admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:19.586564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0b0a4a5e-b63a-47f3-8f86-e8f2acba59cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d29bc0e05ae4a28bef0df1b9d3e19aa', 'request_id': 'req-0b0a4a5e-b63a-47f3-8f86-e8f2acba59cb'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:19.595781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0b0a4a5e-b63a-47f3-8f86-e8f2acba59cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d29bc0e05ae4a28bef0df1b9d3e19aa', 'request_id': 'req-0b0a4a5e-b63a-47f3-8f86-e8f2acba59cb'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:19.602420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0b0a4a5e-b63a-47f3-8f86-e8f2acba59cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d29bc0e05ae4a28bef0df1b9d3e19aa', 'request_id': 'req-0b0a4a5e-b63a-47f3-8f86-e8f2acba59cb'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:19.725752 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0b0a4a5e-b63a-47f3-8f86-e8f2acba59cb admin admin] The token cache is being invalidate because project 9d29bc0e05ae4a28bef0df1b9d3e19aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:31:19.726020 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0b0a4a5e-b63a-47f3-8f86-e8f2acba59cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:19.726899 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0b0a4a5e-b63a-47f3-8f86-e8f2acba59cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:19.728789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1281/2524] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:31:19 2022] DELETE /identity/v3/projects/9d29bc0e05ae4a28bef0df1b9d3e19aa => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:19.734037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d070cde-038c-4b0e-96e0-34d5c22d9162 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:19.734600 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d070cde-038c-4b0e-96e0-34d5c22d9162 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:19.734735 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d070cde-038c-4b0e-96e0-34d5c22d9162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:19.757623 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-8d070cde-038c-4b0e-96e0-34d5c22d9162 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:19.758984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8d070cde-038c-4b0e-96e0-34d5c22d9162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:19.840791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1244/2525] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:19.849938 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d634d7-3fe2-4872-9a5d-03bc07522b77 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:19.850242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d634d7-3fe2-4872-9a5d-03bc07522b77 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:19.850524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d634d7-3fe2-4872-9a5d-03bc07522b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:19.875510 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-70d634d7-3fe2-4872-9a5d-03bc07522b77 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:19.876938 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-70d634d7-3fe2-4872-9a5d-03bc07522b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:19.890058 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:19.892277 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1282/2526] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:19.896421 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d070cde-038c-4b0e-96e0-34d5c22d9162 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:19.907770 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d070cde-038c-4b0e-96e0-34d5c22d9162 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:19.914763 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7a3a4-18c3-4a82-9247-fa04f0639c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:19.915395 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7a3a4-18c3-4a82-9247-fa04f0639c13 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:19.915727 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7a3a4-18c3-4a82-9247-fa04f0639c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:19.915958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7a3a4-18c3-4a82-9247-fa04f0639c13 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:19.916691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7a3a4-18c3-4a82-9247-fa04f0639c13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:31:19.917002 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7a3a4-18c3-4a82-9247-fa04f0639c13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:19.919798 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7a3a4-18c3-4a82-9247-fa04f0639c13 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:19.943548 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1245/2527] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:31:19.945676 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d634d7-3fe2-4872-9a5d-03bc07522b77 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:19.958726 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d634d7-3fe2-4872-9a5d-03bc07522b77 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:19.966876 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3a323-31a8-42a0-bb35-dc449e99ce94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:19.967975 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3a323-31a8-42a0-bb35-dc449e99ce94 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:19.968430 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3a323-31a8-42a0-bb35-dc449e99ce94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:19.968874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3a323-31a8-42a0-bb35-dc449e99ce94 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:19.969690 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3a323-31a8-42a0-bb35-dc449e99ce94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:19.971911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3a323-31a8-42a0-bb35-dc449e99ce94 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:20.099245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1283/2528] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:31:19 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:31:20.101257 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7a3a4-18c3-4a82-9247-fa04f0639c13 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:20.119240 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7a3a4-18c3-4a82-9247-fa04f0639c13 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:20.179783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:20.195263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a3d9c-7f73-452c-bb29-33cf37d64df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:20.195899 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a3d9c-7f73-452c-bb29-33cf37d64df3 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:20.196217 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a3d9c-7f73-452c-bb29-33cf37d64df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:20.196631 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a3d9c-7f73-452c-bb29-33cf37d64df3 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:20.197995 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a3d9c-7f73-452c-bb29-33cf37d64df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:20.199651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a3d9c-7f73-452c-bb29-33cf37d64df3 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:20.403888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3a323-31a8-42a0-bb35-dc449e99ce94 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:20.415810 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1246/2529] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:31:20 2022] POST /identity/v3/users => generated 292 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:31:20.443121 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3a323-31a8-42a0-bb35-dc449e99ce94 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:20.451633 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4afc1-8ed0-4d37-b8c0-4289a52796ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:20.452325 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4afc1-8ed0-4d37-b8c0-4289a52796ac admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:20.452611 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4afc1-8ed0-4d37-b8c0-4289a52796ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:20.452891 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4afc1-8ed0-4d37-b8c0-4289a52796ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:20.453612 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4afc1-8ed0-4d37-b8c0-4289a52796ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:20.457557 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4afc1-8ed0-4d37-b8c0-4289a52796ac admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:20.473037 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1284/2530] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:31:20.474312 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a3d9c-7f73-452c-bb29-33cf37d64df3 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:20.486555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a3d9c-7f73-452c-bb29-33cf37d64df3 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:20.495678 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518263f2-30c0-4869-9d5a-5ae4145ba0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:20.495678 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518263f2-30c0-4869-9d5a-5ae4145ba0ab admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:20.495678 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518263f2-30c0-4869-9d5a-5ae4145ba0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:20.495678 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518263f2-30c0-4869-9d5a-5ae4145ba0ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:20.496215 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518263f2-30c0-4869-9d5a-5ae4145ba0ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:20.496841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518263f2-30c0-4869-9d5a-5ae4145ba0ab admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:20.518169 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1247/2531] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:31:20.521940 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4afc1-8ed0-4d37-b8c0-4289a52796ac admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:20.537303 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4afc1-8ed0-4d37-b8c0-4289a52796ac admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:20.543410 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88a369-d9f4-4372-8e82-d43be8f7cdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:20.544403 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88a369-d9f4-4372-8e82-d43be8f7cdb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:20.544882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88a369-d9f4-4372-8e82-d43be8f7cdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:20.545324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88a369-d9f4-4372-8e82-d43be8f7cdb4 admin admin] PATH_INFO: `/v3/projects/9954dba141014bf398ca562851a40a90/users/a6f6901114ac411bb76aed8b877a6e83/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:20.567747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88a369-d9f4-4372-8e82-d43be8f7cdb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9954dba141014bf398ca562851a40a90, user_id=a6f6901114ac411bb76aed8b877a6e83, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:20.570554 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88a369-d9f4-4372-8e82-d43be8f7cdb4 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:20.679459 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1285/2532] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:31:20 2022] PUT /identity/v3/projects/9954dba141014bf398ca562851a40a90/users/a6f6901114ac411bb76aed8b877a6e83/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:20.691804 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a03b2c-7687-4f21-818e-333749a32baf None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:20.692096 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a03b2c-7687-4f21-818e-333749a32baf None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:20.692400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a03b2c-7687-4f21-818e-333749a32baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:20.727501 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-91a03b2c-7687-4f21-818e-333749a32baf None None] MFA Rules not processed for user `a6f6901114ac411bb76aed8b877a6e83`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:20.728846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-91a03b2c-7687-4f21-818e-333749a32baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:20.853354 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1248/2533] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:20.866388 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88a369-d9f4-4372-8e82-d43be8f7cdb4 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:20.870938 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-2b88a369-d9f4-4372-8e82-d43be8f7cdb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:20.970427 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88a369-d9f4-4372-8e82-d43be8f7cdb4 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:20.976218 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a93119-0d89-4b61-84a0-ab104ffcde37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:20.976996 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a93119-0d89-4b61-84a0-ab104ffcde37 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:20.977532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a93119-0d89-4b61-84a0-ab104ffcde37 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:20.978047 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a93119-0d89-4b61-84a0-ab104ffcde37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:20.992119 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a93119-0d89-4b61-84a0-ab104ffcde37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:20.995694 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a93119-0d89-4b61-84a0-ab104ffcde37 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:21.009539 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1286/2534] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:31:25.102572 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51c8f5-3128-4eb8-ab54-10962b8c01d5 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:25.103338 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51c8f5-3128-4eb8-ab54-10962b8c01d5 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:25.103941 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51c8f5-3128-4eb8-ab54-10962b8c01d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:25.160388 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-0b51c8f5-3128-4eb8-ab54-10962b8c01d5 None None] MFA Rules not processed for user `e343f998e5e34447bd2b5f0a2627bbdf`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:25.163437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-0b51c8f5-3128-4eb8-ab54-10962b8c01d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:25.261108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1249/2535] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:25.277568 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a93119-0d89-4b61-84a0-ab104ffcde37 service cinder] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:25.279230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-43a93119-0d89-4b61-84a0-ab104ffcde37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:25.389994 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a93119-0d89-4b61-84a0-ab104ffcde37 service cinder] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:25.398667 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f466c26-99b8-49af-8bbb-b5949233bbb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:25.399465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f466c26-99b8-49af-8bbb-b5949233bbb0 service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:25.399855 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f466c26-99b8-49af-8bbb-b5949233bbb0 service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:25.400705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f466c26-99b8-49af-8bbb-b5949233bbb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:25.411017 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f466c26-99b8-49af-8bbb-b5949233bbb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:25.412966 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f466c26-99b8-49af-8bbb-b5949233bbb0 service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:25.425661 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1287/2536] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:31:28.495173 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e788d-af3f-439a-818a-31a29da3fe6a None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:28.495712 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e788d-af3f-439a-818a-31a29da3fe6a None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:28.495955 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e788d-af3f-439a-818a-31a29da3fe6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:28.520090 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-199e788d-af3f-439a-818a-31a29da3fe6a None None] MFA Rules not processed for user `f45f65dd3a844cb583e42d837d2a58d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:28.521590 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-199e788d-af3f-439a-818a-31a29da3fe6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:28.564289 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:28.592702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc18709-d5fc-4f4e-9ac4-dbc086f54ff5 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:28.593394 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc18709-d5fc-4f4e-9ac4-dbc086f54ff5 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:28.593394 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc18709-d5fc-4f4e-9ac4-dbc086f54ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:28.605866 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1250/2537] 10.222.0.79 () {58 vars in 967 bytes} [Fri Sep 2 21:31:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:28.617091 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-7cc18709-d5fc-4f4e-9ac4-dbc086f54ff5 None None] MFA Rules not processed for user `e343f998e5e34447bd2b5f0a2627bbdf`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:28.618652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-7cc18709-d5fc-4f4e-9ac4-dbc086f54ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:28.625094 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e788d-af3f-439a-818a-31a29da3fe6a None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:28.626988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-199e788d-af3f-439a-818a-31a29da3fe6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:28.630894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1288/2538] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:31:28.749939 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e788d-af3f-439a-818a-31a29da3fe6a None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:28.756831 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9ba4c-1ca0-415e-a1a7-65b278267627 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da2b1dc9dae413a8ee63ad67e840f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:28.757590 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9ba4c-1ca0-415e-a1a7-65b278267627 service swift] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:28.758009 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9ba4c-1ca0-415e-a1a7-65b278267627 service swift] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:28.758446 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9ba4c-1ca0-415e-a1a7-65b278267627 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:28.772132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9ba4c-1ca0-415e-a1a7-65b278267627 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:28.773759 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9ba4c-1ca0-415e-a1a7-65b278267627 service swift] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:28.798347 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1251/2539] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Sep 2 21:31:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 02 21:31:33.865582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc18709-d5fc-4f4e-9ac4-dbc086f54ff5 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:33.891472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:33.954695 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc18709-d5fc-4f4e-9ac4-dbc086f54ff5 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:33.959600 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81b136-9e77-48ff-b594-3e6818a8be2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:33.960263 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81b136-9e77-48ff-b594-3e6818a8be2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:33.960804 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81b136-9e77-48ff-b594-3e6818a8be2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:33.961087 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81b136-9e77-48ff-b594-3e6818a8be2f admin admin] PATH_INFO: `/v3/users/a6f6901114ac411bb76aed8b877a6e83` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:33.962466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81b136-9e77-48ff-b594-3e6818a8be2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6f6901114ac411bb76aed8b877a6e83)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:33.964470 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81b136-9e77-48ff-b594-3e6818a8be2f admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:34.245110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-8e81b136-9e77-48ff-b594-3e6818a8be2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6f6901114ac411bb76aed8b877a6e83'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:34.246200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-8e81b136-9e77-48ff-b594-3e6818a8be2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6f6901114ac411bb76aed8b877a6e83'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:34.269490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-8e81b136-9e77-48ff-b594-3e6818a8be2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6f6901114ac411bb76aed8b877a6e83'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:34.280415 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-8e81b136-9e77-48ff-b594-3e6818a8be2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6f6901114ac411bb76aed8b877a6e83'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:34.281243 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-8e81b136-9e77-48ff-b594-3e6818a8be2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6f6901114ac411bb76aed8b877a6e83'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:34.402125 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1289/2540] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:31:33 2022] DELETE /identity/v3/users/a6f6901114ac411bb76aed8b877a6e83 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:34.406771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c2e93-cb3b-4e5b-957d-e81358f2bbe9 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:34.407274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c2e93-cb3b-4e5b-957d-e81358f2bbe9 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:34.407358 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c2e93-cb3b-4e5b-957d-e81358f2bbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:34.428484 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-607c2e93-cb3b-4e5b-957d-e81358f2bbe9 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:34.429707 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-607c2e93-cb3b-4e5b-957d-e81358f2bbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:34.500329 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1252/2541] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:34.510797 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81b136-9e77-48ff-b594-3e6818a8be2f admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:34.513164 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-8e81b136-9e77-48ff-b594-3e6818a8be2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:34.588693 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81b136-9e77-48ff-b594-3e6818a8be2f admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:34.592805 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16551df-b3c0-431c-a423-6c508cbcb583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:34.593746 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16551df-b3c0-431c-a423-6c508cbcb583 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:34.594158 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16551df-b3c0-431c-a423-6c508cbcb583 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:34.594432 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16551df-b3c0-431c-a423-6c508cbcb583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:34.607235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16551df-b3c0-431c-a423-6c508cbcb583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:34.608220 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16551df-b3c0-431c-a423-6c508cbcb583 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:34.622258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1290/2542] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:31:35.408441 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c2e93-cb3b-4e5b-957d-e81358f2bbe9 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:35.416275 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-607c2e93-cb3b-4e5b-957d-e81358f2bbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:35.436328 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c2e93-cb3b-4e5b-957d-e81358f2bbe9 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:35.442539 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d05341-d4f7-49ea-a667-ce5b12abda8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:35.443616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d05341-d4f7-49ea-a667-ce5b12abda8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:35.443953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d05341-d4f7-49ea-a667-ce5b12abda8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:35.444161 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d05341-d4f7-49ea-a667-ce5b12abda8e admin admin] PATH_INFO: `/v3/projects/9954dba141014bf398ca562851a40a90` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:35.445916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d05341-d4f7-49ea-a667-ce5b12abda8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9954dba141014bf398ca562851a40a90)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:35.448962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d05341-d4f7-49ea-a667-ce5b12abda8e admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:35.627317 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-78d05341-d4f7-49ea-a667-ce5b12abda8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9954dba141014bf398ca562851a40a90', 'request_id': 'req-78d05341-d4f7-49ea-a667-ce5b12abda8e'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:35.636204 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-78d05341-d4f7-49ea-a667-ce5b12abda8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9954dba141014bf398ca562851a40a90', 'request_id': 'req-78d05341-d4f7-49ea-a667-ce5b12abda8e'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:35.651281 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-78d05341-d4f7-49ea-a667-ce5b12abda8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9954dba141014bf398ca562851a40a90', 'request_id': 'req-78d05341-d4f7-49ea-a667-ce5b12abda8e'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:35.655870 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:35.770443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-78d05341-d4f7-49ea-a667-ce5b12abda8e admin admin] The token cache is being invalidate because project 9954dba141014bf398ca562851a40a90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:31:35.772715 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-78d05341-d4f7-49ea-a667-ce5b12abda8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:35.772715 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-78d05341-d4f7-49ea-a667-ce5b12abda8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:35.773592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1253/2543] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:31:35 2022] DELETE /identity/v3/projects/9954dba141014bf398ca562851a40a90 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:35.779657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e839928-5028-4b78-ae14-05d99fd7bb6f None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:35.780184 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e839928-5028-4b78-ae14-05d99fd7bb6f None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:35.780302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e839928-5028-4b78-ae14-05d99fd7bb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:35.803338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-9e839928-5028-4b78-ae14-05d99fd7bb6f None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:35.804569 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-9e839928-5028-4b78-ae14-05d99fd7bb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:35.850574 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:35.872846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1291/2544] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:35.888271 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd533014-035b-48e2-b247-3cf868327699 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:35.888976 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd533014-035b-48e2-b247-3cf868327699 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:35.889396 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd533014-035b-48e2-b247-3cf868327699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:35.923984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-bd533014-035b-48e2-b247-3cf868327699 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:35.926499 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-bd533014-035b-48e2-b247-3cf868327699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:35.939309 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1254/2545] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:35.944129 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e839928-5028-4b78-ae14-05d99fd7bb6f None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:35.959997 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e839928-5028-4b78-ae14-05d99fd7bb6f None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:35.966488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e48ba-8bc6-481f-bdf8-e03bb3275010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:35.967213 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e48ba-8bc6-481f-bdf8-e03bb3275010 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:35.968159 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e48ba-8bc6-481f-bdf8-e03bb3275010 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:35.968159 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e48ba-8bc6-481f-bdf8-e03bb3275010 admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:35.968722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e48ba-8bc6-481f-bdf8-e03bb3275010 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:31:35.969644 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e48ba-8bc6-481f-bdf8-e03bb3275010 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:35.970905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e48ba-8bc6-481f-bdf8-e03bb3275010 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:35.989852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1292/2546] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:31:35.994633 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd533014-035b-48e2-b247-3cf868327699 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:36.004290 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd533014-035b-48e2-b247-3cf868327699 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:36.009475 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ef2f5-4c0e-4665-9328-f9e50d3a2af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:36.010207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ef2f5-4c0e-4665-9328-f9e50d3a2af4 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:36.010554 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ef2f5-4c0e-4665-9328-f9e50d3a2af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:36.010783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ef2f5-4c0e-4665-9328-f9e50d3a2af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:36.011457 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ef2f5-4c0e-4665-9328-f9e50d3a2af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:36.013509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ef2f5-4c0e-4665-9328-f9e50d3a2af4 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:36.142295 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1255/2547] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:31:35 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:31:36.146385 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e48ba-8bc6-481f-bdf8-e03bb3275010 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:36.157403 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e48ba-8bc6-481f-bdf8-e03bb3275010 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:36.245383 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8410479-94d0-4f15-93bf-9ed70493d1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:36.245686 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8410479-94d0-4f15-93bf-9ed70493d1d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:36.245982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8410479-94d0-4f15-93bf-9ed70493d1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:36.246267 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8410479-94d0-4f15-93bf-9ed70493d1d7 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:36.246943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8410479-94d0-4f15-93bf-9ed70493d1d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:36.248932 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8410479-94d0-4f15-93bf-9ed70493d1d7 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:36.414217 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1293/2548] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:31:36 2022] POST /identity/v3/users => generated 288 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:31:36.427257 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ef2f5-4c0e-4665-9328-f9e50d3a2af4 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:36.430463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ef2f5-4c0e-4665-9328-f9e50d3a2af4 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:36.436764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a130afe-7d6b-49e0-b1e7-d873eeb4e8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:36.437510 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a130afe-7d6b-49e0-b1e7-d873eeb4e8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:36.437871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a130afe-7d6b-49e0-b1e7-d873eeb4e8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:36.438190 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a130afe-7d6b-49e0-b1e7-d873eeb4e8e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:36.438900 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a130afe-7d6b-49e0-b1e7-d873eeb4e8e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:36.440681 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a130afe-7d6b-49e0-b1e7-d873eeb4e8e9 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:36.453156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1256/2549] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:31:36.457542 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8410479-94d0-4f15-93bf-9ed70493d1d7 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:36.469350 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8410479-94d0-4f15-93bf-9ed70493d1d7 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:36.502869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75e015-6f6a-4ea7-9d04-bf10ab7a7aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:36.502869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75e015-6f6a-4ea7-9d04-bf10ab7a7aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:36.502869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75e015-6f6a-4ea7-9d04-bf10ab7a7aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:36.502869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75e015-6f6a-4ea7-9d04-bf10ab7a7aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:36.503287 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75e015-6f6a-4ea7-9d04-bf10ab7a7aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:36.503287 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75e015-6f6a-4ea7-9d04-bf10ab7a7aa8 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:36.503287 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1294/2550] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:31:36.506012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a130afe-7d6b-49e0-b1e7-d873eeb4e8e9 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:36.518976 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a130afe-7d6b-49e0-b1e7-d873eeb4e8e9 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:36.524975 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb6b59-9eaa-4c13-8073-6f504cb4ec5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:36.525910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb6b59-9eaa-4c13-8073-6f504cb4ec5c admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:36.526202 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb6b59-9eaa-4c13-8073-6f504cb4ec5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:36.526486 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb6b59-9eaa-4c13-8073-6f504cb4ec5c admin admin] PATH_INFO: `/v3/projects/d291eefd77e249a197e2ac7246d7a76d/users/124d062eee95454ab74582538589b799/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:36.550677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb6b59-9eaa-4c13-8073-6f504cb4ec5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d291eefd77e249a197e2ac7246d7a76d, user_id=124d062eee95454ab74582538589b799, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:36.553367 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb6b59-9eaa-4c13-8073-6f504cb4ec5c admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:36.699522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1257/2551] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:31:36 2022] PUT /identity/v3/projects/d291eefd77e249a197e2ac7246d7a76d/users/124d062eee95454ab74582538589b799/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:36.711621 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef917f-4bc1-4bbb-a25a-c12870fb8016 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:36.712406 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef917f-4bc1-4bbb-a25a-c12870fb8016 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:36.712406 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef917f-4bc1-4bbb-a25a-c12870fb8016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:36.743858 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-ccef917f-4bc1-4bbb-a25a-c12870fb8016 None None] MFA Rules not processed for user `124d062eee95454ab74582538589b799`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:36.744659 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ccef917f-4bc1-4bbb-a25a-c12870fb8016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:36.829508 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1295/2552] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:36.834080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb6b59-9eaa-4c13-8073-6f504cb4ec5c admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:36.906818 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb6b59-9eaa-4c13-8073-6f504cb4ec5c admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:36.911751 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b32b6-b206-4b15-aeb2-65ec2404fba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:36.912370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b32b6-b206-4b15-aeb2-65ec2404fba9 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:36.912655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b32b6-b206-4b15-aeb2-65ec2404fba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:36.912956 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b32b6-b206-4b15-aeb2-65ec2404fba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:36.913654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b32b6-b206-4b15-aeb2-65ec2404fba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:36.915846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b32b6-b206-4b15-aeb2-65ec2404fba9 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:37.093178 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1258/2553] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:31:36 2022] POST /identity/v3/projects => generated 375 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:31:37.094351 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef917f-4bc1-4bbb-a25a-c12870fb8016 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:37.106519 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef917f-4bc1-4bbb-a25a-c12870fb8016 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:37.146226 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:37.171524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe2b8a-e28f-4d21-9ce3-9fc7b86a6419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:37.172469 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe2b8a-e28f-4d21-9ce3-9fc7b86a6419 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:37.172963 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe2b8a-e28f-4d21-9ce3-9fc7b86a6419 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:37.173454 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe2b8a-e28f-4d21-9ce3-9fc7b86a6419 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:37.174673 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe2b8a-e28f-4d21-9ce3-9fc7b86a6419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:37.178577 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe2b8a-e28f-4d21-9ce3-9fc7b86a6419 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:37.313221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1296/2554] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:31:37 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:31:37.314551 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b32b6-b206-4b15-aeb2-65ec2404fba9 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:37.325654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b32b6-b206-4b15-aeb2-65ec2404fba9 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:37.333346 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a38f6-fa14-46f5-a937-2c472eb5bea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:37.335384 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a38f6-fa14-46f5-a937-2c472eb5bea3 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:37.335384 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a38f6-fa14-46f5-a937-2c472eb5bea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:37.335384 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a38f6-fa14-46f5-a937-2c472eb5bea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:37.335384 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a38f6-fa14-46f5-a937-2c472eb5bea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:37.336826 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a38f6-fa14-46f5-a937-2c472eb5bea3 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:37.349096 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1259/2555] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:31:37.354565 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe2b8a-e28f-4d21-9ce3-9fc7b86a6419 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:37.365030 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe2b8a-e28f-4d21-9ce3-9fc7b86a6419 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:37.370618 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79312e67-0b0f-4e14-b6fe-598fb3b46210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:37.371291 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79312e67-0b0f-4e14-b6fe-598fb3b46210 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:37.371581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79312e67-0b0f-4e14-b6fe-598fb3b46210 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:37.371870 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79312e67-0b0f-4e14-b6fe-598fb3b46210 admin admin] PATH_INFO: `/v3/projects/e2eee382f5e14a52a8f0696582f0ac1b/users/f0b96ee723e8451d84fa5ba59a1512e9/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:37.387718 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79312e67-0b0f-4e14-b6fe-598fb3b46210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2eee382f5e14a52a8f0696582f0ac1b, user_id=f0b96ee723e8451d84fa5ba59a1512e9, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:37.390480 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79312e67-0b0f-4e14-b6fe-598fb3b46210 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:37.499583 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1297/2556] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:31:37 2022] PUT /identity/v3/projects/e2eee382f5e14a52a8f0696582f0ac1b/users/f0b96ee723e8451d84fa5ba59a1512e9/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:31:37.506117 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a38f6-fa14-46f5-a937-2c472eb5bea3 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:37.523697 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a38f6-fa14-46f5-a937-2c472eb5bea3 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:37.599253 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b83c9a-2e96-4f39-bb0d-72f21745c0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:37.599547 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b83c9a-2e96-4f39-bb0d-72f21745c0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:37.599735 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b83c9a-2e96-4f39-bb0d-72f21745c0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:37.599993 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b83c9a-2e96-4f39-bb0d-72f21745c0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:37.600678 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b83c9a-2e96-4f39-bb0d-72f21745c0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:37.603736 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b83c9a-2e96-4f39-bb0d-72f21745c0a5 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:37.614661 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1260/2557] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:31:37.620006 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79312e67-0b0f-4e14-b6fe-598fb3b46210 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:37.631480 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79312e67-0b0f-4e14-b6fe-598fb3b46210 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:37.636381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4fc44-ce75-40d5-b4ae-110645acffb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:37.637055 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4fc44-ce75-40d5-b4ae-110645acffb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:37.637341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4fc44-ce75-40d5-b4ae-110645acffb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:37.637621 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4fc44-ce75-40d5-b4ae-110645acffb8 admin admin] PATH_INFO: `/v3/projects/e2eee382f5e14a52a8f0696582f0ac1b/users/f0b96ee723e8451d84fa5ba59a1512e9/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:37.639601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4fc44-ce75-40d5-b4ae-110645acffb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2eee382f5e14a52a8f0696582f0ac1b, user_id=f0b96ee723e8451d84fa5ba59a1512e9, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:37.642330 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4fc44-ce75-40d5-b4ae-110645acffb8 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:37.658782 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1298/2558] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:31:37 2022] PUT /identity/v3/projects/e2eee382f5e14a52a8f0696582f0ac1b/users/f0b96ee723e8451d84fa5ba59a1512e9/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:37.739998 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ed05e-934c-4fc0-ac79-2f8ffc5621af None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:37.739998 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ed05e-934c-4fc0-ac79-2f8ffc5621af None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:37.739998 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ed05e-934c-4fc0-ac79-2f8ffc5621af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:37.740985 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:37.772679 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-a98ed05e-934c-4fc0-ac79-2f8ffc5621af None None] MFA Rules not processed for user `f0b96ee723e8451d84fa5ba59a1512e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:37.772679 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-a98ed05e-934c-4fc0-ac79-2f8ffc5621af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:37.866460 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1261/2559] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:37.882792 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4fc44-ce75-40d5-b4ae-110645acffb8 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:37.885463 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-08c4fc44-ce75-40d5-b4ae-110645acffb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:37.991004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4fc44-ce75-40d5-b4ae-110645acffb8 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:37.995889 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed07cab-7a56-4d51-8c5c-65b3d7661a99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:37.996819 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed07cab-7a56-4d51-8c5c-65b3d7661a99 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:37.997129 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed07cab-7a56-4d51-8c5c-65b3d7661a99 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:37.997413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed07cab-7a56-4d51-8c5c-65b3d7661a99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:38.064817 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed07cab-7a56-4d51-8c5c-65b3d7661a99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:38.066274 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed07cab-7a56-4d51-8c5c-65b3d7661a99 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:38.079988 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1299/2560] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:31:41.513205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ed05e-934c-4fc0-ac79-2f8ffc5621af None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:41.581505 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ed05e-934c-4fc0-ac79-2f8ffc5621af None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:41.586074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f9e2d-af9a-46eb-a75a-60f284dc0b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:41.586735 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f9e2d-af9a-46eb-a75a-60f284dc0b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:41.587027 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f9e2d-af9a-46eb-a75a-60f284dc0b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:41.587305 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f9e2d-af9a-46eb-a75a-60f284dc0b80 admin admin] PATH_INFO: `/v3/users/124d062eee95454ab74582538589b799` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:41.589142 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f9e2d-af9a-46eb-a75a-60f284dc0b80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=124d062eee95454ab74582538589b799)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:41.591142 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f9e2d-af9a-46eb-a75a-60f284dc0b80 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:41.833726 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-938f9e2d-af9a-46eb-a75a-60f284dc0b80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '124d062eee95454ab74582538589b799'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:41.834407 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-938f9e2d-af9a-46eb-a75a-60f284dc0b80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '124d062eee95454ab74582538589b799'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:41.842507 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-938f9e2d-af9a-46eb-a75a-60f284dc0b80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '124d062eee95454ab74582538589b799'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:41.856274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-938f9e2d-af9a-46eb-a75a-60f284dc0b80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '124d062eee95454ab74582538589b799'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:41.857039 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-938f9e2d-af9a-46eb-a75a-60f284dc0b80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '124d062eee95454ab74582538589b799'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:41.960747 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1262/2561] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:31:41 2022] DELETE /identity/v3/users/124d062eee95454ab74582538589b799 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:31:41.965872 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16e398-abb8-414b-aad6-a28f9994651c None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:41.966396 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16e398-abb8-414b-aad6-a28f9994651c None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:41.966524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16e398-abb8-414b-aad6-a28f9994651c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:41.985943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-ca16e398-abb8-414b-aad6-a28f9994651c None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:41.987186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ca16e398-abb8-414b-aad6-a28f9994651c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:42.030551 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:42.049746 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1300/2562] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:42.060226 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f9e2d-af9a-46eb-a75a-60f284dc0b80 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:42.061930 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-938f9e2d-af9a-46eb-a75a-60f284dc0b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:42.072383 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:42.125468 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f9e2d-af9a-46eb-a75a-60f284dc0b80 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:42.129073 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53472c-c67b-466e-bca0-96040e07070a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:42.129704 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53472c-c67b-466e-bca0-96040e07070a service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:42.130013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53472c-c67b-466e-bca0-96040e07070a service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:42.130292 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53472c-c67b-466e-bca0-96040e07070a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:42.140230 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53472c-c67b-466e-bca0-96040e07070a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:42.141928 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53472c-c67b-466e-bca0-96040e07070a service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:42.151916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1263/2563] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:31:42.657431 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16e398-abb8-414b-aad6-a28f9994651c None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:42.659191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ca16e398-abb8-414b-aad6-a28f9994651c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:42.673489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16e398-abb8-414b-aad6-a28f9994651c None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:42.679795 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf561b-a58b-4ee0-9eda-bd0483033ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:42.680620 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf561b-a58b-4ee0-9eda-bd0483033ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:42.681327 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf561b-a58b-4ee0-9eda-bd0483033ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:42.681761 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf561b-a58b-4ee0-9eda-bd0483033ac6 admin admin] PATH_INFO: `/v3/projects/d291eefd77e249a197e2ac7246d7a76d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:42.683430 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf561b-a58b-4ee0-9eda-bd0483033ac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d291eefd77e249a197e2ac7246d7a76d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:42.686943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf561b-a58b-4ee0-9eda-bd0483033ac6 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:42.904045 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-18cf561b-a58b-4ee0-9eda-bd0483033ac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd291eefd77e249a197e2ac7246d7a76d', 'request_id': 'req-18cf561b-a58b-4ee0-9eda-bd0483033ac6'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:42.911155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-18cf561b-a58b-4ee0-9eda-bd0483033ac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd291eefd77e249a197e2ac7246d7a76d', 'request_id': 'req-18cf561b-a58b-4ee0-9eda-bd0483033ac6'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:42.917935 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-18cf561b-a58b-4ee0-9eda-bd0483033ac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd291eefd77e249a197e2ac7246d7a76d', 'request_id': 'req-18cf561b-a58b-4ee0-9eda-bd0483033ac6'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:42.994923 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-18cf561b-a58b-4ee0-9eda-bd0483033ac6 admin admin] The token cache is being invalidate because project d291eefd77e249a197e2ac7246d7a76d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:31:42.995602 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-18cf561b-a58b-4ee0-9eda-bd0483033ac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:42.996111 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-18cf561b-a58b-4ee0-9eda-bd0483033ac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:42.998036 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1301/2564] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:31:42 2022] DELETE /identity/v3/projects/d291eefd77e249a197e2ac7246d7a76d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:43.002188 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53472c-c67b-466e-bca0-96040e07070a service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:43.014960 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53472c-c67b-466e-bca0-96040e07070a service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:43.079834 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e956576-bf5e-4eac-9518-20fcb9375a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:43.080488 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e956576-bf5e-4eac-9518-20fcb9375a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:43.080766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e956576-bf5e-4eac-9518-20fcb9375a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:43.081045 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e956576-bf5e-4eac-9518-20fcb9375a4d admin admin] PATH_INFO: `/v3/users/f0b96ee723e8451d84fa5ba59a1512e9` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:43.082262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e956576-bf5e-4eac-9518-20fcb9375a4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b96ee723e8451d84fa5ba59a1512e9)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:43.084245 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e956576-bf5e-4eac-9518-20fcb9375a4d admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:43.409552 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-8e956576-bf5e-4eac-9518-20fcb9375a4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b96ee723e8451d84fa5ba59a1512e9'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:43.410273 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-8e956576-bf5e-4eac-9518-20fcb9375a4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b96ee723e8451d84fa5ba59a1512e9'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:43.418144 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-8e956576-bf5e-4eac-9518-20fcb9375a4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b96ee723e8451d84fa5ba59a1512e9'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:43.431002 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-8e956576-bf5e-4eac-9518-20fcb9375a4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b96ee723e8451d84fa5ba59a1512e9'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:43.431751 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-8e956576-bf5e-4eac-9518-20fcb9375a4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b96ee723e8451d84fa5ba59a1512e9'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:43.515096 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1264/2565] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:31:43 2022] DELETE /identity/v3/users/f0b96ee723e8451d84fa5ba59a1512e9 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:44.076910 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf561b-a58b-4ee0-9eda-bd0483033ac6 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:44.078409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-18cf561b-a58b-4ee0-9eda-bd0483033ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:44.097639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf561b-a58b-4ee0-9eda-bd0483033ac6 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:44.162268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62223d27-d9a9-4c13-ba39-215f9947b201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:44.162939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62223d27-d9a9-4c13-ba39-215f9947b201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:44.163224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62223d27-d9a9-4c13-ba39-215f9947b201 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:44.163500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62223d27-d9a9-4c13-ba39-215f9947b201 admin admin] PATH_INFO: `/v3/projects/e2eee382f5e14a52a8f0696582f0ac1b` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:44.164699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62223d27-d9a9-4c13-ba39-215f9947b201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2eee382f5e14a52a8f0696582f0ac1b)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:44.166663 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62223d27-d9a9-4c13-ba39-215f9947b201 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:44.368400 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-62223d27-d9a9-4c13-ba39-215f9947b201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2eee382f5e14a52a8f0696582f0ac1b', 'request_id': 'req-62223d27-d9a9-4c13-ba39-215f9947b201'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:44.380018 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-62223d27-d9a9-4c13-ba39-215f9947b201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2eee382f5e14a52a8f0696582f0ac1b', 'request_id': 'req-62223d27-d9a9-4c13-ba39-215f9947b201'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:44.387066 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-62223d27-d9a9-4c13-ba39-215f9947b201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2eee382f5e14a52a8f0696582f0ac1b', 'request_id': 'req-62223d27-d9a9-4c13-ba39-215f9947b201'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:44.509487 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:44.515523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-62223d27-d9a9-4c13-ba39-215f9947b201 admin admin] The token cache is being invalidate because project e2eee382f5e14a52a8f0696582f0ac1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:31:44.515819 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-62223d27-d9a9-4c13-ba39-215f9947b201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:44.516496 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-62223d27-d9a9-4c13-ba39-215f9947b201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:44.518098 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1302/2566] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:31:44 2022] DELETE /identity/v3/projects/e2eee382f5e14a52a8f0696582f0ac1b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:44.523833 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f487cad-6f44-4f2b-bbb3-5226e9c31108 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:44.524333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f487cad-6f44-4f2b-bbb3-5226e9c31108 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:44.524431 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f487cad-6f44-4f2b-bbb3-5226e9c31108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:44.545250 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-6f487cad-6f44-4f2b-bbb3-5226e9c31108 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:44.546481 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-6f487cad-6f44-4f2b-bbb3-5226e9c31108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:44.572978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:44.611191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1265/2567] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:44.619380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca419f12-e88b-40e3-9547-a2e98966296b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:44.619595 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca419f12-e88b-40e3-9547-a2e98966296b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:44.619914 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca419f12-e88b-40e3-9547-a2e98966296b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:44.641484 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-ca419f12-e88b-40e3-9547-a2e98966296b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:44.642766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ca419f12-e88b-40e3-9547-a2e98966296b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:44.655237 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1303/2568] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:44.660404 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f487cad-6f44-4f2b-bbb3-5226e9c31108 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:44.671326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f487cad-6f44-4f2b-bbb3-5226e9c31108 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:44.676093 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406acb6-851f-47a1-ad33-bd224ab33f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:44.676836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406acb6-851f-47a1-ad33-bd224ab33f12 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:44.677033 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406acb6-851f-47a1-ad33-bd224ab33f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:44.677452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406acb6-851f-47a1-ad33-bd224ab33f12 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:44.677965 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406acb6-851f-47a1-ad33-bd224ab33f12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:31:44.678366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406acb6-851f-47a1-ad33-bd224ab33f12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:44.679964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406acb6-851f-47a1-ad33-bd224ab33f12 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:44.702293 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1266/2569] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:31:44.707334 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca419f12-e88b-40e3-9547-a2e98966296b None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:44.723518 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca419f12-e88b-40e3-9547-a2e98966296b None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:44.728643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75536f5f-de12-498f-9a54-68e3f5ccba0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:44.729256 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75536f5f-de12-498f-9a54-68e3f5ccba0c admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:44.730095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75536f5f-de12-498f-9a54-68e3f5ccba0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:44.730374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75536f5f-de12-498f-9a54-68e3f5ccba0c admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:44.731039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75536f5f-de12-498f-9a54-68e3f5ccba0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:44.732967 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75536f5f-de12-498f-9a54-68e3f5ccba0c admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:44.847336 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1304/2570] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:31:44 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:31:44.851636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406acb6-851f-47a1-ad33-bd224ab33f12 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:44.863241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406acb6-851f-47a1-ad33-bd224ab33f12 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:44.924564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6337ece-5936-45c1-ac14-0168ed8cabff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:44.925180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6337ece-5936-45c1-ac14-0168ed8cabff admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:44.925461 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6337ece-5936-45c1-ac14-0168ed8cabff admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:44.925739 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6337ece-5936-45c1-ac14-0168ed8cabff admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:44.926418 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6337ece-5936-45c1-ac14-0168ed8cabff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:44.928346 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6337ece-5936-45c1-ac14-0168ed8cabff admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:45.013081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1267/2571] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:31:44 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:31:45.017095 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75536f5f-de12-498f-9a54-68e3f5ccba0c admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:45.031029 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75536f5f-de12-498f-9a54-68e3f5ccba0c admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:45.036699 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa3c31-a06b-44b2-a18f-ac2c1936859f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:45.036819 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa3c31-a06b-44b2-a18f-ac2c1936859f admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:45.037178 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa3c31-a06b-44b2-a18f-ac2c1936859f admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:45.037473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa3c31-a06b-44b2-a18f-ac2c1936859f admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:45.038175 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa3c31-a06b-44b2-a18f-ac2c1936859f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:45.039793 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa3c31-a06b-44b2-a18f-ac2c1936859f admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:45.053963 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1305/2572] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:31:45.055129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6337ece-5936-45c1-ac14-0168ed8cabff admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:45.071178 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6337ece-5936-45c1-ac14-0168ed8cabff admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:45.076930 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c084ed-9c94-468c-a0f7-22976c2d158d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:45.077540 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c084ed-9c94-468c-a0f7-22976c2d158d admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:45.077793 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c084ed-9c94-468c-a0f7-22976c2d158d admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:45.078438 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c084ed-9c94-468c-a0f7-22976c2d158d admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:45.078814 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c084ed-9c94-468c-a0f7-22976c2d158d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:45.081082 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c084ed-9c94-468c-a0f7-22976c2d158d admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:45.096805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1268/2573] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:31:45.101136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa3c31-a06b-44b2-a18f-ac2c1936859f admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:45.112373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa3c31-a06b-44b2-a18f-ac2c1936859f admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:45.118864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85857b10-b0a5-423a-8e85-1d8622268b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:45.118864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85857b10-b0a5-423a-8e85-1d8622268b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:45.119140 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85857b10-b0a5-423a-8e85-1d8622268b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:45.119400 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85857b10-b0a5-423a-8e85-1d8622268b57 admin admin] PATH_INFO: `/v3/projects/1d6f1a996ba54bc0b239bc0e61aa385d/users/8eb916bdb20e48e9b715b3dd7e547996/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:45.137737 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85857b10-b0a5-423a-8e85-1d8622268b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d6f1a996ba54bc0b239bc0e61aa385d, user_id=8eb916bdb20e48e9b715b3dd7e547996, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:45.140504 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85857b10-b0a5-423a-8e85-1d8622268b57 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:45.230767 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1306/2574] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:31:45 2022] PUT /identity/v3/projects/1d6f1a996ba54bc0b239bc0e61aa385d/users/8eb916bdb20e48e9b715b3dd7e547996/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:45.243981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d97dc1-e3e1-4ada-befe-c26c82c4c11a None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:45.244372 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d97dc1-e3e1-4ada-befe-c26c82c4c11a None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:45.244731 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d97dc1-e3e1-4ada-befe-c26c82c4c11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:45.277795 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-61d97dc1-e3e1-4ada-befe-c26c82c4c11a None None] MFA Rules not processed for user `8eb916bdb20e48e9b715b3dd7e547996`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:45.279050 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-61d97dc1-e3e1-4ada-befe-c26c82c4c11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:45.365710 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1269/2575] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:45.371780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85857b10-b0a5-423a-8e85-1d8622268b57 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:45.448983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85857b10-b0a5-423a-8e85-1d8622268b57 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:45.454301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84bf8f-e25f-4c80-b6f9-29a0e1d0ff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:45.454921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84bf8f-e25f-4c80-b6f9-29a0e1d0ff4e admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:45.455209 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84bf8f-e25f-4c80-b6f9-29a0e1d0ff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:45.455495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84bf8f-e25f-4c80-b6f9-29a0e1d0ff4e admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:45.456203 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84bf8f-e25f-4c80-b6f9-29a0e1d0ff4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:45.458188 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84bf8f-e25f-4c80-b6f9-29a0e1d0ff4e admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:45.616864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1307/2576] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:31:45 2022] POST /identity/v3/projects => generated 383 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:31:45.618684 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d97dc1-e3e1-4ada-befe-c26c82c4c11a None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:45.631661 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d97dc1-e3e1-4ada-befe-c26c82c4c11a None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:45.657463 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:45.699069 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b00c49-fb81-43b0-be11-705e4e4a7c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:45.699620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b00c49-fb81-43b0-be11-705e4e4a7c8a admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:45.699906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b00c49-fb81-43b0-be11-705e4e4a7c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:45.700183 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b00c49-fb81-43b0-be11-705e4e4a7c8a admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:45.700828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b00c49-fb81-43b0-be11-705e4e4a7c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:45.702975 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b00c49-fb81-43b0-be11-705e4e4a7c8a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:45.881204 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1270/2577] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:31:45 2022] POST /identity/v3/users => generated 292 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:31:45.885961 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84bf8f-e25f-4c80-b6f9-29a0e1d0ff4e admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:45.896652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84bf8f-e25f-4c80-b6f9-29a0e1d0ff4e admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:45.901448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b08a6-4438-41b2-a7bb-6294085a8031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:45.902086 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b08a6-4438-41b2-a7bb-6294085a8031 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:45.902372 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b08a6-4438-41b2-a7bb-6294085a8031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:45.902652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b08a6-4438-41b2-a7bb-6294085a8031 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:45.903306 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b08a6-4438-41b2-a7bb-6294085a8031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:45.904968 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b08a6-4438-41b2-a7bb-6294085a8031 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:45.919103 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1308/2578] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:31:45.923359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b00c49-fb81-43b0-be11-705e4e4a7c8a admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:45.934520 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b00c49-fb81-43b0-be11-705e4e4a7c8a admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:45.939962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750c6ea-38ee-49e0-a634-0c4b0970e553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:45.940577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750c6ea-38ee-49e0-a634-0c4b0970e553 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:45.940859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750c6ea-38ee-49e0-a634-0c4b0970e553 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:45.941143 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750c6ea-38ee-49e0-a634-0c4b0970e553 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:45.941799 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750c6ea-38ee-49e0-a634-0c4b0970e553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:45.943425 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750c6ea-38ee-49e0-a634-0c4b0970e553 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:45.953974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1271/2579] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:31:45.958414 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b08a6-4438-41b2-a7bb-6294085a8031 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:45.972313 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b08a6-4438-41b2-a7bb-6294085a8031 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:45.980191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a4d89-2140-49bb-a799-488c6cf900b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:45.981055 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a4d89-2140-49bb-a799-488c6cf900b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:45.981339 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a4d89-2140-49bb-a799-488c6cf900b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:45.981656 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a4d89-2140-49bb-a799-488c6cf900b9 admin admin] PATH_INFO: `/v3/projects/99b7a13ad5f0434ab9b7c7aa466f45f0/users/b3b90258f0c94d3da478100394bfa576/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:45.998821 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a4d89-2140-49bb-a799-488c6cf900b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b7a13ad5f0434ab9b7c7aa466f45f0, user_id=b3b90258f0c94d3da478100394bfa576, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:46.001867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a4d89-2140-49bb-a799-488c6cf900b9 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:46.236249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1309/2580] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:31:45 2022] PUT /identity/v3/projects/99b7a13ad5f0434ab9b7c7aa466f45f0/users/b3b90258f0c94d3da478100394bfa576/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:31:46.249559 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d943d-7bd4-431f-96c4-b0330e22d285 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:46.250025 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d943d-7bd4-431f-96c4-b0330e22d285 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:46.250405 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d943d-7bd4-431f-96c4-b0330e22d285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:46.284011 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-7f3d943d-7bd4-431f-96c4-b0330e22d285 None None] MFA Rules not processed for user `b3b90258f0c94d3da478100394bfa576`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:46.285297 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-7f3d943d-7bd4-431f-96c4-b0330e22d285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:46.362636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1272/2581] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:46.367895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a4d89-2140-49bb-a799-488c6cf900b9 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:46.427182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:46.445953 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a4d89-2140-49bb-a799-488c6cf900b9 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:46.450995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df627f48-106e-46e7-abce-bd46d0b9b298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:46.451665 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df627f48-106e-46e7-abce-bd46d0b9b298 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:46.451948 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df627f48-106e-46e7-abce-bd46d0b9b298 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:46.452217 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df627f48-106e-46e7-abce-bd46d0b9b298 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:46.453101 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df627f48-106e-46e7-abce-bd46d0b9b298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:46.454996 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df627f48-106e-46e7-abce-bd46d0b9b298 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:46.569991 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1310/2582] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:31:46 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:31:46.571085 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d943d-7bd4-431f-96c4-b0330e22d285 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:46.582360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d943d-7bd4-431f-96c4-b0330e22d285 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:46.651320 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed8f0c-7340-4d83-934e-cc0cbc0b76fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:46.652272 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed8f0c-7340-4d83-934e-cc0cbc0b76fb admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:46.652652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed8f0c-7340-4d83-934e-cc0cbc0b76fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:46.653010 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed8f0c-7340-4d83-934e-cc0cbc0b76fb admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:46.653742 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed8f0c-7340-4d83-934e-cc0cbc0b76fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:46.655732 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed8f0c-7340-4d83-934e-cc0cbc0b76fb admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:46.778497 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1273/2583] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:31:46 2022] POST /identity/v3/users => generated 299 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:31:46.780645 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df627f48-106e-46e7-abce-bd46d0b9b298 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:46.792109 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df627f48-106e-46e7-abce-bd46d0b9b298 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:46.798421 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c2839-b2f0-407b-8558-97cfb0cb8868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:46.801781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c2839-b2f0-407b-8558-97cfb0cb8868 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:46.801781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c2839-b2f0-407b-8558-97cfb0cb8868 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:46.801781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c2839-b2f0-407b-8558-97cfb0cb8868 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:46.801781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c2839-b2f0-407b-8558-97cfb0cb8868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:46.802457 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c2839-b2f0-407b-8558-97cfb0cb8868 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:46.821696 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1311/2584] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:31:46.823107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed8f0c-7340-4d83-934e-cc0cbc0b76fb admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:46.834835 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed8f0c-7340-4d83-934e-cc0cbc0b76fb admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:46.841195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13eb3e4-430f-4f8c-a407-7b36dec534ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:46.842074 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13eb3e4-430f-4f8c-a407-7b36dec534ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:46.842467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13eb3e4-430f-4f8c-a407-7b36dec534ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:46.842882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13eb3e4-430f-4f8c-a407-7b36dec534ac admin admin] PATH_INFO: `/v3/projects/40365bdf793e42078ed73b983593ad81/users/3fd7e3a923704f2481af5c119fc49927/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:46.864193 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13eb3e4-430f-4f8c-a407-7b36dec534ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=40365bdf793e42078ed73b983593ad81, user_id=3fd7e3a923704f2481af5c119fc49927, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:46.867186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13eb3e4-430f-4f8c-a407-7b36dec534ac admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:46.938104 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:46.948693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1274/2585] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:31:46 2022] PUT /identity/v3/projects/40365bdf793e42078ed73b983593ad81/users/3fd7e3a923704f2481af5c119fc49927/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:46.950464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c2839-b2f0-407b-8558-97cfb0cb8868 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:46.966030 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c2839-b2f0-407b-8558-97cfb0cb8868 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:47.040697 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc80f7-a0a7-494c-ab23-5301f0c96103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:47.041414 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc80f7-a0a7-494c-ab23-5301f0c96103 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:47.042406 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc80f7-a0a7-494c-ab23-5301f0c96103 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:47.042865 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc80f7-a0a7-494c-ab23-5301f0c96103 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:47.043670 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc80f7-a0a7-494c-ab23-5301f0c96103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:47.045445 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc80f7-a0a7-494c-ab23-5301f0c96103 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:47.061648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1312/2586] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:31:47.063021 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13eb3e4-430f-4f8c-a407-7b36dec534ac admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:47.077223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13eb3e4-430f-4f8c-a407-7b36dec534ac admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:47.083125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe1b98-cbb5-4bb2-805c-64821cba25ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:47.083817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe1b98-cbb5-4bb2-805c-64821cba25ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:47.084101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe1b98-cbb5-4bb2-805c-64821cba25ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:47.084766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe1b98-cbb5-4bb2-805c-64821cba25ab admin admin] PATH_INFO: `/v3/projects/40365bdf793e42078ed73b983593ad81/users/3fd7e3a923704f2481af5c119fc49927/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:47.087228 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe1b98-cbb5-4bb2-805c-64821cba25ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=40365bdf793e42078ed73b983593ad81, user_id=3fd7e3a923704f2481af5c119fc49927, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:47.091227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe1b98-cbb5-4bb2-805c-64821cba25ab admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:47.110744 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1275/2587] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:31:47 2022] PUT /identity/v3/projects/40365bdf793e42078ed73b983593ad81/users/3fd7e3a923704f2481af5c119fc49927/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:31:47.122642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e917b-f8ba-456a-ae12-df91ca86104d None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:47.123127 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e917b-f8ba-456a-ae12-df91ca86104d None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:47.123605 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e917b-f8ba-456a-ae12-df91ca86104d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:47.169269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-aa3e917b-f8ba-456a-ae12-df91ca86104d None None] MFA Rules not processed for user `3fd7e3a923704f2481af5c119fc49927`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:47.170665 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-aa3e917b-f8ba-456a-ae12-df91ca86104d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:47.277541 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1313/2588] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:47.285728 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe1b98-cbb5-4bb2-805c-64821cba25ab admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:47.287642 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-7bbe1b98-cbb5-4bb2-805c-64821cba25ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:47.493208 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe1b98-cbb5-4bb2-805c-64821cba25ab admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:47.499336 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658b114-bd75-4070-b440-a183eada8db7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:47.499587 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658b114-bd75-4070-b440-a183eada8db7 service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:47.499866 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658b114-bd75-4070-b440-a183eada8db7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:47.500096 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658b114-bd75-4070-b440-a183eada8db7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:47.569454 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658b114-bd75-4070-b440-a183eada8db7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:47.571541 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658b114-bd75-4070-b440-a183eada8db7 service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:47.582111 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1276/2589] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:31:49.752007 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e917b-f8ba-456a-ae12-df91ca86104d None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:49.753675 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-aa3e917b-f8ba-456a-ae12-df91ca86104d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:49.766129 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e917b-f8ba-456a-ae12-df91ca86104d None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:49.769906 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f55d20-4e9d-4c23-8eb1-ad7af80cf959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:49.770527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f55d20-4e9d-4c23-8eb1-ad7af80cf959 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:49.770811 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f55d20-4e9d-4c23-8eb1-ad7af80cf959 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:49.771085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f55d20-4e9d-4c23-8eb1-ad7af80cf959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:49.812479 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:49.832628 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f55d20-4e9d-4c23-8eb1-ad7af80cf959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:49.834128 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f55d20-4e9d-4c23-8eb1-ad7af80cf959 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:49.843733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1314/2590] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:31:51.724518 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658b114-bd75-4070-b440-a183eada8db7 service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:51.734254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658b114-bd75-4070-b440-a183eada8db7 service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:51.750337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3e69e-b488-4379-ac72-6ed9a13c1df8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:51.750337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3e69e-b488-4379-ac72-6ed9a13c1df8 service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:51.750337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3e69e-b488-4379-ac72-6ed9a13c1df8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:51.750337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3e69e-b488-4379-ac72-6ed9a13c1df8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:51.750777 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3e69e-b488-4379-ac72-6ed9a13c1df8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:51.751318 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3e69e-b488-4379-ac72-6ed9a13c1df8 service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:51.762188 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1277/2591] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:31:56.571791 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f55d20-4e9d-4c23-8eb1-ad7af80cf959 service cinder] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:56.635083 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f55d20-4e9d-4c23-8eb1-ad7af80cf959 service cinder] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:56.639915 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d64729-4fba-4c7d-84f0-6dbb9edcf65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:56.640548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d64729-4fba-4c7d-84f0-6dbb9edcf65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:56.640836 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d64729-4fba-4c7d-84f0-6dbb9edcf65a admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:56.641214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d64729-4fba-4c7d-84f0-6dbb9edcf65a admin admin] PATH_INFO: `/v3/users/8eb916bdb20e48e9b715b3dd7e547996` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:56.642320 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d64729-4fba-4c7d-84f0-6dbb9edcf65a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eb916bdb20e48e9b715b3dd7e547996)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:56.644298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d64729-4fba-4c7d-84f0-6dbb9edcf65a admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:56.957532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-27d64729-4fba-4c7d-84f0-6dbb9edcf65a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eb916bdb20e48e9b715b3dd7e547996'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:56.958195 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-27d64729-4fba-4c7d-84f0-6dbb9edcf65a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eb916bdb20e48e9b715b3dd7e547996'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:56.970245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-27d64729-4fba-4c7d-84f0-6dbb9edcf65a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eb916bdb20e48e9b715b3dd7e547996'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:56.977145 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-27d64729-4fba-4c7d-84f0-6dbb9edcf65a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eb916bdb20e48e9b715b3dd7e547996'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:56.977868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-27d64729-4fba-4c7d-84f0-6dbb9edcf65a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eb916bdb20e48e9b715b3dd7e547996'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:57.141517 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1315/2592] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:31:56 2022] DELETE /identity/v3/users/8eb916bdb20e48e9b715b3dd7e547996 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:57.146637 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f1070-ebe1-4c15-ba25-74f35c84a0f6 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:57.147162 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f1070-ebe1-4c15-ba25-74f35c84a0f6 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:57.147274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f1070-ebe1-4c15-ba25-74f35c84a0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:57.169010 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-286f1070-ebe1-4c15-ba25-74f35c84a0f6 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:31:57.170296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-286f1070-ebe1-4c15-ba25-74f35c84a0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:57.233568 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1278/2593] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:31:57.243798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d64729-4fba-4c7d-84f0-6dbb9edcf65a admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:57.245277 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-27d64729-4fba-4c7d-84f0-6dbb9edcf65a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:57.306413 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d64729-4fba-4c7d-84f0-6dbb9edcf65a admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:57.310869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d231a3-927f-4812-b073-af2f7663b9db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:57.311487 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d231a3-927f-4812-b073-af2f7663b9db service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:57.311776 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d231a3-927f-4812-b073-af2f7663b9db service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:57.312054 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d231a3-927f-4812-b073-af2f7663b9db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:57.322610 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d231a3-927f-4812-b073-af2f7663b9db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:57.324908 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d231a3-927f-4812-b073-af2f7663b9db service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:57.330160 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:57.335071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1316/2594] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:31:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:31:57.978361 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f1070-ebe1-4c15-ba25-74f35c84a0f6 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:57.980178 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-286f1070-ebe1-4c15-ba25-74f35c84a0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:57.993984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f1070-ebe1-4c15-ba25-74f35c84a0f6 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:58.000314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f749cd-7039-48d6-86f0-42209196108e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:58.000972 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f749cd-7039-48d6-86f0-42209196108e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:58.001293 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f749cd-7039-48d6-86f0-42209196108e admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:58.001641 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f749cd-7039-48d6-86f0-42209196108e admin admin] PATH_INFO: `/v3/projects/1d6f1a996ba54bc0b239bc0e61aa385d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:58.002907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f749cd-7039-48d6-86f0-42209196108e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d6f1a996ba54bc0b239bc0e61aa385d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:58.004911 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f749cd-7039-48d6-86f0-42209196108e admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:58.030664 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:58.299142 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-b5f749cd-7039-48d6-86f0-42209196108e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d6f1a996ba54bc0b239bc0e61aa385d', 'request_id': 'req-b5f749cd-7039-48d6-86f0-42209196108e'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:58.305182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-b5f749cd-7039-48d6-86f0-42209196108e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d6f1a996ba54bc0b239bc0e61aa385d', 'request_id': 'req-b5f749cd-7039-48d6-86f0-42209196108e'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:58.311655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-b5f749cd-7039-48d6-86f0-42209196108e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d6f1a996ba54bc0b239bc0e61aa385d', 'request_id': 'req-b5f749cd-7039-48d6-86f0-42209196108e'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:58.490772 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-b5f749cd-7039-48d6-86f0-42209196108e admin admin] The token cache is being invalidate because project 1d6f1a996ba54bc0b239bc0e61aa385d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:31:58.491476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-b5f749cd-7039-48d6-86f0-42209196108e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:58.491957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-b5f749cd-7039-48d6-86f0-42209196108e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:58.493514 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1279/2595] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:31:57 2022] DELETE /identity/v3/projects/1d6f1a996ba54bc0b239bc0e61aa385d => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:58.498515 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d231a3-927f-4812-b073-af2f7663b9db service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:58.508758 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d231a3-927f-4812-b073-af2f7663b9db service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:58.570457 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d88c1-c96c-4241-8f57-06c7535d5b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:58.571086 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d88c1-c96c-4241-8f57-06c7535d5b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:58.571380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d88c1-c96c-4241-8f57-06c7535d5b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:58.571662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d88c1-c96c-4241-8f57-06c7535d5b1a admin admin] PATH_INFO: `/v3/users/b3b90258f0c94d3da478100394bfa576` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:58.572803 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d88c1-c96c-4241-8f57-06c7535d5b1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3b90258f0c94d3da478100394bfa576)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:58.574903 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d88c1-c96c-4241-8f57-06c7535d5b1a admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:31:58.991320 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-376d88c1-c96c-4241-8f57-06c7535d5b1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3b90258f0c94d3da478100394bfa576'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:58.992009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-376d88c1-c96c-4241-8f57-06c7535d5b1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3b90258f0c94d3da478100394bfa576'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:59.005501 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-376d88c1-c96c-4241-8f57-06c7535d5b1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3b90258f0c94d3da478100394bfa576'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:59.013152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-376d88c1-c96c-4241-8f57-06c7535d5b1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3b90258f0c94d3da478100394bfa576'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:59.013791 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-376d88c1-c96c-4241-8f57-06c7535d5b1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3b90258f0c94d3da478100394bfa576'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:31:59.199740 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1317/2596] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:31:58 2022] DELETE /identity/v3/users/b3b90258f0c94d3da478100394bfa576 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:31:59.839379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f749cd-7039-48d6-86f0-42209196108e admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:31:59.841123 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-b5f749cd-7039-48d6-86f0-42209196108e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:31:59.856014 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f749cd-7039-48d6-86f0-42209196108e admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:31:59.917583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de65c9-1898-4fab-a4c2-28e23c897f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:31:59.918238 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de65c9-1898-4fab-a4c2-28e23c897f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:31:59.918516 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de65c9-1898-4fab-a4c2-28e23c897f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:31:59.918785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de65c9-1898-4fab-a4c2-28e23c897f57 admin admin] PATH_INFO: `/v3/projects/99b7a13ad5f0434ab9b7c7aa466f45f0` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:31:59.919893 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de65c9-1898-4fab-a4c2-28e23c897f57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b7a13ad5f0434ab9b7c7aa466f45f0)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:31:59.922564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de65c9-1898-4fab-a4c2-28e23c897f57 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:00.096514 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-25de65c9-1898-4fab-a4c2-28e23c897f57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b7a13ad5f0434ab9b7c7aa466f45f0', 'request_id': 'req-25de65c9-1898-4fab-a4c2-28e23c897f57'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:00.104689 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-25de65c9-1898-4fab-a4c2-28e23c897f57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b7a13ad5f0434ab9b7c7aa466f45f0', 'request_id': 'req-25de65c9-1898-4fab-a4c2-28e23c897f57'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:00.114983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-25de65c9-1898-4fab-a4c2-28e23c897f57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b7a13ad5f0434ab9b7c7aa466f45f0', 'request_id': 'req-25de65c9-1898-4fab-a4c2-28e23c897f57'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:00.247168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-25de65c9-1898-4fab-a4c2-28e23c897f57 admin admin] The token cache is being invalidate because project 99b7a13ad5f0434ab9b7c7aa466f45f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:32:00.247398 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-25de65c9-1898-4fab-a4c2-28e23c897f57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:00.248105 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-25de65c9-1898-4fab-a4c2-28e23c897f57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:00.250148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1280/2597] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:31:59 2022] DELETE /identity/v3/projects/99b7a13ad5f0434ab9b7c7aa466f45f0 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:32:00.254409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d88c1-c96c-4241-8f57-06c7535d5b1a admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:00.255942 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-376d88c1-c96c-4241-8f57-06c7535d5b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:00.269802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d88c1-c96c-4241-8f57-06c7535d5b1a admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:00.466963 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55a065-aa12-461e-a027-82f7ed079815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:00.468789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55a065-aa12-461e-a027-82f7ed079815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:00.469082 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55a065-aa12-461e-a027-82f7ed079815 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:00.469359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55a065-aa12-461e-a027-82f7ed079815 admin admin] PATH_INFO: `/v3/users/3fd7e3a923704f2481af5c119fc49927` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:00.470584 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55a065-aa12-461e-a027-82f7ed079815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fd7e3a923704f2481af5c119fc49927)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:00.472526 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55a065-aa12-461e-a027-82f7ed079815 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:00.501357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:00.687522 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-8f55a065-aa12-461e-a027-82f7ed079815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fd7e3a923704f2481af5c119fc49927'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:00.688224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-8f55a065-aa12-461e-a027-82f7ed079815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fd7e3a923704f2481af5c119fc49927'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:00.701179 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-8f55a065-aa12-461e-a027-82f7ed079815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fd7e3a923704f2481af5c119fc49927'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:00.709708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-8f55a065-aa12-461e-a027-82f7ed079815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fd7e3a923704f2481af5c119fc49927'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:00.710473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-8f55a065-aa12-461e-a027-82f7ed079815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fd7e3a923704f2481af5c119fc49927'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:00.820573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1318/2598] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:32:00 2022] DELETE /identity/v3/users/3fd7e3a923704f2481af5c119fc49927 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:32:01.526818 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de65c9-1898-4fab-a4c2-28e23c897f57 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:01.529301 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-25de65c9-1898-4fab-a4c2-28e23c897f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:01.544437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de65c9-1898-4fab-a4c2-28e23c897f57 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:01.586639 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:01.618545 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245632b0-b4eb-45e4-89e7-e3bee42a66a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:01.619205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245632b0-b4eb-45e4-89e7-e3bee42a66a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:01.619495 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245632b0-b4eb-45e4-89e7-e3bee42a66a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:01.619771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245632b0-b4eb-45e4-89e7-e3bee42a66a8 admin admin] PATH_INFO: `/v3/projects/40365bdf793e42078ed73b983593ad81` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:01.620931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245632b0-b4eb-45e4-89e7-e3bee42a66a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40365bdf793e42078ed73b983593ad81)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:01.622878 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245632b0-b4eb-45e4-89e7-e3bee42a66a8 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:01.761302 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-245632b0-b4eb-45e4-89e7-e3bee42a66a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40365bdf793e42078ed73b983593ad81', 'request_id': 'req-245632b0-b4eb-45e4-89e7-e3bee42a66a8'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:01.768864 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-245632b0-b4eb-45e4-89e7-e3bee42a66a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40365bdf793e42078ed73b983593ad81', 'request_id': 'req-245632b0-b4eb-45e4-89e7-e3bee42a66a8'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:01.774868 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-245632b0-b4eb-45e4-89e7-e3bee42a66a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40365bdf793e42078ed73b983593ad81', 'request_id': 'req-245632b0-b4eb-45e4-89e7-e3bee42a66a8'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:01.866884 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-245632b0-b4eb-45e4-89e7-e3bee42a66a8 admin admin] The token cache is being invalidate because project 40365bdf793e42078ed73b983593ad81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:32:01.867089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-245632b0-b4eb-45e4-89e7-e3bee42a66a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:01.867870 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-245632b0-b4eb-45e4-89e7-e3bee42a66a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:01.869500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1281/2599] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:32:01 2022] DELETE /identity/v3/projects/40365bdf793e42078ed73b983593ad81 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:32:01.875131 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46295b0-1f54-468a-b5e5-e51c079b3975 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:01.875616 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46295b0-1f54-468a-b5e5-e51c079b3975 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:01.875727 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46295b0-1f54-468a-b5e5-e51c079b3975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:01.896447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-d46295b0-1f54-468a-b5e5-e51c079b3975 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:01.897648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-d46295b0-1f54-468a-b5e5-e51c079b3975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:01.959593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1319/2600] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:32:01.969590 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ecdb6-d66d-4218-82fa-2d7113df793c None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:01.969904 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ecdb6-d66d-4218-82fa-2d7113df793c None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:01.970191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ecdb6-d66d-4218-82fa-2d7113df793c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:01.992332 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-5d3ecdb6-d66d-4218-82fa-2d7113df793c None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:01.993542 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-5d3ecdb6-d66d-4218-82fa-2d7113df793c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:02.002344 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1282/2601] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:32:02.006995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46295b0-1f54-468a-b5e5-e51c079b3975 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:02.017434 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46295b0-1f54-468a-b5e5-e51c079b3975 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:02.022363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39dffc-09bd-41fa-8435-cf57db162351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:02.022976 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39dffc-09bd-41fa-8435-cf57db162351 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:02.023260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39dffc-09bd-41fa-8435-cf57db162351 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:02.023533 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39dffc-09bd-41fa-8435-cf57db162351 admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:02.024192 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39dffc-09bd-41fa-8435-cf57db162351 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:32:02.024490 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39dffc-09bd-41fa-8435-cf57db162351 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:02.026163 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39dffc-09bd-41fa-8435-cf57db162351 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:02.039425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1320/2602] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:32:02.043914 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ecdb6-d66d-4218-82fa-2d7113df793c None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:02.054336 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ecdb6-d66d-4218-82fa-2d7113df793c None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:02.059044 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba374094-b55b-4313-b837-b0f9886c2f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:02.059640 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba374094-b55b-4313-b837-b0f9886c2f98 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:02.059922 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba374094-b55b-4313-b837-b0f9886c2f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:02.060197 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba374094-b55b-4313-b837-b0f9886c2f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:02.061570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba374094-b55b-4313-b837-b0f9886c2f98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:02.064198 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba374094-b55b-4313-b837-b0f9886c2f98 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:02.165119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1283/2603] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:32:02 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:32:02.169674 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39dffc-09bd-41fa-8435-cf57db162351 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:02.181453 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39dffc-09bd-41fa-8435-cf57db162351 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:02.243640 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd86aee-557f-4a85-8238-57897668b1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:02.244252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd86aee-557f-4a85-8238-57897668b1f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:02.244539 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd86aee-557f-4a85-8238-57897668b1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:02.244811 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd86aee-557f-4a85-8238-57897668b1f7 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:02.245459 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd86aee-557f-4a85-8238-57897668b1f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:02.247723 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd86aee-557f-4a85-8238-57897668b1f7 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:02.399971 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1321/2604] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:32:02 2022] POST /identity/v3/users => generated 288 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:32:02.405157 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba374094-b55b-4313-b837-b0f9886c2f98 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:02.415987 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba374094-b55b-4313-b837-b0f9886c2f98 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:02.421220 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c8c1d-3562-426a-8ed0-748a3cabec02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:02.421850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c8c1d-3562-426a-8ed0-748a3cabec02 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:02.422229 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c8c1d-3562-426a-8ed0-748a3cabec02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:02.422406 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c8c1d-3562-426a-8ed0-748a3cabec02 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:02.423048 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c8c1d-3562-426a-8ed0-748a3cabec02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:02.424626 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c8c1d-3562-426a-8ed0-748a3cabec02 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:02.435581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1284/2605] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:32:02.440136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd86aee-557f-4a85-8238-57897668b1f7 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:02.450324 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd86aee-557f-4a85-8238-57897668b1f7 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:02.455308 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94189498-4ef0-40f2-80fb-74e26c719674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:02.455916 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94189498-4ef0-40f2-80fb-74e26c719674 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:02.456198 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94189498-4ef0-40f2-80fb-74e26c719674 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:02.456476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94189498-4ef0-40f2-80fb-74e26c719674 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:02.457176 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94189498-4ef0-40f2-80fb-74e26c719674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:02.458803 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94189498-4ef0-40f2-80fb-74e26c719674 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:02.469741 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1322/2606] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:32:02.474180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c8c1d-3562-426a-8ed0-748a3cabec02 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:02.486525 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c8c1d-3562-426a-8ed0-748a3cabec02 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:02.494748 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ecafa-c314-491b-89ae-56ada4610b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:02.494748 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ecafa-c314-491b-89ae-56ada4610b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:02.494748 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ecafa-c314-491b-89ae-56ada4610b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:02.494748 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ecafa-c314-491b-89ae-56ada4610b44 admin admin] PATH_INFO: `/v3/projects/13e1a51ba78945bf8555b8700c7d41a4/users/4a02b3426810429486e73c77c90f6b5c/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:02.510160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ecafa-c314-491b-89ae-56ada4610b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e1a51ba78945bf8555b8700c7d41a4, user_id=4a02b3426810429486e73c77c90f6b5c, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:02.512988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ecafa-c314-491b-89ae-56ada4610b44 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:02.626817 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1285/2607] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:32:02 2022] PUT /identity/v3/projects/13e1a51ba78945bf8555b8700c7d41a4/users/4a02b3426810429486e73c77c90f6b5c/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:32:02.637312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4bddd-ff7c-4d8c-ae66-c8a066b92ed1 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:02.637599 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4bddd-ff7c-4d8c-ae66-c8a066b92ed1 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:02.637907 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4bddd-ff7c-4d8c-ae66-c8a066b92ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:02.646679 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:02.673374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-6ae4bddd-ff7c-4d8c-ae66-c8a066b92ed1 None None] MFA Rules not processed for user `4a02b3426810429486e73c77c90f6b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:02.673374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-6ae4bddd-ff7c-4d8c-ae66-c8a066b92ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:02.744763 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1323/2608] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:32:02.755675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ecafa-c314-491b-89ae-56ada4610b44 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:02.757386 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8e0ecafa-c314-491b-89ae-56ada4610b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:02.818176 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ecafa-c314-491b-89ae-56ada4610b44 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:02.822381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a17e37-bc1f-425b-8e40-86f72af7a3bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:02.823025 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a17e37-bc1f-425b-8e40-86f72af7a3bb service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:02.823285 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a17e37-bc1f-425b-8e40-86f72af7a3bb service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:02.823557 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a17e37-bc1f-425b-8e40-86f72af7a3bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:02.834023 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a17e37-bc1f-425b-8e40-86f72af7a3bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:02.835476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a17e37-bc1f-425b-8e40-86f72af7a3bb service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:02.846730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1286/2609] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:32:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:32:12.840802 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:13.010139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=30 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:14.034855 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4bddd-ff7c-4d8c-ae66-c8a066b92ed1 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:14.036723 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-6ae4bddd-ff7c-4d8c-ae66-c8a066b92ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:14.100640 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4bddd-ff7c-4d8c-ae66-c8a066b92ed1 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:14.104274 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6862e8-0d11-45a7-89d2-1b7b21d37090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:14.106987 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6862e8-0d11-45a7-89d2-1b7b21d37090 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:14.106987 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6862e8-0d11-45a7-89d2-1b7b21d37090 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:14.106987 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6862e8-0d11-45a7-89d2-1b7b21d37090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:14.107285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ab6862e8-0d11-45a7-89d2-1b7b21d37090 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:14.176915 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6862e8-0d11-45a7-89d2-1b7b21d37090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:14.178754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6862e8-0d11-45a7-89d2-1b7b21d37090 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:14.191194 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1324/2610] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:32:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:32:15.265565 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a17e37-bc1f-425b-8e40-86f72af7a3bb service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:15.277362 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a17e37-bc1f-425b-8e40-86f72af7a3bb service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:15.288988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b85d6-aac2-4707-a160-da6a8f148809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:15.288988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b85d6-aac2-4707-a160-da6a8f148809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:15.288988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b85d6-aac2-4707-a160-da6a8f148809 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:15.288988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b85d6-aac2-4707-a160-da6a8f148809 admin admin] PATH_INFO: `/v3/users/4a02b3426810429486e73c77c90f6b5c` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:15.289465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b85d6-aac2-4707-a160-da6a8f148809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a02b3426810429486e73c77c90f6b5c)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:15.290987 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b85d6-aac2-4707-a160-da6a8f148809 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:15.620013 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-ec4b85d6-aac2-4707-a160-da6a8f148809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a02b3426810429486e73c77c90f6b5c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:15.621305 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-ec4b85d6-aac2-4707-a160-da6a8f148809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a02b3426810429486e73c77c90f6b5c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:15.632045 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-ec4b85d6-aac2-4707-a160-da6a8f148809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a02b3426810429486e73c77c90f6b5c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:15.653982 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-ec4b85d6-aac2-4707-a160-da6a8f148809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a02b3426810429486e73c77c90f6b5c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:15.656688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-ec4b85d6-aac2-4707-a160-da6a8f148809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a02b3426810429486e73c77c90f6b5c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:15.837325 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1287/2611] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:32:15 2022] DELETE /identity/v3/users/4a02b3426810429486e73c77c90f6b5c => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:32:15.838860 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d771e-6636-4258-8218-59141054fddb None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:15.839577 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d771e-6636-4258-8218-59141054fddb None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:15.839736 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d771e-6636-4258-8218-59141054fddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:15.865537 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-c94d771e-6636-4258-8218-59141054fddb None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:15.870760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-c94d771e-6636-4258-8218-59141054fddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:15.959294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1325/2612] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:32:15.970477 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b85d6-aac2-4707-a160-da6a8f148809 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:15.972125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ec4b85d6-aac2-4707-a160-da6a8f148809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:16.084467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b85d6-aac2-4707-a160-da6a8f148809 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:16.093996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2447331-e53b-4687-950b-1f1e65b760bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:16.093996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2447331-e53b-4687-950b-1f1e65b760bc service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:16.093996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2447331-e53b-4687-950b-1f1e65b760bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:16.093996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2447331-e53b-4687-950b-1f1e65b760bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:16.109634 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2447331-e53b-4687-950b-1f1e65b760bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:16.112422 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2447331-e53b-4687-950b-1f1e65b760bc service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:16.130519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1288/2613] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:32:16.792177 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d771e-6636-4258-8218-59141054fddb None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:16.793799 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-c94d771e-6636-4258-8218-59141054fddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:16.821036 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d771e-6636-4258-8218-59141054fddb None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:16.829146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878ee1e-ea99-4fe6-848a-f9ad0da3fb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:16.831234 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878ee1e-ea99-4fe6-848a-f9ad0da3fb05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:16.831886 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878ee1e-ea99-4fe6-848a-f9ad0da3fb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:16.832703 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878ee1e-ea99-4fe6-848a-f9ad0da3fb05 admin admin] PATH_INFO: `/v3/projects/13e1a51ba78945bf8555b8700c7d41a4` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:16.841840 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878ee1e-ea99-4fe6-848a-f9ad0da3fb05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13e1a51ba78945bf8555b8700c7d41a4)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:16.841840 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878ee1e-ea99-4fe6-848a-f9ad0da3fb05 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:17.010896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:17.014260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b878ee1e-ea99-4fe6-848a-f9ad0da3fb05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e1a51ba78945bf8555b8700c7d41a4', 'request_id': 'req-b878ee1e-ea99-4fe6-848a-f9ad0da3fb05'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:17.021449 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b878ee1e-ea99-4fe6-848a-f9ad0da3fb05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e1a51ba78945bf8555b8700c7d41a4', 'request_id': 'req-b878ee1e-ea99-4fe6-848a-f9ad0da3fb05'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:17.028544 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b878ee1e-ea99-4fe6-848a-f9ad0da3fb05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e1a51ba78945bf8555b8700c7d41a4', 'request_id': 'req-b878ee1e-ea99-4fe6-848a-f9ad0da3fb05'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:17.129593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b878ee1e-ea99-4fe6-848a-f9ad0da3fb05 admin admin] The token cache is being invalidate because project 13e1a51ba78945bf8555b8700c7d41a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:32:17.130208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b878ee1e-ea99-4fe6-848a-f9ad0da3fb05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:17.130825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b878ee1e-ea99-4fe6-848a-f9ad0da3fb05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:17.132466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1326/2614] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:32:16 2022] DELETE /identity/v3/projects/13e1a51ba78945bf8555b8700c7d41a4 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:32:17.137782 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483e03d-a1de-47c6-9caf-e7aa4bda62be None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:17.138364 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483e03d-a1de-47c6-9caf-e7aa4bda62be None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:17.138364 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483e03d-a1de-47c6-9caf-e7aa4bda62be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:17.162488 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-c483e03d-a1de-47c6-9caf-e7aa4bda62be None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:17.163729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-c483e03d-a1de-47c6-9caf-e7aa4bda62be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:17.268104 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1289/2615] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:32:17.286653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743025d2-9b82-437c-a2fa-3c13a67a17c0 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:17.286864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743025d2-9b82-437c-a2fa-3c13a67a17c0 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:17.287460 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743025d2-9b82-437c-a2fa-3c13a67a17c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:17.319462 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-743025d2-9b82-437c-a2fa-3c13a67a17c0 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:17.321397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-743025d2-9b82-437c-a2fa-3c13a67a17c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:17.330978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1327/2616] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:32:17.335348 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483e03d-a1de-47c6-9caf-e7aa4bda62be None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:17.347298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483e03d-a1de-47c6-9caf-e7aa4bda62be None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:17.353268 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9897d60-296d-41be-9a1c-d45fef3ce49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:17.353947 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9897d60-296d-41be-9a1c-d45fef3ce49a admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:17.354236 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9897d60-296d-41be-9a1c-d45fef3ce49a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:17.354531 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9897d60-296d-41be-9a1c-d45fef3ce49a admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:17.355190 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9897d60-296d-41be-9a1c-d45fef3ce49a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:32:17.355499 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9897d60-296d-41be-9a1c-d45fef3ce49a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:17.357525 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9897d60-296d-41be-9a1c-d45fef3ce49a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:17.377859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1290/2617] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:32:17.383345 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743025d2-9b82-437c-a2fa-3c13a67a17c0 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:17.397311 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743025d2-9b82-437c-a2fa-3c13a67a17c0 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:17.402739 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed9bc7-23cd-4cd8-818c-b254613ce5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:17.403445 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed9bc7-23cd-4cd8-818c-b254613ce5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:17.403729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed9bc7-23cd-4cd8-818c-b254613ce5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:17.404002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed9bc7-23cd-4cd8-818c-b254613ce5f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:17.404640 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed9bc7-23cd-4cd8-818c-b254613ce5f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:17.407327 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed9bc7-23cd-4cd8-818c-b254613ce5f5 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:17.543366 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1328/2618] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:32:17 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:32:17.547360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9897d60-296d-41be-9a1c-d45fef3ce49a admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:17.550280 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:17.555718 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9897d60-296d-41be-9a1c-d45fef3ce49a admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:17.653276 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3299a0-e244-457a-9658-385e3392fd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:17.654199 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3299a0-e244-457a-9658-385e3392fd00 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:17.654494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3299a0-e244-457a-9658-385e3392fd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:17.659813 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3299a0-e244-457a-9658-385e3392fd00 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:17.659813 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3299a0-e244-457a-9658-385e3392fd00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:17.659813 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3299a0-e244-457a-9658-385e3392fd00 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:17.769623 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1291/2619] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:32:17 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:32:17.772581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed9bc7-23cd-4cd8-818c-b254613ce5f5 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:17.787445 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed9bc7-23cd-4cd8-818c-b254613ce5f5 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:17.794258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd30c81-d246-4b59-9fa1-fccaaa6a61c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:17.795637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd30c81-d246-4b59-9fa1-fccaaa6a61c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:17.796058 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd30c81-d246-4b59-9fa1-fccaaa6a61c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:17.796455 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd30c81-d246-4b59-9fa1-fccaaa6a61c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:17.797868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd30c81-d246-4b59-9fa1-fccaaa6a61c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:17.799615 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd30c81-d246-4b59-9fa1-fccaaa6a61c0 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:17.825901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1329/2620] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:32:17.828381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3299a0-e244-457a-9658-385e3392fd00 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:17.840522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3299a0-e244-457a-9658-385e3392fd00 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:17.846441 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc47ac9-0fd6-4d8e-901f-66ae4faabc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:17.848250 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc47ac9-0fd6-4d8e-901f-66ae4faabc66 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:17.848250 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc47ac9-0fd6-4d8e-901f-66ae4faabc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:17.848250 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc47ac9-0fd6-4d8e-901f-66ae4faabc66 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:17.848577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc47ac9-0fd6-4d8e-901f-66ae4faabc66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:17.850134 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc47ac9-0fd6-4d8e-901f-66ae4faabc66 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:17.861356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1292/2621] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:32:17.866106 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd30c81-d246-4b59-9fa1-fccaaa6a61c0 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:17.877124 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd30c81-d246-4b59-9fa1-fccaaa6a61c0 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:17.882054 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599c24a-c0fe-437e-9e23-e8f7ed8030cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:17.882877 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599c24a-c0fe-437e-9e23-e8f7ed8030cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:17.883142 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599c24a-c0fe-437e-9e23-e8f7ed8030cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:17.883453 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599c24a-c0fe-437e-9e23-e8f7ed8030cd admin admin] PATH_INFO: `/v3/projects/3bc1a0a5f86e4a48b2442c9ae0b6457c/users/e1ce89c776494d41a3f5cf18076a688c/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:17.904077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599c24a-c0fe-437e-9e23-e8f7ed8030cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bc1a0a5f86e4a48b2442c9ae0b6457c, user_id=e1ce89c776494d41a3f5cf18076a688c, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:17.907352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599c24a-c0fe-437e-9e23-e8f7ed8030cd admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:18.070742 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1330/2622] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:32:17 2022] PUT /identity/v3/projects/3bc1a0a5f86e4a48b2442c9ae0b6457c/users/e1ce89c776494d41a3f5cf18076a688c/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:32:18.083563 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25b780-ff97-4225-812f-7b033b42ea37 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:18.083563 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25b780-ff97-4225-812f-7b033b42ea37 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:18.084534 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25b780-ff97-4225-812f-7b033b42ea37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:18.119248 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-fb25b780-ff97-4225-812f-7b033b42ea37 None None] MFA Rules not processed for user `e1ce89c776494d41a3f5cf18076a688c`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:18.120578 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-fb25b780-ff97-4225-812f-7b033b42ea37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:18.219806 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1293/2623] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:32:18.235532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599c24a-c0fe-437e-9e23-e8f7ed8030cd admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:18.240626 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-a599c24a-c0fe-437e-9e23-e8f7ed8030cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:18.326550 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599c24a-c0fe-437e-9e23-e8f7ed8030cd admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:18.330931 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790480d-2fc0-4a11-8087-1bc8ff1f6484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:18.331720 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790480d-2fc0-4a11-8087-1bc8ff1f6484 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:18.332025 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790480d-2fc0-4a11-8087-1bc8ff1f6484 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:18.332428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790480d-2fc0-4a11-8087-1bc8ff1f6484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:18.341694 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790480d-2fc0-4a11-8087-1bc8ff1f6484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:18.343843 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790480d-2fc0-4a11-8087-1bc8ff1f6484 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:18.353827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1331/2624] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:32:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:32:18.721884 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25b780-ff97-4225-812f-7b033b42ea37 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:18.723401 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-fb25b780-ff97-4225-812f-7b033b42ea37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:18.838716 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25b780-ff97-4225-812f-7b033b42ea37 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:18.847746 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0dd94-fcdb-4a61-9264-abbd9b893ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:18.851671 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0dd94-fcdb-4a61-9264-abbd9b893ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:18.853385 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0dd94-fcdb-4a61-9264-abbd9b893ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:18.853986 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0dd94-fcdb-4a61-9264-abbd9b893ba1 admin admin] PATH_INFO: `/v3/users/aa84378418324708b40f0791e2217ccc` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:18.855881 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0dd94-fcdb-4a61-9264-abbd9b893ba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa84378418324708b40f0791e2217ccc)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:18.858298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0dd94-fcdb-4a61-9264-abbd9b893ba1 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:18.879642 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:19.178599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-75a0dd94-fcdb-4a61-9264-abbd9b893ba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa84378418324708b40f0791e2217ccc'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:19.179615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-75a0dd94-fcdb-4a61-9264-abbd9b893ba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa84378418324708b40f0791e2217ccc'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:19.191788 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-75a0dd94-fcdb-4a61-9264-abbd9b893ba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa84378418324708b40f0791e2217ccc'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:19.212481 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-75a0dd94-fcdb-4a61-9264-abbd9b893ba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa84378418324708b40f0791e2217ccc'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:19.213594 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-75a0dd94-fcdb-4a61-9264-abbd9b893ba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa84378418324708b40f0791e2217ccc'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:19.381800 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1294/2625] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:32:18 2022] DELETE /identity/v3/users/aa84378418324708b40f0791e2217ccc => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:32:19.718305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790480d-2fc0-4a11-8087-1bc8ff1f6484 service cinder] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:19.732266 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790480d-2fc0-4a11-8087-1bc8ff1f6484 service cinder] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:19.847268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a70d0-0d26-4d01-82cc-f395f94a0825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:19.847901 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a70d0-0d26-4d01-82cc-f395f94a0825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:19.848183 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a70d0-0d26-4d01-82cc-f395f94a0825 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:19.848456 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a70d0-0d26-4d01-82cc-f395f94a0825 admin admin] PATH_INFO: `/v3/projects/6dbbc6a603794466b64e5822ea9a19f3` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:19.849594 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a70d0-0d26-4d01-82cc-f395f94a0825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dbbc6a603794466b64e5822ea9a19f3)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:19.851560 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a70d0-0d26-4d01-82cc-f395f94a0825 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:19.870694 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:19.985548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-572a70d0-0d26-4d01-82cc-f395f94a0825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dbbc6a603794466b64e5822ea9a19f3', 'request_id': 'req-572a70d0-0d26-4d01-82cc-f395f94a0825'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:19.993280 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-572a70d0-0d26-4d01-82cc-f395f94a0825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dbbc6a603794466b64e5822ea9a19f3', 'request_id': 'req-572a70d0-0d26-4d01-82cc-f395f94a0825'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:20.000719 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-572a70d0-0d26-4d01-82cc-f395f94a0825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dbbc6a603794466b64e5822ea9a19f3', 'request_id': 'req-572a70d0-0d26-4d01-82cc-f395f94a0825'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:20.075951 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-572a70d0-0d26-4d01-82cc-f395f94a0825 admin admin] The token cache is being invalidate because project 6dbbc6a603794466b64e5822ea9a19f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:32:20.081659 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-572a70d0-0d26-4d01-82cc-f395f94a0825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:20.081659 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-572a70d0-0d26-4d01-82cc-f395f94a0825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:20.081659 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1332/2626] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:32:19 2022] DELETE /identity/v3/projects/6dbbc6a603794466b64e5822ea9a19f3 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:32:20.086027 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f3fb4-8fab-4c2f-be57-2675dc0a6eb6 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:20.086374 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f3fb4-8fab-4c2f-be57-2675dc0a6eb6 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:20.086713 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f3fb4-8fab-4c2f-be57-2675dc0a6eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:20.109346 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-201f3fb4-8fab-4c2f-be57-2675dc0a6eb6 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:20.110638 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-201f3fb4-8fab-4c2f-be57-2675dc0a6eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:20.185244 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1295/2627] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:32:20.194576 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70778c05-4a83-4efd-bbe3-d431701092b9 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:20.194862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70778c05-4a83-4efd-bbe3-d431701092b9 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:20.195144 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70778c05-4a83-4efd-bbe3-d431701092b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:20.215911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-70778c05-4a83-4efd-bbe3-d431701092b9 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:20.217154 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-70778c05-4a83-4efd-bbe3-d431701092b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:20.225852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1333/2628] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:32:20.230360 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f3fb4-8fab-4c2f-be57-2675dc0a6eb6 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:20.244033 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f3fb4-8fab-4c2f-be57-2675dc0a6eb6 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:20.247309 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde3511-0531-471e-a010-fed834b69a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:20.248025 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde3511-0531-471e-a010-fed834b69a24 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:20.248223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde3511-0531-471e-a010-fed834b69a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:20.248501 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde3511-0531-471e-a010-fed834b69a24 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:20.249191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde3511-0531-471e-a010-fed834b69a24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:32:20.249535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde3511-0531-471e-a010-fed834b69a24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:20.251328 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde3511-0531-471e-a010-fed834b69a24 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:20.266467 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1296/2629] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:32:20.273051 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70778c05-4a83-4efd-bbe3-d431701092b9 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:20.284011 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70778c05-4a83-4efd-bbe3-d431701092b9 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:20.289094 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b385e9f-46b4-4b5f-8090-d7703b1ac6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:20.289708 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b385e9f-46b4-4b5f-8090-d7703b1ac6c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:20.290074 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b385e9f-46b4-4b5f-8090-d7703b1ac6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:20.290357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b385e9f-46b4-4b5f-8090-d7703b1ac6c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:20.291004 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b385e9f-46b4-4b5f-8090-d7703b1ac6c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:20.292902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b385e9f-46b4-4b5f-8090-d7703b1ac6c5 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:20.361389 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f5493-56f1-4d84-a135-7e1ca213791d None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:20.361673 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f5493-56f1-4d84-a135-7e1ca213791d None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:20.362089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f5493-56f1-4d84-a135-7e1ca213791d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:20.383532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-152f5493-56f1-4d84-a135-7e1ca213791d None None] MFA Rules not processed for user `e1ce89c776494d41a3f5cf18076a688c`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:20.384688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-152f5493-56f1-4d84-a135-7e1ca213791d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:20.441767 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1297/2630] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:32:20.496114 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1334/2631] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:32:20 2022] POST /identity/v3/projects => generated 381 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:32:20.500884 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f5493-56f1-4d84-a135-7e1ca213791d None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:20.516814 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f5493-56f1-4d84-a135-7e1ca213791d None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:20.538780 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:20.586703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981daf4-41cf-4ed2-b433-0be90147c35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:20.587504 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981daf4-41cf-4ed2-b433-0be90147c35e admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:20.587850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981daf4-41cf-4ed2-b433-0be90147c35e admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:20.588348 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981daf4-41cf-4ed2-b433-0be90147c35e admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:20.589471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981daf4-41cf-4ed2-b433-0be90147c35e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:20.591654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981daf4-41cf-4ed2-b433-0be90147c35e admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:20.679227 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1298/2632] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:32:20 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:32:20.683733 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b385e9f-46b4-4b5f-8090-d7703b1ac6c5 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:20.696854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b385e9f-46b4-4b5f-8090-d7703b1ac6c5 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:20.704397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353ce38-ec6e-46ba-869e-f49ab4c3f1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:20.705203 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353ce38-ec6e-46ba-869e-f49ab4c3f1cf admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:20.705614 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353ce38-ec6e-46ba-869e-f49ab4c3f1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:20.706127 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353ce38-ec6e-46ba-869e-f49ab4c3f1cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:20.707117 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353ce38-ec6e-46ba-869e-f49ab4c3f1cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:20.709040 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353ce38-ec6e-46ba-869e-f49ab4c3f1cf admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:20.722941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1335/2633] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:32:20.727100 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981daf4-41cf-4ed2-b433-0be90147c35e admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:20.742635 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981daf4-41cf-4ed2-b433-0be90147c35e admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:20.747954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dc441-d824-403b-8ae2-06badd9c2127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:20.748514 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dc441-d824-403b-8ae2-06badd9c2127 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:20.748912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dc441-d824-403b-8ae2-06badd9c2127 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:20.749836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dc441-d824-403b-8ae2-06badd9c2127 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:20.750727 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dc441-d824-403b-8ae2-06badd9c2127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:20.752515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dc441-d824-403b-8ae2-06badd9c2127 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:20.764276 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1299/2634] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:32:20.769048 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353ce38-ec6e-46ba-869e-f49ab4c3f1cf admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:20.782882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353ce38-ec6e-46ba-869e-f49ab4c3f1cf admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:20.793058 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440a6c8-5aaf-44e8-88e2-79c416a3a4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:20.793058 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440a6c8-5aaf-44e8-88e2-79c416a3a4c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:20.793058 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440a6c8-5aaf-44e8-88e2-79c416a3a4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:20.793058 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440a6c8-5aaf-44e8-88e2-79c416a3a4c2 admin admin] PATH_INFO: `/v3/projects/f9592b6c88424223a896cd590dda5031/users/4ed4377b168b4f05a61061468b68b6c8/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:20.812731 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440a6c8-5aaf-44e8-88e2-79c416a3a4c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9592b6c88424223a896cd590dda5031, user_id=4ed4377b168b4f05a61061468b68b6c8, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:20.815497 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440a6c8-5aaf-44e8-88e2-79c416a3a4c2 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:20.919916 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1336/2635] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:32:20 2022] PUT /identity/v3/projects/f9592b6c88424223a896cd590dda5031/users/4ed4377b168b4f05a61061468b68b6c8/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:32:20.935187 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef5dd6-4f1b-4bf5-8bf0-2d31818c1479 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:20.935505 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef5dd6-4f1b-4bf5-8bf0-2d31818c1479 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:20.935787 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef5dd6-4f1b-4bf5-8bf0-2d31818c1479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:20.968093 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-e5ef5dd6-4f1b-4bf5-8bf0-2d31818c1479 None None] MFA Rules not processed for user `4ed4377b168b4f05a61061468b68b6c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:20.969548 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e5ef5dd6-4f1b-4bf5-8bf0-2d31818c1479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:21.044166 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1300/2636] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:32:21.048790 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440a6c8-5aaf-44e8-88e2-79c416a3a4c2 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:21.133155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440a6c8-5aaf-44e8-88e2-79c416a3a4c2 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:21.139127 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd5257-4b2d-4052-aef4-8d90fa02c31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:21.140429 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd5257-4b2d-4052-aef4-8d90fa02c31e admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:21.140929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd5257-4b2d-4052-aef4-8d90fa02c31e admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:21.141090 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd5257-4b2d-4052-aef4-8d90fa02c31e admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:21.141850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd5257-4b2d-4052-aef4-8d90fa02c31e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:21.145730 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd5257-4b2d-4052-aef4-8d90fa02c31e admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:21.255420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1337/2637] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:32:21 2022] POST /identity/v3/projects => generated 381 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:32:21.260243 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef5dd6-4f1b-4bf5-8bf0-2d31818c1479 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:21.271452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef5dd6-4f1b-4bf5-8bf0-2d31818c1479 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:21.334030 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20d027-a03b-4898-95ed-939e435ff497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:21.334673 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20d027-a03b-4898-95ed-939e435ff497 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:21.334954 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20d027-a03b-4898-95ed-939e435ff497 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:21.335223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20d027-a03b-4898-95ed-939e435ff497 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:21.335921 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20d027-a03b-4898-95ed-939e435ff497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:21.337797 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20d027-a03b-4898-95ed-939e435ff497 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:21.461853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1301/2638] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:32:21 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:32:21.473505 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd5257-4b2d-4052-aef4-8d90fa02c31e admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:21.486241 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd5257-4b2d-4052-aef4-8d90fa02c31e admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:21.492134 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136d975-2446-4bd0-9f54-aa6c3a42f767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:21.492760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136d975-2446-4bd0-9f54-aa6c3a42f767 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:21.493044 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136d975-2446-4bd0-9f54-aa6c3a42f767 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:21.493438 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136d975-2446-4bd0-9f54-aa6c3a42f767 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:21.494073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136d975-2446-4bd0-9f54-aa6c3a42f767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:21.495663 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136d975-2446-4bd0-9f54-aa6c3a42f767 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:21.512616 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1338/2639] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:32:21.513896 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20d027-a03b-4898-95ed-939e435ff497 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:21.526390 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20d027-a03b-4898-95ed-939e435ff497 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:21.531489 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc1d0a-9de6-400c-8de6-85c171a5a320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:21.532152 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc1d0a-9de6-400c-8de6-85c171a5a320 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:21.532434 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc1d0a-9de6-400c-8de6-85c171a5a320 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:21.532714 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc1d0a-9de6-400c-8de6-85c171a5a320 admin admin] PATH_INFO: `/v3/projects/d9c2133f7d574298acf2f836eac761fa/users/e2dada564eb1420fb8313a98cdf8672f/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:21.552464 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc1d0a-9de6-400c-8de6-85c171a5a320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9c2133f7d574298acf2f836eac761fa, user_id=e2dada564eb1420fb8313a98cdf8672f, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:21.556104 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc1d0a-9de6-400c-8de6-85c171a5a320 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:21.560181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:21.692668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1302/2640] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:32:21 2022] PUT /identity/v3/projects/d9c2133f7d574298acf2f836eac761fa/users/e2dada564eb1420fb8313a98cdf8672f/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:32:21.698758 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136d975-2446-4bd0-9f54-aa6c3a42f767 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:21.711468 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136d975-2446-4bd0-9f54-aa6c3a42f767 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:21.722274 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:21.785183 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca282019-3050-4f1e-b006-a185845734c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:21.786420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca282019-3050-4f1e-b006-a185845734c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:21.786968 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca282019-3050-4f1e-b006-a185845734c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:21.787357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca282019-3050-4f1e-b006-a185845734c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:21.788532 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca282019-3050-4f1e-b006-a185845734c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:21.790427 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca282019-3050-4f1e-b006-a185845734c2 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:21.802062 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1339/2641] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:32:21.806482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc1d0a-9de6-400c-8de6-85c171a5a320 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:21.818008 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc1d0a-9de6-400c-8de6-85c171a5a320 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:21.823479 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2395e7d-c8b7-48d9-ac9d-dd6e773eb5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:21.823838 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2395e7d-c8b7-48d9-ac9d-dd6e773eb5b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:21.824134 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2395e7d-c8b7-48d9-ac9d-dd6e773eb5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:21.824433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2395e7d-c8b7-48d9-ac9d-dd6e773eb5b8 admin admin] PATH_INFO: `/v3/projects/d9c2133f7d574298acf2f836eac761fa/users/e2dada564eb1420fb8313a98cdf8672f/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:21.826616 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2395e7d-c8b7-48d9-ac9d-dd6e773eb5b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9c2133f7d574298acf2f836eac761fa, user_id=e2dada564eb1420fb8313a98cdf8672f, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:21.830001 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2395e7d-c8b7-48d9-ac9d-dd6e773eb5b8 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:21.856378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1303/2642] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:32:21 2022] PUT /identity/v3/projects/d9c2133f7d574298acf2f836eac761fa/users/e2dada564eb1420fb8313a98cdf8672f/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:32:21.868727 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5581d-d016-449b-972c-b36bdf6dee25 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:21.869433 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5581d-d016-449b-972c-b36bdf6dee25 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:21.870172 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5581d-d016-449b-972c-b36bdf6dee25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:21.911032 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-91c5581d-d016-449b-972c-b36bdf6dee25 None None] MFA Rules not processed for user `e2dada564eb1420fb8313a98cdf8672f`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:21.912272 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-91c5581d-d016-449b-972c-b36bdf6dee25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:22.002143 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1340/2643] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:32:22.022373 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2395e7d-c8b7-48d9-ac9d-dd6e773eb5b8 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:22.025359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e2395e7d-c8b7-48d9-ac9d-dd6e773eb5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:22.122638 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2395e7d-c8b7-48d9-ac9d-dd6e773eb5b8 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:22.129203 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816829a4-8352-4ded-a274-01911d8ff33b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:22.130266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816829a4-8352-4ded-a274-01911d8ff33b service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:22.130678 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816829a4-8352-4ded-a274-01911d8ff33b service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:22.131199 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816829a4-8352-4ded-a274-01911d8ff33b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:22.142905 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816829a4-8352-4ded-a274-01911d8ff33b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:22.144371 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816829a4-8352-4ded-a274-01911d8ff33b service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:22.157945 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1304/2644] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:32:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:32:23.445217 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5581d-d016-449b-972c-b36bdf6dee25 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:23.456037 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5581d-d016-449b-972c-b36bdf6dee25 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:23.461087 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c01ffa-cb80-43d9-9999-ba6a3f1f3a4d tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dada564eb1420fb8313a98cdf8672f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c2133f7d574298acf2f836eac761fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:23.467033 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c01ffa-cb80-43d9-9999-ba6a3f1f3a4d tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:23.467033 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c01ffa-cb80-43d9-9999-ba6a3f1f3a4d tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:23.467033 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c01ffa-cb80-43d9-9999-ba6a3f1f3a4d tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:23.467033 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c01ffa-cb80-43d9-9999-ba6a3f1f3a4d tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:32:23.467033 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c01ffa-cb80-43d9-9999-ba6a3f1f3a4d tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:23.468191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c01ffa-cb80-43d9-9999-ba6a3f1f3a4d tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:23.479000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1341/2645] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:32:23.483850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816829a4-8352-4ded-a274-01911d8ff33b service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:23.493664 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816829a4-8352-4ded-a274-01911d8ff33b service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:23.498347 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03f08e-168d-4cf1-b337-2d640497c139 tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dada564eb1420fb8313a98cdf8672f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c2133f7d574298acf2f836eac761fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:23.499038 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03f08e-168d-4cf1-b337-2d640497c139 tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:23.499522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03f08e-168d-4cf1-b337-2d640497c139 tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:23.499807 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03f08e-168d-4cf1-b337-2d640497c139 tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:23.500442 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03f08e-168d-4cf1-b337-2d640497c139 tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:23.502381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03f08e-168d-4cf1-b337-2d640497c139 tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:23.616689 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1305/2646] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:32:23 2022] POST /identity/v3/projects => generated 353 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:32:23.621373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c01ffa-cb80-43d9-9999-ba6a3f1f3a4d tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:23.632274 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c01ffa-cb80-43d9-9999-ba6a3f1f3a4d tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:23.716579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78f629-33ea-4c96-ac78-aa97a4366ee1 tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dada564eb1420fb8313a98cdf8672f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c2133f7d574298acf2f836eac761fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:23.719129 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78f629-33ea-4c96-ac78-aa97a4366ee1 tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:23.719129 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78f629-33ea-4c96-ac78-aa97a4366ee1 tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:23.719129 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78f629-33ea-4c96-ac78-aa97a4366ee1 tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:23.720336 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78f629-33ea-4c96-ac78-aa97a4366ee1 tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:32:23.720849 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78f629-33ea-4c96-ac78-aa97a4366ee1 tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:23.723740 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78f629-33ea-4c96-ac78-aa97a4366ee1 tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:23.743600 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1342/2647] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:32:23.788153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03f08e-168d-4cf1-b337-2d640497c139 tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:23.799673 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03f08e-168d-4cf1-b337-2d640497c139 tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:23.804568 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f71da1-878e-423f-991f-1bf1f50184cb tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dada564eb1420fb8313a98cdf8672f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c2133f7d574298acf2f836eac761fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:23.805365 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f71da1-878e-423f-991f-1bf1f50184cb tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:23.805655 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f71da1-878e-423f-991f-1bf1f50184cb tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:23.805973 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f71da1-878e-423f-991f-1bf1f50184cb tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] PATH_INFO: `/v3/projects/dae7c4677603461bb12ff223d2b9a16c` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:23.807117 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f71da1-878e-423f-991f-1bf1f50184cb tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dae7c4677603461bb12ff223d2b9a16c)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:23.809005 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f71da1-878e-423f-991f-1bf1f50184cb tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:23.967376 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e3f71da1-878e-423f-991f-1bf1f50184cb tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae7c4677603461bb12ff223d2b9a16c', 'request_id': 'req-e3f71da1-878e-423f-991f-1bf1f50184cb'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:23.974635 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e3f71da1-878e-423f-991f-1bf1f50184cb tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae7c4677603461bb12ff223d2b9a16c', 'request_id': 'req-e3f71da1-878e-423f-991f-1bf1f50184cb'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:23.980910 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e3f71da1-878e-423f-991f-1bf1f50184cb tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae7c4677603461bb12ff223d2b9a16c', 'request_id': 'req-e3f71da1-878e-423f-991f-1bf1f50184cb'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:24.083583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e3f71da1-878e-423f-991f-1bf1f50184cb tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] The token cache is being invalidate because project dae7c4677603461bb12ff223d2b9a16c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:32:24.083890 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e3f71da1-878e-423f-991f-1bf1f50184cb tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:24.084570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-e3f71da1-878e-423f-991f-1bf1f50184cb tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:24.086136 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1306/2648] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:32:23 2022] DELETE /identity/v3/projects/dae7c4677603461bb12ff223d2b9a16c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:32:24.925748 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78f629-33ea-4c96-ac78-aa97a4366ee1 tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:24.928223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-1c78f629-33ea-4c96-ac78-aa97a4366ee1 tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:24.956151 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:25.042561 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78f629-33ea-4c96-ac78-aa97a4366ee1 tempest-VolumeQuotaClassesTest-1604803970 tempest-VolumeQuotaClassesTest-1604803970-project-admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:25.120651 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d23af-86cf-43d8-9c37-ec7d24dc1719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:25.121299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d23af-86cf-43d8-9c37-ec7d24dc1719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:25.121581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d23af-86cf-43d8-9c37-ec7d24dc1719 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:25.121886 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d23af-86cf-43d8-9c37-ec7d24dc1719 admin admin] PATH_INFO: `/v3/users/4ed4377b168b4f05a61061468b68b6c8` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:25.123084 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d23af-86cf-43d8-9c37-ec7d24dc1719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ed4377b168b4f05a61061468b68b6c8)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:25.125953 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d23af-86cf-43d8-9c37-ec7d24dc1719 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:25.329200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7e8d23af-86cf-43d8-9c37-ec7d24dc1719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ed4377b168b4f05a61061468b68b6c8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:25.329963 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7e8d23af-86cf-43d8-9c37-ec7d24dc1719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ed4377b168b4f05a61061468b68b6c8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:25.344244 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7e8d23af-86cf-43d8-9c37-ec7d24dc1719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ed4377b168b4f05a61061468b68b6c8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:25.352516 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7e8d23af-86cf-43d8-9c37-ec7d24dc1719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ed4377b168b4f05a61061468b68b6c8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:25.353259 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7e8d23af-86cf-43d8-9c37-ec7d24dc1719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ed4377b168b4f05a61061468b68b6c8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:25.483108 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1343/2649] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:32:24 2022] DELETE /identity/v3/users/4ed4377b168b4f05a61061468b68b6c8 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:32:25.488611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f6b8e-a662-4eeb-a84c-4cea7d69c9c9 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:25.489453 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f6b8e-a662-4eeb-a84c-4cea7d69c9c9 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:25.489453 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f6b8e-a662-4eeb-a84c-4cea7d69c9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:25.510444 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-678f6b8e-a662-4eeb-a84c-4cea7d69c9c9 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:25.511717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-678f6b8e-a662-4eeb-a84c-4cea7d69c9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:25.575565 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:25.597290 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1307/2650] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:32:25.609334 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d23af-86cf-43d8-9c37-ec7d24dc1719 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:25.610977 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-7e8d23af-86cf-43d8-9c37-ec7d24dc1719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:25.664643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:25.678440 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d23af-86cf-43d8-9c37-ec7d24dc1719 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:25.684391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56fd81-d3ff-4e95-8740-9ed41342a4b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:25.684598 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56fd81-d3ff-4e95-8740-9ed41342a4b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:25.684738 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56fd81-d3ff-4e95-8740-9ed41342a4b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:25.685003 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56fd81-d3ff-4e95-8740-9ed41342a4b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:25.696408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56fd81-d3ff-4e95-8740-9ed41342a4b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:25.697939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56fd81-d3ff-4e95-8740-9ed41342a4b8 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:25.714455 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1344/2651] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:32:26.523333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f6b8e-a662-4eeb-a84c-4cea7d69c9c9 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:26.524887 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-678f6b8e-a662-4eeb-a84c-4cea7d69c9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:26.544692 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f6b8e-a662-4eeb-a84c-4cea7d69c9c9 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:26.558794 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdb4de-67c3-4f33-a973-f613567cb812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:26.559882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdb4de-67c3-4f33-a973-f613567cb812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:26.560311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdb4de-67c3-4f33-a973-f613567cb812 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:26.560783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdb4de-67c3-4f33-a973-f613567cb812 admin admin] PATH_INFO: `/v3/projects/f9592b6c88424223a896cd590dda5031` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:26.562503 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdb4de-67c3-4f33-a973-f613567cb812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9592b6c88424223a896cd590dda5031)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:26.567775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdb4de-67c3-4f33-a973-f613567cb812 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:26.728329 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-36bdb4de-67c3-4f33-a973-f613567cb812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9592b6c88424223a896cd590dda5031', 'request_id': 'req-36bdb4de-67c3-4f33-a973-f613567cb812'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:26.740647 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-36bdb4de-67c3-4f33-a973-f613567cb812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9592b6c88424223a896cd590dda5031', 'request_id': 'req-36bdb4de-67c3-4f33-a973-f613567cb812'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:26.748942 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-36bdb4de-67c3-4f33-a973-f613567cb812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9592b6c88424223a896cd590dda5031', 'request_id': 'req-36bdb4de-67c3-4f33-a973-f613567cb812'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:26.879848 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-36bdb4de-67c3-4f33-a973-f613567cb812 admin admin] The token cache is being invalidate because project f9592b6c88424223a896cd590dda5031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:32:26.880541 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-36bdb4de-67c3-4f33-a973-f613567cb812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:26.881885 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-36bdb4de-67c3-4f33-a973-f613567cb812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:26.884807 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1308/2652] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:32:26 2022] DELETE /identity/v3/projects/f9592b6c88424223a896cd590dda5031 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:32:26.891632 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56fd81-d3ff-4e95-8740-9ed41342a4b8 service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:26.909240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56fd81-d3ff-4e95-8740-9ed41342a4b8 service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:26.910706 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdb4de-67c3-4f33-a973-f613567cb812 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:26.913479 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-36bdb4de-67c3-4f33-a973-f613567cb812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:27.085478 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312a77a-0ac2-42cf-b4c9-94fe5ca5a537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:27.086241 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312a77a-0ac2-42cf-b4c9-94fe5ca5a537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:27.086727 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312a77a-0ac2-42cf-b4c9-94fe5ca5a537 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:27.087212 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312a77a-0ac2-42cf-b4c9-94fe5ca5a537 admin admin] PATH_INFO: `/v3/users/e2dada564eb1420fb8313a98cdf8672f` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:27.090142 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312a77a-0ac2-42cf-b4c9-94fe5ca5a537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2dada564eb1420fb8313a98cdf8672f)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:27.093025 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312a77a-0ac2-42cf-b4c9-94fe5ca5a537 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:27.102534 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdb4de-67c3-4f33-a973-f613567cb812 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:27.110562 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae31af0-ad1c-419a-9a88-9422219d4c92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:27.111296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae31af0-ad1c-419a-9a88-9422219d4c92 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:27.111688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae31af0-ad1c-419a-9a88-9422219d4c92 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:27.112045 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae31af0-ad1c-419a-9a88-9422219d4c92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:27.114689 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-6ae31af0-ad1c-419a-9a88-9422219d4c92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:27.139000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae31af0-ad1c-419a-9a88-9422219d4c92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:27.139000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae31af0-ad1c-419a-9a88-9422219d4c92 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:27.149380 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1309/2653] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:32:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:32:27.313624 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0312a77a-0ac2-42cf-b4c9-94fe5ca5a537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2dada564eb1420fb8313a98cdf8672f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:27.314345 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0312a77a-0ac2-42cf-b4c9-94fe5ca5a537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2dada564eb1420fb8313a98cdf8672f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:27.337123 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0312a77a-0ac2-42cf-b4c9-94fe5ca5a537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2dada564eb1420fb8313a98cdf8672f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:27.358209 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0312a77a-0ac2-42cf-b4c9-94fe5ca5a537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2dada564eb1420fb8313a98cdf8672f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:27.363200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0312a77a-0ac2-42cf-b4c9-94fe5ca5a537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2dada564eb1420fb8313a98cdf8672f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:27.397866 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae31af0-ad1c-419a-9a88-9422219d4c92 service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:27.408141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae31af0-ad1c-419a-9a88-9422219d4c92 service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:27.412061 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e51cc-9e03-48f0-b2f0-497fae9fedad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:27.412714 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e51cc-9e03-48f0-b2f0-497fae9fedad service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:27.413000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e51cc-9e03-48f0-b2f0-497fae9fedad service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:27.413464 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e51cc-9e03-48f0-b2f0-497fae9fedad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:27.415377 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-3b2e51cc-9e03-48f0-b2f0-497fae9fedad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:27.507740 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e51cc-9e03-48f0-b2f0-497fae9fedad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:27.509212 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e51cc-9e03-48f0-b2f0-497fae9fedad service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:27.515908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:27.521779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1345/2654] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:32:26 2022] DELETE /identity/v3/users/e2dada564eb1420fb8313a98cdf8672f => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:32:27.535664 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1310/2655] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:32:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:32:28.096427 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312a77a-0ac2-42cf-b4c9-94fe5ca5a537 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:28.100715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-0312a77a-0ac2-42cf-b4c9-94fe5ca5a537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:28.226765 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312a77a-0ac2-42cf-b4c9-94fe5ca5a537 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:28.233777 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07aa61-844d-4e65-9b1e-8f691e742ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:28.234873 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07aa61-844d-4e65-9b1e-8f691e742ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:28.235537 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07aa61-844d-4e65-9b1e-8f691e742ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:28.236112 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07aa61-844d-4e65-9b1e-8f691e742ceb admin admin] PATH_INFO: `/v3/projects/d9c2133f7d574298acf2f836eac761fa` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:28.238089 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07aa61-844d-4e65-9b1e-8f691e742ceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9c2133f7d574298acf2f836eac761fa)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:28.242107 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07aa61-844d-4e65-9b1e-8f691e742ceb admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:28.251331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:28.393443 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6c07aa61-844d-4e65-9b1e-8f691e742ceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9c2133f7d574298acf2f836eac761fa', 'request_id': 'req-6c07aa61-844d-4e65-9b1e-8f691e742ceb'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:28.400511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6c07aa61-844d-4e65-9b1e-8f691e742ceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9c2133f7d574298acf2f836eac761fa', 'request_id': 'req-6c07aa61-844d-4e65-9b1e-8f691e742ceb'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:28.409007 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6c07aa61-844d-4e65-9b1e-8f691e742ceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9c2133f7d574298acf2f836eac761fa', 'request_id': 'req-6c07aa61-844d-4e65-9b1e-8f691e742ceb'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:28.506000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6c07aa61-844d-4e65-9b1e-8f691e742ceb admin admin] The token cache is being invalidate because project d9c2133f7d574298acf2f836eac761fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:32:28.506448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6c07aa61-844d-4e65-9b1e-8f691e742ceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:28.506984 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6c07aa61-844d-4e65-9b1e-8f691e742ceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:28.508472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1346/2656] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:32:28 2022] DELETE /identity/v3/projects/d9c2133f7d574298acf2f836eac761fa => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:32:28.513577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e010c-d2fc-4df7-9404-748db880ad88 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:28.513987 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e010c-d2fc-4df7-9404-748db880ad88 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:28.514456 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e010c-d2fc-4df7-9404-748db880ad88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:28.537325 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-736e010c-d2fc-4df7-9404-748db880ad88 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:28.538067 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-736e010c-d2fc-4df7-9404-748db880ad88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:28.617957 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1311/2657] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:32:28.627231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750e899-f62a-4137-9d22-eef25fa729c8 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:28.627881 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750e899-f62a-4137-9d22-eef25fa729c8 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:28.628768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750e899-f62a-4137-9d22-eef25fa729c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:28.654432 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-b750e899-f62a-4137-9d22-eef25fa729c8 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:28.655902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b750e899-f62a-4137-9d22-eef25fa729c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:28.668691 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1347/2658] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:32:28.673072 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e010c-d2fc-4df7-9404-748db880ad88 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:28.683439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e010c-d2fc-4df7-9404-748db880ad88 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:28.692412 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d3319-29f7-4b3f-99a0-177c78ef00dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:28.693055 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d3319-29f7-4b3f-99a0-177c78ef00dd admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:28.693489 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d3319-29f7-4b3f-99a0-177c78ef00dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:28.694007 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d3319-29f7-4b3f-99a0-177c78ef00dd admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:28.699401 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d3319-29f7-4b3f-99a0-177c78ef00dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:32:28.699401 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d3319-29f7-4b3f-99a0-177c78ef00dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:28.699401 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d3319-29f7-4b3f-99a0-177c78ef00dd admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:28.713310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1312/2659] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:32:28.719846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750e899-f62a-4137-9d22-eef25fa729c8 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:28.729724 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750e899-f62a-4137-9d22-eef25fa729c8 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:28.735739 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bad57f-ac1b-41d8-8a6a-c238182987ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:28.736513 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bad57f-ac1b-41d8-8a6a-c238182987ec admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:28.736892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bad57f-ac1b-41d8-8a6a-c238182987ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:28.737275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bad57f-ac1b-41d8-8a6a-c238182987ec admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:28.738046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bad57f-ac1b-41d8-8a6a-c238182987ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:28.740541 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bad57f-ac1b-41d8-8a6a-c238182987ec admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:28.873491 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1348/2660] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:32:28 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:32:28.878397 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d3319-29f7-4b3f-99a0-177c78ef00dd admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:28.889891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d3319-29f7-4b3f-99a0-177c78ef00dd admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:28.954974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467dc71-359b-48d9-905a-8d7de4f3c0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:28.955626 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467dc71-359b-48d9-905a-8d7de4f3c0e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:28.955908 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467dc71-359b-48d9-905a-8d7de4f3c0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:28.956184 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467dc71-359b-48d9-905a-8d7de4f3c0e1 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:28.956875 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467dc71-359b-48d9-905a-8d7de4f3c0e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:28.958843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467dc71-359b-48d9-905a-8d7de4f3c0e1 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:29.089461 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1313/2661] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:32:28 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:32:29.097069 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bad57f-ac1b-41d8-8a6a-c238182987ec admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:29.114870 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bad57f-ac1b-41d8-8a6a-c238182987ec admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:29.120932 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c94ed-082e-462c-91b0-91c56b878def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:29.121796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c94ed-082e-462c-91b0-91c56b878def admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:29.122329 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c94ed-082e-462c-91b0-91c56b878def admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:29.122792 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c94ed-082e-462c-91b0-91c56b878def admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:29.124680 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c94ed-082e-462c-91b0-91c56b878def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:29.126908 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c94ed-082e-462c-91b0-91c56b878def admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:29.138372 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1349/2662] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:32:29.144450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467dc71-359b-48d9-905a-8d7de4f3c0e1 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:29.157258 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467dc71-359b-48d9-905a-8d7de4f3c0e1 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:29.162114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64276533-9428-497e-9440-ccfe854908d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:29.162720 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64276533-9428-497e-9440-ccfe854908d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:29.162999 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64276533-9428-497e-9440-ccfe854908d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:29.163530 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64276533-9428-497e-9440-ccfe854908d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:29.164352 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64276533-9428-497e-9440-ccfe854908d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:29.166073 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64276533-9428-497e-9440-ccfe854908d4 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:29.179174 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1314/2663] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:32:29.184198 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c94ed-082e-462c-91b0-91c56b878def admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:29.199835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c94ed-082e-462c-91b0-91c56b878def admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:29.204815 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd119d-0366-42b1-99ed-1db81057775e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:29.205497 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd119d-0366-42b1-99ed-1db81057775e admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:29.205782 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd119d-0366-42b1-99ed-1db81057775e admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:29.206201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd119d-0366-42b1-99ed-1db81057775e admin admin] PATH_INFO: `/v3/projects/fff21fecc9db4c0e8003f61d1617efa3/users/586001d82e444e7ebba368f2eebfeec9/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:29.225398 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd119d-0366-42b1-99ed-1db81057775e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff21fecc9db4c0e8003f61d1617efa3, user_id=586001d82e444e7ebba368f2eebfeec9, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:29.228299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd119d-0366-42b1-99ed-1db81057775e admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:29.334944 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1350/2664] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:32:29 2022] PUT /identity/v3/projects/fff21fecc9db4c0e8003f61d1617efa3/users/586001d82e444e7ebba368f2eebfeec9/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:32:29.347987 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8428-cbbe-488f-a2cc-dfbba642f33f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:29.348266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8428-cbbe-488f-a2cc-dfbba642f33f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:29.348544 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8428-cbbe-488f-a2cc-dfbba642f33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:29.385739 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-3eba8428-cbbe-488f-a2cc-dfbba642f33f None None] MFA Rules not processed for user `586001d82e444e7ebba368f2eebfeec9`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:29.386987 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-3eba8428-cbbe-488f-a2cc-dfbba642f33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:29.469117 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:29.487242 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1315/2665] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:32:29.500363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd119d-0366-42b1-99ed-1db81057775e admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:29.503000 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ebfd119d-0366-42b1-99ed-1db81057775e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:29.585902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd119d-0366-42b1-99ed-1db81057775e admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:29.598377 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374d130-6450-4ee8-adf6-81ceb3632e3a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72840602ec264a74855b601c8d1ddf89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:29.600869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374d130-6450-4ee8-adf6-81ceb3632e3a service glance] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:29.601312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374d130-6450-4ee8-adf6-81ceb3632e3a service glance] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:29.601823 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374d130-6450-4ee8-adf6-81ceb3632e3a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:29.633233 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374d130-6450-4ee8-adf6-81ceb3632e3a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:29.635154 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374d130-6450-4ee8-adf6-81ceb3632e3a service glance] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:29.649941 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1351/2666] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:32:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:32:36.346094 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae9488-4ea2-4e63-bb3a-9026a82b917f None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:36.346766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae9488-4ea2-4e63-bb3a-9026a82b917f None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:36.346766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae9488-4ea2-4e63-bb3a-9026a82b917f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:36.370222 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-3aae9488-4ea2-4e63-bb3a-9026a82b917f None None] MFA Rules not processed for user `e2940758d8424054bf3a68a42b79bb81`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:36.371546 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-3aae9488-4ea2-4e63-bb3a-9026a82b917f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:36.446322 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1316/2667] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:32:37.115191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374d130-6450-4ee8-adf6-81ceb3632e3a service glance] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:37.117024 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-a374d130-6450-4ee8-adf6-81ceb3632e3a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:37.162326 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:37.189044 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374d130-6450-4ee8-adf6-81ceb3632e3a service glance] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:37.192831 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846e6a8-0151-4558-9bc9-fc6f6a128747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:37.193440 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846e6a8-0151-4558-9bc9-fc6f6a128747 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:37.193729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846e6a8-0151-4558-9bc9-fc6f6a128747 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:37.194037 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846e6a8-0151-4558-9bc9-fc6f6a128747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:37.195819 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b846e6a8-0151-4558-9bc9-fc6f6a128747 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:37.276843 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846e6a8-0151-4558-9bc9-fc6f6a128747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:37.278561 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846e6a8-0151-4558-9bc9-fc6f6a128747 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:37.291671 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1352/2668] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:32:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:32:39.898913 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae9488-4ea2-4e63-bb3a-9026a82b917f None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:39.900648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-3aae9488-4ea2-4e63-bb3a-9026a82b917f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:39.971324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae9488-4ea2-4e63-bb3a-9026a82b917f None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:39.975588 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be8f98-eb26-48d7-bb93-bde825217fc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:39.976042 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be8f98-eb26-48d7-bb93-bde825217fc1 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:39.977397 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be8f98-eb26-48d7-bb93-bde825217fc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:39.977397 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be8f98-eb26-48d7-bb93-bde825217fc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:39.978546 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-17be8f98-eb26-48d7-bb93-bde825217fc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:40.001600 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be8f98-eb26-48d7-bb93-bde825217fc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:40.003108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be8f98-eb26-48d7-bb93-bde825217fc1 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:40.015683 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1317/2669] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:32:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:32:47.785171 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=39 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:50.009884 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=54 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:50.130471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56808f-ded8-4271-9d32-f55b8c3aca6b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:50.130471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56808f-ded8-4271-9d32-f55b8c3aca6b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:50.130471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56808f-ded8-4271-9d32-f55b8c3aca6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:50.162597 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-3a56808f-ded8-4271-9d32-f55b8c3aca6b None None] MFA Rules not processed for user `e343f998e5e34447bd2b5f0a2627bbdf`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:50.163848 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-3a56808f-ded8-4271-9d32-f55b8c3aca6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:50.232263 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1353/2670] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:32:50.944557 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cfb6b-24a3-4bf8-89ec-a9521293889d None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:50.944843 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cfb6b-24a3-4bf8-89ec-a9521293889d None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:50.945144 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cfb6b-24a3-4bf8-89ec-a9521293889d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:50.966604 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-4b9cfb6b-24a3-4bf8-89ec-a9521293889d None None] MFA Rules not processed for user `f45f65dd3a844cb583e42d837d2a58d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:50.969681 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-4b9cfb6b-24a3-4bf8-89ec-a9521293889d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:51.028337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1318/2671] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Sep 2 21:32:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:32:51.180719 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56808f-ded8-4271-9d32-f55b8c3aca6b None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:51.182219 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-3a56808f-ded8-4271-9d32-f55b8c3aca6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:51.303943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56808f-ded8-4271-9d32-f55b8c3aca6b None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:51.311918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8995734-f841-4830-b928-47aed594b34a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da2b1dc9dae413a8ee63ad67e840f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:51.312832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8995734-f841-4830-b928-47aed594b34a service swift] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:51.313314 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8995734-f841-4830-b928-47aed594b34a service swift] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:51.313772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8995734-f841-4830-b928-47aed594b34a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:51.325357 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8995734-f841-4830-b928-47aed594b34a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:51.327366 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8995734-f841-4830-b928-47aed594b34a service swift] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:51.347359 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1354/2672] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Sep 2 21:32:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:32:52.517022 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdde56-d998-4742-83b0-f2c0255ab702 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:52.517604 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdde56-d998-4742-83b0-f2c0255ab702 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:52.517604 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdde56-d998-4742-83b0-f2c0255ab702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:52.539731 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-bbcdde56-d998-4742-83b0-f2c0255ab702 None None] MFA Rules not processed for user `f45f65dd3a844cb583e42d837d2a58d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:52.540955 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-bbcdde56-d998-4742-83b0-f2c0255ab702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:52.549050 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1319/2673] 10.222.0.79 () {58 vars in 967 bytes} [Fri Sep 2 21:32:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:32:52.563230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8995734-f841-4830-b928-47aed594b34a service swift] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:52.573940 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8995734-f841-4830-b928-47aed594b34a service swift] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:52.579700 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2cc46-8d2b-4e75-b789-544a0aee83ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da2b1dc9dae413a8ee63ad67e840f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:52.580309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2cc46-8d2b-4e75-b789-544a0aee83ed service swift] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:52.580596 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2cc46-8d2b-4e75-b789-544a0aee83ed service swift] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:52.580882 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2cc46-8d2b-4e75-b789-544a0aee83ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:52.589309 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2cc46-8d2b-4e75-b789-544a0aee83ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:52.591793 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2cc46-8d2b-4e75-b789-544a0aee83ed service swift] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:52.600722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1355/2674] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Sep 2 21:32:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:32:53.742640 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793520e-ea0a-458a-863a-ec0b57e4ab79 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:53.743342 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793520e-ea0a-458a-863a-ec0b57e4ab79 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:53.743342 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793520e-ea0a-458a-863a-ec0b57e4ab79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:53.767464 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-8793520e-ea0a-458a-863a-ec0b57e4ab79 None None] MFA Rules not processed for user `f45f65dd3a844cb583e42d837d2a58d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:53.768674 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8793520e-ea0a-458a-863a-ec0b57e4ab79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:53.776256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1320/2675] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Sep 2 21:32:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:32:53.791919 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2cc46-8d2b-4e75-b789-544a0aee83ed service swift] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:53.804728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2cc46-8d2b-4e75-b789-544a0aee83ed service swift] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:53.811120 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73895c13-7a91-4f48-9c2d-211d1cef4382 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da2b1dc9dae413a8ee63ad67e840f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:53.811788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73895c13-7a91-4f48-9c2d-211d1cef4382 service swift] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:53.812109 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73895c13-7a91-4f48-9c2d-211d1cef4382 service swift] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:53.812448 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73895c13-7a91-4f48-9c2d-211d1cef4382 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:53.822629 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73895c13-7a91-4f48-9c2d-211d1cef4382 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:53.824229 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73895c13-7a91-4f48-9c2d-211d1cef4382 service swift] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:53.834138 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1356/2676] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Sep 2 21:32:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 02 21:32:54.263295 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793520e-ea0a-458a-863a-ec0b57e4ab79 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:54.329859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793520e-ea0a-458a-863a-ec0b57e4ab79 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:54.336218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75922175-ae1c-47c8-990e-6051afacb8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:54.336997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75922175-ae1c-47c8-990e-6051afacb8a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:54.337608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75922175-ae1c-47c8-990e-6051afacb8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:54.338035 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75922175-ae1c-47c8-990e-6051afacb8a1 admin admin] PATH_INFO: `/v3/users/586001d82e444e7ebba368f2eebfeec9` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:54.339911 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75922175-ae1c-47c8-990e-6051afacb8a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=586001d82e444e7ebba368f2eebfeec9)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:54.342596 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75922175-ae1c-47c8-990e-6051afacb8a1 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:54.638864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f0db0-a2e0-4427-b394-db54cbb65dc1 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:54.639288 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f0db0-a2e0-4427-b394-db54cbb65dc1 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:54.639626 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f0db0-a2e0-4427-b394-db54cbb65dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:54.661267 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-4d2f0db0-a2e0-4427-b394-db54cbb65dc1 None None] MFA Rules not processed for user `f45f65dd3a844cb583e42d837d2a58d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:54.662520 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-4d2f0db0-a2e0-4427-b394-db54cbb65dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:54.670216 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1357/2677] 10.222.0.79 () {58 vars in 967 bytes} [Fri Sep 2 21:32:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:32:54.693340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f0db0-a2e0-4427-b394-db54cbb65dc1 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:54.707953 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f0db0-a2e0-4427-b394-db54cbb65dc1 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:54.709206 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-75922175-ae1c-47c8-990e-6051afacb8a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '586001d82e444e7ebba368f2eebfeec9'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:54.710016 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-75922175-ae1c-47c8-990e-6051afacb8a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '586001d82e444e7ebba368f2eebfeec9'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:54.717648 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6ff11-31c8-44fa-8913-e51b66ba0c05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3da2b1dc9dae413a8ee63ad67e840f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:54.718571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6ff11-31c8-44fa-8913-e51b66ba0c05 service swift] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:54.718975 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6ff11-31c8-44fa-8913-e51b66ba0c05 service swift] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:54.719438 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6ff11-31c8-44fa-8913-e51b66ba0c05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:54.721297 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-75922175-ae1c-47c8-990e-6051afacb8a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '586001d82e444e7ebba368f2eebfeec9'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:54.728556 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6ff11-31c8-44fa-8913-e51b66ba0c05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:54.730200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6ff11-31c8-44fa-8913-e51b66ba0c05 service swift] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:54.735320 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-75922175-ae1c-47c8-990e-6051afacb8a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '586001d82e444e7ebba368f2eebfeec9'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:54.736454 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-75922175-ae1c-47c8-990e-6051afacb8a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '586001d82e444e7ebba368f2eebfeec9'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:54.739749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1358/2678] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Sep 2 21:32:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 02 21:32:54.819029 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1321/2679] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:32:54 2022] DELETE /identity/v3/users/586001d82e444e7ebba368f2eebfeec9 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:32:54.823559 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc17e3-ab83-447a-92ca-52ca8a718d79 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:54.823994 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc17e3-ab83-447a-92ca-52ca8a718d79 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:54.824263 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc17e3-ab83-447a-92ca-52ca8a718d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:54.846601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-b7cc17e3-ab83-447a-92ca-52ca8a718d79 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:54.846601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b7cc17e3-ab83-447a-92ca-52ca8a718d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:54.899127 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:54.916534 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1359/2680] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:32:54.928944 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75922175-ae1c-47c8-990e-6051afacb8a1 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:54.930572 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-75922175-ae1c-47c8-990e-6051afacb8a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:54.954966 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:55.013520 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75922175-ae1c-47c8-990e-6051afacb8a1 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:55.018300 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246bc987-3836-46b3-81f6-23d774d67411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:55.019030 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bc987-3836-46b3-81f6-23d774d67411 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:55.019381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bc987-3836-46b3-81f6-23d774d67411 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:55.019729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bc987-3836-46b3-81f6-23d774d67411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:55.044507 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246bc987-3836-46b3-81f6-23d774d67411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:55.044507 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246bc987-3836-46b3-81f6-23d774d67411 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:55.045248 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1322/2681] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:32:55.578753 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc17e3-ab83-447a-92ca-52ca8a718d79 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:55.580234 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b7cc17e3-ab83-447a-92ca-52ca8a718d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:55.599156 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc17e3-ab83-447a-92ca-52ca8a718d79 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:55.606491 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48baae-b589-41f4-8295-bcc596b0ab62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:55.607590 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48baae-b589-41f4-8295-bcc596b0ab62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:55.608190 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48baae-b589-41f4-8295-bcc596b0ab62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:55.608645 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48baae-b589-41f4-8295-bcc596b0ab62 admin admin] PATH_INFO: `/v3/projects/fff21fecc9db4c0e8003f61d1617efa3` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:55.610073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48baae-b589-41f4-8295-bcc596b0ab62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fff21fecc9db4c0e8003f61d1617efa3)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:55.612500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48baae-b589-41f4-8295-bcc596b0ab62 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:55.828832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4b48baae-b589-41f4-8295-bcc596b0ab62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fff21fecc9db4c0e8003f61d1617efa3', 'request_id': 'req-4b48baae-b589-41f4-8295-bcc596b0ab62'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:55.836918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4b48baae-b589-41f4-8295-bcc596b0ab62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fff21fecc9db4c0e8003f61d1617efa3', 'request_id': 'req-4b48baae-b589-41f4-8295-bcc596b0ab62'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:55.845326 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4b48baae-b589-41f4-8295-bcc596b0ab62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fff21fecc9db4c0e8003f61d1617efa3', 'request_id': 'req-4b48baae-b589-41f4-8295-bcc596b0ab62'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:55.995077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4b48baae-b589-41f4-8295-bcc596b0ab62 admin admin] The token cache is being invalidate because project fff21fecc9db4c0e8003f61d1617efa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:32:55.995381 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4b48baae-b589-41f4-8295-bcc596b0ab62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:55.996137 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-4b48baae-b589-41f4-8295-bcc596b0ab62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:55.998294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1360/2682] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:32:55 2022] DELETE /identity/v3/projects/fff21fecc9db4c0e8003f61d1617efa3 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:32:56.003390 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406dcdb-4c0e-4fbc-a6bd-57f1cb1660f6 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:56.003903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406dcdb-4c0e-4fbc-a6bd-57f1cb1660f6 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:56.004061 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406dcdb-4c0e-4fbc-a6bd-57f1cb1660f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:56.033575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-2406dcdb-4c0e-4fbc-a6bd-57f1cb1660f6 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:56.034850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-2406dcdb-4c0e-4fbc-a6bd-57f1cb1660f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:56.100894 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1323/2683] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:32:56.109132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd17e8-d1c9-4216-92dc-4004037a3f51 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:56.109364 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd17e8-d1c9-4216-92dc-4004037a3f51 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:56.109641 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd17e8-d1c9-4216-92dc-4004037a3f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:56.134160 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-ddbd17e8-d1c9-4216-92dc-4004037a3f51 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:56.135403 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-ddbd17e8-d1c9-4216-92dc-4004037a3f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:56.148808 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1361/2684] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:32:56.150413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406dcdb-4c0e-4fbc-a6bd-57f1cb1660f6 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:56.168573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406dcdb-4c0e-4fbc-a6bd-57f1cb1660f6 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:56.168573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1927d6-0dac-4e68-a023-51f34365851e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:56.169033 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1927d6-0dac-4e68-a023-51f34365851e admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:56.169302 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1927d6-0dac-4e68-a023-51f34365851e admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:56.169724 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1927d6-0dac-4e68-a023-51f34365851e admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:56.170433 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1927d6-0dac-4e68-a023-51f34365851e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:32:56.170793 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1927d6-0dac-4e68-a023-51f34365851e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:56.173323 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1927d6-0dac-4e68-a023-51f34365851e admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:56.192657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1324/2685] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:32:56.197099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd17e8-d1c9-4216-92dc-4004037a3f51 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:56.208685 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd17e8-d1c9-4216-92dc-4004037a3f51 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:56.219781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52767d-bceb-46ac-914d-cdd34421a585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:56.219781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52767d-bceb-46ac-914d-cdd34421a585 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:56.219781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52767d-bceb-46ac-914d-cdd34421a585 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:56.219781 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52767d-bceb-46ac-914d-cdd34421a585 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:56.220321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52767d-bceb-46ac-914d-cdd34421a585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:56.220321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52767d-bceb-46ac-914d-cdd34421a585 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:56.324911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1362/2686] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:32:56 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:32:56.332136 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1927d6-0dac-4e68-a023-51f34365851e admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:56.344729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1927d6-0dac-4e68-a023-51f34365851e admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:56.452851 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081c2d1-76be-468f-b111-3fc8e0c6173c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:56.452851 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081c2d1-76be-468f-b111-3fc8e0c6173c admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:56.452851 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081c2d1-76be-468f-b111-3fc8e0c6173c admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:56.452851 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081c2d1-76be-468f-b111-3fc8e0c6173c admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:56.453691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3081c2d1-76be-468f-b111-3fc8e0c6173c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:56.459154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3081c2d1-76be-468f-b111-3fc8e0c6173c admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:56.546061 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1325/2687] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:32:56 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:32:56.551361 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52767d-bceb-46ac-914d-cdd34421a585 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:56.569103 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52767d-bceb-46ac-914d-cdd34421a585 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:56.576338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f5d0a-8932-442e-a5ae-a4d1bb663c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:56.576978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f5d0a-8932-442e-a5ae-a4d1bb663c24 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:56.577447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f5d0a-8932-442e-a5ae-a4d1bb663c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:56.578100 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f5d0a-8932-442e-a5ae-a4d1bb663c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:56.578788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f5d0a-8932-442e-a5ae-a4d1bb663c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:56.580905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f5d0a-8932-442e-a5ae-a4d1bb663c24 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:56.598581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1363/2688] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:32:56.602864 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081c2d1-76be-468f-b111-3fc8e0c6173c admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:56.618464 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081c2d1-76be-468f-b111-3fc8e0c6173c admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:56.626750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b46fa0-ff79-4dd2-b00a-8c50640b2c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:56.627701 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b46fa0-ff79-4dd2-b00a-8c50640b2c8a admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:56.627987 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b46fa0-ff79-4dd2-b00a-8c50640b2c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:56.628266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b46fa0-ff79-4dd2-b00a-8c50640b2c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:56.629051 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b46fa0-ff79-4dd2-b00a-8c50640b2c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:56.631462 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b46fa0-ff79-4dd2-b00a-8c50640b2c8a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:56.644533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1326/2689] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:32:56.648952 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f5d0a-8932-442e-a5ae-a4d1bb663c24 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:56.660771 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f5d0a-8932-442e-a5ae-a4d1bb663c24 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:56.666020 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84dc5a-b2ad-4b02-a838-dee92b56416d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:56.666764 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84dc5a-b2ad-4b02-a838-dee92b56416d admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:56.669654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84dc5a-b2ad-4b02-a838-dee92b56416d admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:56.669654 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84dc5a-b2ad-4b02-a838-dee92b56416d admin admin] PATH_INFO: `/v3/projects/965f060a091946f0952f6cf1c3b736f3/users/3a0c14af3c1440adae0a2196c68681dd/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:56.684314 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84dc5a-b2ad-4b02-a838-dee92b56416d admin admin] RBAC: Authorizing `identity:create_grant(project_id=965f060a091946f0952f6cf1c3b736f3, user_id=3a0c14af3c1440adae0a2196c68681dd, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:56.686948 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84dc5a-b2ad-4b02-a838-dee92b56416d admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:56.776082 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1364/2690] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:32:56 2022] PUT /identity/v3/projects/965f060a091946f0952f6cf1c3b736f3/users/3a0c14af3c1440adae0a2196c68681dd/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:32:56.787593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597ed1c-c192-4e51-acac-0b056ddfdb3a None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:56.787931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597ed1c-c192-4e51-acac-0b056ddfdb3a None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:56.788168 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597ed1c-c192-4e51-acac-0b056ddfdb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:56.819162 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-f597ed1c-c192-4e51-acac-0b056ddfdb3a None None] MFA Rules not processed for user `3a0c14af3c1440adae0a2196c68681dd`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:56.820372 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f597ed1c-c192-4e51-acac-0b056ddfdb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:56.829117 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:56.891288 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1327/2691] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:32:56.903682 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84dc5a-b2ad-4b02-a838-dee92b56416d admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:56.905608 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-0c84dc5a-b2ad-4b02-a838-dee92b56416d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:56.988404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84dc5a-b2ad-4b02-a838-dee92b56416d admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:56.988663 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d9fee-af02-4d94-b73d-326fcc16110b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:56.989305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d9fee-af02-4d94-b73d-326fcc16110b service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:56.989588 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d9fee-af02-4d94-b73d-326fcc16110b service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:56.990026 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d9fee-af02-4d94-b73d-326fcc16110b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:56.999377 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d9fee-af02-4d94-b73d-326fcc16110b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:57.000970 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d9fee-af02-4d94-b73d-326fcc16110b service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:57.010667 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1365/2692] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:32:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:32:57.989244 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597ed1c-c192-4e51-acac-0b056ddfdb3a None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:57.990789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f597ed1c-c192-4e51-acac-0b056ddfdb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:58.071573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597ed1c-c192-4e51-acac-0b056ddfdb3a None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:58.077802 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072900a6-23bb-4be7-8c38-a6faf826e632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:58.078509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072900a6-23bb-4be7-8c38-a6faf826e632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:58.079024 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072900a6-23bb-4be7-8c38-a6faf826e632 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:58.079194 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072900a6-23bb-4be7-8c38-a6faf826e632 admin admin] PATH_INFO: `/v3/users/e1ce89c776494d41a3f5cf18076a688c` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:58.080550 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072900a6-23bb-4be7-8c38-a6faf826e632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ce89c776494d41a3f5cf18076a688c)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:58.082601 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072900a6-23bb-4be7-8c38-a6faf826e632 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:58.303335 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-072900a6-23bb-4be7-8c38-a6faf826e632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ce89c776494d41a3f5cf18076a688c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:58.304245 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-072900a6-23bb-4be7-8c38-a6faf826e632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ce89c776494d41a3f5cf18076a688c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:58.318681 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-072900a6-23bb-4be7-8c38-a6faf826e632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ce89c776494d41a3f5cf18076a688c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:58.334598 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-072900a6-23bb-4be7-8c38-a6faf826e632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ce89c776494d41a3f5cf18076a688c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:58.335344 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-072900a6-23bb-4be7-8c38-a6faf826e632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ce89c776494d41a3f5cf18076a688c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:58.428340 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1328/2693] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:32:57 2022] DELETE /identity/v3/users/e1ce89c776494d41a3f5cf18076a688c => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:32:58.442792 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac641be-258d-4f60-93e8-80e3c3ce3e87 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:58.443296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac641be-258d-4f60-93e8-80e3c3ce3e87 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:58.443398 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac641be-258d-4f60-93e8-80e3c3ce3e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:58.451727 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:58.466776 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-4ac641be-258d-4f60-93e8-80e3c3ce3e87 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:32:58.468057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-4ac641be-258d-4f60-93e8-80e3c3ce3e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:58.529779 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1366/2694] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:32:58.539557 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072900a6-23bb-4be7-8c38-a6faf826e632 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:58.541019 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-072900a6-23bb-4be7-8c38-a6faf826e632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:58.575610 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:58.603394 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072900a6-23bb-4be7-8c38-a6faf826e632 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:58.607631 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551eb1f1-f473-480b-9608-0c796d448530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:58.608314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eb1f1-f473-480b-9608-0c796d448530 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:58.608605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eb1f1-f473-480b-9608-0c796d448530 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:58.609167 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eb1f1-f473-480b-9608-0c796d448530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:58.619452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551eb1f1-f473-480b-9608-0c796d448530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:58.620884 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551eb1f1-f473-480b-9608-0c796d448530 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:58.631673 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1329/2695] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:32:58.906467 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac641be-258d-4f60-93e8-80e3c3ce3e87 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:32:58.913436 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-4ac641be-258d-4f60-93e8-80e3c3ce3e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:32:58.923313 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac641be-258d-4f60-93e8-80e3c3ce3e87 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:32:58.928609 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964fd18-4341-4067-b377-58967b7ecd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:32:58.929280 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964fd18-4341-4067-b377-58967b7ecd36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:32:58.929680 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964fd18-4341-4067-b377-58967b7ecd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:32:58.929825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964fd18-4341-4067-b377-58967b7ecd36 admin admin] PATH_INFO: `/v3/projects/3bc1a0a5f86e4a48b2442c9ae0b6457c` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:32:58.931082 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964fd18-4341-4067-b377-58967b7ecd36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bc1a0a5f86e4a48b2442c9ae0b6457c)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:32:58.933484 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964fd18-4341-4067-b377-58967b7ecd36 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:32:59.082701 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-a964fd18-4341-4067-b377-58967b7ecd36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'request_id': 'req-a964fd18-4341-4067-b377-58967b7ecd36'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:59.091487 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-a964fd18-4341-4067-b377-58967b7ecd36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'request_id': 'req-a964fd18-4341-4067-b377-58967b7ecd36'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:59.100727 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-a964fd18-4341-4067-b377-58967b7ecd36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'request_id': 'req-a964fd18-4341-4067-b377-58967b7ecd36'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:59.233193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-a964fd18-4341-4067-b377-58967b7ecd36 admin admin] The token cache is being invalidate because project 3bc1a0a5f86e4a48b2442c9ae0b6457c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:32:59.233487 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-a964fd18-4341-4067-b377-58967b7ecd36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:59.234147 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-a964fd18-4341-4067-b377-58967b7ecd36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:32:59.235744 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1367/2696] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:32:58 2022] DELETE /identity/v3/projects/3bc1a0a5f86e4a48b2442c9ae0b6457c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:33:08.721127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=13 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:09.229472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:11.191688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551eb1f1-f473-480b-9608-0c796d448530 service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:11.200627 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551eb1f1-f473-480b-9608-0c796d448530 service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:11.261287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad2677-e571-4e5d-9d9d-bc16c211d303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:11.261922 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad2677-e571-4e5d-9d9d-bc16c211d303 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:11.262205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad2677-e571-4e5d-9d9d-bc16c211d303 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:11.262473 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad2677-e571-4e5d-9d9d-bc16c211d303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:11.264289 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-2fad2677-e571-4e5d-9d9d-bc16c211d303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:11.332885 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad2677-e571-4e5d-9d9d-bc16c211d303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:11.334366 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad2677-e571-4e5d-9d9d-bc16c211d303 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:11.346889 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1330/2697] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:33:11 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:33:21.340303 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=50 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:24.530340 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964fd18-4341-4067-b377-58967b7ecd36 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:24.532945 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-a964fd18-4341-4067-b377-58967b7ecd36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:24.602073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964fd18-4341-4067-b377-58967b7ecd36 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:24.607059 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21d64d-383a-438c-a942-642889f9c69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:24.607702 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21d64d-383a-438c-a942-642889f9c69a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:24.607983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21d64d-383a-438c-a942-642889f9c69a admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:24.608408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21d64d-383a-438c-a942-642889f9c69a admin admin] PATH_INFO: `/v3/users/3a0c14af3c1440adae0a2196c68681dd` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:24.609642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21d64d-383a-438c-a942-642889f9c69a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a0c14af3c1440adae0a2196c68681dd)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:24.612868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21d64d-383a-438c-a942-642889f9c69a admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:24.787237 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-fe21d64d-383a-438c-a942-642889f9c69a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a0c14af3c1440adae0a2196c68681dd'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:24.787883 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-fe21d64d-383a-438c-a942-642889f9c69a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a0c14af3c1440adae0a2196c68681dd'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:24.805129 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-fe21d64d-383a-438c-a942-642889f9c69a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a0c14af3c1440adae0a2196c68681dd'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:24.817393 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-fe21d64d-383a-438c-a942-642889f9c69a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a0c14af3c1440adae0a2196c68681dd'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:24.818191 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-fe21d64d-383a-438c-a942-642889f9c69a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a0c14af3c1440adae0a2196c68681dd'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:24.898019 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1368/2698] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:33:24 2022] DELETE /identity/v3/users/3a0c14af3c1440adae0a2196c68681dd => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:33:24.903434 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b8a09-3371-4a25-8479-00d29edaeb07 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:24.904050 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b8a09-3371-4a25-8479-00d29edaeb07 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:24.904308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b8a09-3371-4a25-8479-00d29edaeb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:24.929058 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-fb4b8a09-3371-4a25-8479-00d29edaeb07 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:24.930453 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-fb4b8a09-3371-4a25-8479-00d29edaeb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:24.996157 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1331/2699] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:33:25.006707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21d64d-383a-438c-a942-642889f9c69a admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:25.008202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-fe21d64d-383a-438c-a942-642889f9c69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:25.066874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21d64d-383a-438c-a942-642889f9c69a admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:25.070666 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c77769-6ac7-4fbb-9310-9316bacbd199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:25.071271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c77769-6ac7-4fbb-9310-9316bacbd199 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:25.071551 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c77769-6ac7-4fbb-9310-9316bacbd199 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:25.071827 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c77769-6ac7-4fbb-9310-9316bacbd199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:25.082116 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c77769-6ac7-4fbb-9310-9316bacbd199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:25.083610 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c77769-6ac7-4fbb-9310-9316bacbd199 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:25.094816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1369/2700] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:33:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:33:25.599600 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b8a09-3371-4a25-8479-00d29edaeb07 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:25.601257 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-fb4b8a09-3371-4a25-8479-00d29edaeb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:25.619093 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b8a09-3371-4a25-8479-00d29edaeb07 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:25.624475 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2753251-8789-4d99-9dfb-b4c7d128411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:25.625165 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2753251-8789-4d99-9dfb-b4c7d128411c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:25.625619 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2753251-8789-4d99-9dfb-b4c7d128411c admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:25.626187 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2753251-8789-4d99-9dfb-b4c7d128411c admin admin] PATH_INFO: `/v3/projects/965f060a091946f0952f6cf1c3b736f3` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:25.627698 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2753251-8789-4d99-9dfb-b4c7d128411c admin admin] RBAC: Authorizing `identity:delete_project(project_id=965f060a091946f0952f6cf1c3b736f3)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:25.629845 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2753251-8789-4d99-9dfb-b4c7d128411c admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:25.809872 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-c2753251-8789-4d99-9dfb-b4c7d128411c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '965f060a091946f0952f6cf1c3b736f3', 'request_id': 'req-c2753251-8789-4d99-9dfb-b4c7d128411c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:25.816564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-c2753251-8789-4d99-9dfb-b4c7d128411c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '965f060a091946f0952f6cf1c3b736f3', 'request_id': 'req-c2753251-8789-4d99-9dfb-b4c7d128411c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:25.822455 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-c2753251-8789-4d99-9dfb-b4c7d128411c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '965f060a091946f0952f6cf1c3b736f3', 'request_id': 'req-c2753251-8789-4d99-9dfb-b4c7d128411c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:25.965316 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-c2753251-8789-4d99-9dfb-b4c7d128411c admin admin] The token cache is being invalidate because project 965f060a091946f0952f6cf1c3b736f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:33:25.966029 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-c2753251-8789-4d99-9dfb-b4c7d128411c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:25.966332 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-c2753251-8789-4d99-9dfb-b4c7d128411c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:25.967970 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1332/2701] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:33:25 2022] DELETE /identity/v3/projects/965f060a091946f0952f6cf1c3b736f3 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:33:25.973583 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8136d9f-9d21-474f-81cd-ff26feee6a1b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:25.981069 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8136d9f-9d21-474f-81cd-ff26feee6a1b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:25.981069 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8136d9f-9d21-474f-81cd-ff26feee6a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:25.994461 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-e8136d9f-9d21-474f-81cd-ff26feee6a1b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:25.995655 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-e8136d9f-9d21-474f-81cd-ff26feee6a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:26.013539 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:26.056974 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1370/2702] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:33:26.065415 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b1879-badd-4a63-b189-bb48b7f9bb05 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:26.065693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b1879-badd-4a63-b189-bb48b7f9bb05 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:26.065998 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b1879-badd-4a63-b189-bb48b7f9bb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:26.087359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-c32b1879-badd-4a63-b189-bb48b7f9bb05 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:26.088653 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-c32b1879-badd-4a63-b189-bb48b7f9bb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:26.097614 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1333/2703] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:33:26.102077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8136d9f-9d21-474f-81cd-ff26feee6a1b None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:26.113158 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8136d9f-9d21-474f-81cd-ff26feee6a1b None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:26.117905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435830c3-ec84-43a4-bf90-65cdce59264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:26.118504 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435830c3-ec84-43a4-bf90-65cdce59264c admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:26.118785 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435830c3-ec84-43a4-bf90-65cdce59264c admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:26.119054 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435830c3-ec84-43a4-bf90-65cdce59264c admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:26.119694 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435830c3-ec84-43a4-bf90-65cdce59264c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:33:26.119997 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435830c3-ec84-43a4-bf90-65cdce59264c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:26.121628 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435830c3-ec84-43a4-bf90-65cdce59264c admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:26.135242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1371/2704] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:33:26.140497 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b1879-badd-4a63-b189-bb48b7f9bb05 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:26.152598 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b1879-badd-4a63-b189-bb48b7f9bb05 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:26.157339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210546bb-1a19-487e-8e8b-361d05afcfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:26.157983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210546bb-1a19-487e-8e8b-361d05afcfa9 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:26.158267 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210546bb-1a19-487e-8e8b-361d05afcfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:26.158538 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210546bb-1a19-487e-8e8b-361d05afcfa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:26.159181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210546bb-1a19-487e-8e8b-361d05afcfa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:26.161111 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210546bb-1a19-487e-8e8b-361d05afcfa9 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:26.264179 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1334/2705] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:33:26 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:33:26.270830 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435830c3-ec84-43a4-bf90-65cdce59264c admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:26.280871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435830c3-ec84-43a4-bf90-65cdce59264c admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:26.342322 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cada75-29b7-4fad-86f8-4a2a07f45eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:26.342929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cada75-29b7-4fad-86f8-4a2a07f45eaa admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:26.343214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cada75-29b7-4fad-86f8-4a2a07f45eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:26.343659 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cada75-29b7-4fad-86f8-4a2a07f45eaa admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:26.344174 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cada75-29b7-4fad-86f8-4a2a07f45eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:26.346245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cada75-29b7-4fad-86f8-4a2a07f45eaa admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:26.466063 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1372/2706] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:33:26 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:33:26.474375 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210546bb-1a19-487e-8e8b-361d05afcfa9 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:26.481458 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210546bb-1a19-487e-8e8b-361d05afcfa9 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:26.488146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3321468-dbd3-4412-b0a0-ab9a6a90872e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:26.488776 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3321468-dbd3-4412-b0a0-ab9a6a90872e admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:26.489057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3321468-dbd3-4412-b0a0-ab9a6a90872e admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:26.489340 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3321468-dbd3-4412-b0a0-ab9a6a90872e admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:26.490037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3321468-dbd3-4412-b0a0-ab9a6a90872e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:26.491699 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3321468-dbd3-4412-b0a0-ab9a6a90872e admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:26.504334 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1335/2707] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:33:26.508656 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cada75-29b7-4fad-86f8-4a2a07f45eaa admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:26.522885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cada75-29b7-4fad-86f8-4a2a07f45eaa admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:26.527978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a34ae-5b9a-4668-a4fc-d35849b054e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:26.528574 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a34ae-5b9a-4668-a4fc-d35849b054e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:26.528854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a34ae-5b9a-4668-a4fc-d35849b054e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:26.529124 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a34ae-5b9a-4668-a4fc-d35849b054e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:26.529758 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a34ae-5b9a-4668-a4fc-d35849b054e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:26.531417 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a34ae-5b9a-4668-a4fc-d35849b054e4 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:26.542477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1373/2708] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:33:26.546821 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3321468-dbd3-4412-b0a0-ab9a6a90872e admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:26.557470 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3321468-dbd3-4412-b0a0-ab9a6a90872e admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:26.562154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62701aa0-cf5a-479a-ba61-80fbe6c225b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:26.563514 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62701aa0-cf5a-479a-ba61-80fbe6c225b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:26.563970 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62701aa0-cf5a-479a-ba61-80fbe6c225b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:26.564349 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62701aa0-cf5a-479a-ba61-80fbe6c225b0 admin admin] PATH_INFO: `/v3/projects/a2f96deb0c2344db8f90f64a97c54c93/users/aac66ea08996408eaad7bd2b5d3da94c/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:26.579794 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62701aa0-cf5a-479a-ba61-80fbe6c225b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f96deb0c2344db8f90f64a97c54c93, user_id=aac66ea08996408eaad7bd2b5d3da94c, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:26.582480 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62701aa0-cf5a-479a-ba61-80fbe6c225b0 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:26.655094 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1336/2709] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:33:26 2022] PUT /identity/v3/projects/a2f96deb0c2344db8f90f64a97c54c93/users/aac66ea08996408eaad7bd2b5d3da94c/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:33:26.667749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad5a32-03ac-46be-b73b-95ccfe19c752 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:26.668031 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad5a32-03ac-46be-b73b-95ccfe19c752 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:26.668305 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad5a32-03ac-46be-b73b-95ccfe19c752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:26.702753 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-eaad5a32-03ac-46be-b73b-95ccfe19c752 None None] MFA Rules not processed for user `aac66ea08996408eaad7bd2b5d3da94c`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:26.704575 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-eaad5a32-03ac-46be-b73b-95ccfe19c752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:26.788315 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1374/2710] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:33:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:33:26.801052 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62701aa0-cf5a-479a-ba61-80fbe6c225b0 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:26.802931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-62701aa0-cf5a-479a-ba61-80fbe6c225b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:26.828349 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:26.869429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62701aa0-cf5a-479a-ba61-80fbe6c225b0 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:26.873171 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c285454-42d3-4366-b52d-3c467e2d8a4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:26.874805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c285454-42d3-4366-b52d-3c467e2d8a4c service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:26.874805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c285454-42d3-4366-b52d-3c467e2d8a4c service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:26.874805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c285454-42d3-4366-b52d-3c467e2d8a4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:26.883323 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c285454-42d3-4366-b52d-3c467e2d8a4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:26.884869 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c285454-42d3-4366-b52d-3c467e2d8a4c service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:26.894651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1337/2711] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:33:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:33:31.307285 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad5a32-03ac-46be-b73b-95ccfe19c752 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:31.339137 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:31.395735 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad5a32-03ac-46be-b73b-95ccfe19c752 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:31.401335 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ace6d-ecad-4e77-b7cc-16e921ea2c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:31.402020 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ace6d-ecad-4e77-b7cc-16e921ea2c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:31.402307 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ace6d-ecad-4e77-b7cc-16e921ea2c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:31.402586 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ace6d-ecad-4e77-b7cc-16e921ea2c00 admin admin] PATH_INFO: `/v3/users/aac66ea08996408eaad7bd2b5d3da94c` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:31.403738 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ace6d-ecad-4e77-b7cc-16e921ea2c00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aac66ea08996408eaad7bd2b5d3da94c)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:31.405685 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ace6d-ecad-4e77-b7cc-16e921ea2c00 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:31.645639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-dd4ace6d-ecad-4e77-b7cc-16e921ea2c00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aac66ea08996408eaad7bd2b5d3da94c'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:31.646271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-dd4ace6d-ecad-4e77-b7cc-16e921ea2c00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aac66ea08996408eaad7bd2b5d3da94c'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:31.664326 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-dd4ace6d-ecad-4e77-b7cc-16e921ea2c00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aac66ea08996408eaad7bd2b5d3da94c'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:31.673707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-dd4ace6d-ecad-4e77-b7cc-16e921ea2c00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aac66ea08996408eaad7bd2b5d3da94c'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:31.674579 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-dd4ace6d-ecad-4e77-b7cc-16e921ea2c00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aac66ea08996408eaad7bd2b5d3da94c'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:31.803350 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1375/2712] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:33:31 2022] DELETE /identity/v3/users/aac66ea08996408eaad7bd2b5d3da94c => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:33:31.810607 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0fad8-0936-4938-b597-67ac25541f16 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:31.811416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0fad8-0936-4938-b597-67ac25541f16 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:31.811633 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0fad8-0936-4938-b597-67ac25541f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:31.833618 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-d6e0fad8-0936-4938-b597-67ac25541f16 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:31.834902 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d6e0fad8-0936-4938-b597-67ac25541f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:31.909010 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1338/2713] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:33:31.923754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ace6d-ecad-4e77-b7cc-16e921ea2c00 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:31.925441 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-dd4ace6d-ecad-4e77-b7cc-16e921ea2c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:31.996053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ace6d-ecad-4e77-b7cc-16e921ea2c00 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:31.999829 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfd953-1ec9-46f4-9c25-113967c52e7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:32.000915 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfd953-1ec9-46f4-9c25-113967c52e7b service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:32.001155 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfd953-1ec9-46f4-9c25-113967c52e7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:32.001426 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfd953-1ec9-46f4-9c25-113967c52e7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:32.012026 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfd953-1ec9-46f4-9c25-113967c52e7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:32.013476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfd953-1ec9-46f4-9c25-113967c52e7b service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:32.025176 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1376/2714] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:33:32.557889 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0fad8-0936-4938-b597-67ac25541f16 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:32.557889 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-d6e0fad8-0936-4938-b597-67ac25541f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:32.567476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0fad8-0936-4938-b597-67ac25541f16 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:32.573958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125ac7b-f064-4c92-b114-60bb2de94ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:32.574646 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125ac7b-f064-4c92-b114-60bb2de94ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:32.574930 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125ac7b-f064-4c92-b114-60bb2de94ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:32.575239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125ac7b-f064-4c92-b114-60bb2de94ed1 admin admin] PATH_INFO: `/v3/projects/a2f96deb0c2344db8f90f64a97c54c93` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:32.576535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125ac7b-f064-4c92-b114-60bb2de94ed1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f96deb0c2344db8f90f64a97c54c93)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:32.578628 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125ac7b-f064-4c92-b114-60bb2de94ed1 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:32.760628 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2125ac7b-f064-4c92-b114-60bb2de94ed1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f96deb0c2344db8f90f64a97c54c93', 'request_id': 'req-2125ac7b-f064-4c92-b114-60bb2de94ed1'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:32.767899 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2125ac7b-f064-4c92-b114-60bb2de94ed1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f96deb0c2344db8f90f64a97c54c93', 'request_id': 'req-2125ac7b-f064-4c92-b114-60bb2de94ed1'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:32.774038 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2125ac7b-f064-4c92-b114-60bb2de94ed1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f96deb0c2344db8f90f64a97c54c93', 'request_id': 'req-2125ac7b-f064-4c92-b114-60bb2de94ed1'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:32.849944 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2125ac7b-f064-4c92-b114-60bb2de94ed1 admin admin] The token cache is being invalidate because project a2f96deb0c2344db8f90f64a97c54c93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:33:32.850608 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2125ac7b-f064-4c92-b114-60bb2de94ed1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:32.850974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-2125ac7b-f064-4c92-b114-60bb2de94ed1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:33:32.853491 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1339/2715] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:33:32 2022] DELETE /identity/v3/projects/a2f96deb0c2344db8f90f64a97c54c93 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:33:32.858603 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f5ad6-c07b-420d-863f-3b3f9801492c None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:32.859641 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f5ad6-c07b-420d-863f-3b3f9801492c None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:32.859795 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f5ad6-c07b-420d-863f-3b3f9801492c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:32.887710 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-601f5ad6-c07b-420d-863f-3b3f9801492c None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:32.889025 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-601f5ad6-c07b-420d-863f-3b3f9801492c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:32.933513 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:32.969960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1377/2716] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:33:32.979854 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e6279-45b8-45f0-9dec-02aa7d2db073 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:32.980159 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e6279-45b8-45f0-9dec-02aa7d2db073 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:32.980488 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e6279-45b8-45f0-9dec-02aa7d2db073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:33.004577 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-760e6279-45b8-45f0-9dec-02aa7d2db073 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:33.006049 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-760e6279-45b8-45f0-9dec-02aa7d2db073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:33.017529 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1340/2717] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:33:33.022837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f5ad6-c07b-420d-863f-3b3f9801492c None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:33.034821 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f5ad6-c07b-420d-863f-3b3f9801492c None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:33.043836 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96f9b0-5a78-4701-8820-ca825e3710d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:33.044573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96f9b0-5a78-4701-8820-ca825e3710d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:33.044948 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96f9b0-5a78-4701-8820-ca825e3710d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:33.052658 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96f9b0-5a78-4701-8820-ca825e3710d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:33.052658 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96f9b0-5a78-4701-8820-ca825e3710d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:33:33.052658 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96f9b0-5a78-4701-8820-ca825e3710d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:33.052658 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96f9b0-5a78-4701-8820-ca825e3710d6 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:33.064415 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1378/2718] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:33:33.070539 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e6279-45b8-45f0-9dec-02aa7d2db073 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:33.081141 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e6279-45b8-45f0-9dec-02aa7d2db073 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:33.086221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e222e-a363-40da-b03b-4cceec1d19a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:33.086852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e222e-a363-40da-b03b-4cceec1d19a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:33.087143 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e222e-a363-40da-b03b-4cceec1d19a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:33.087399 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e222e-a363-40da-b03b-4cceec1d19a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:33.088060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e222e-a363-40da-b03b-4cceec1d19a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:33.090114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e222e-a363-40da-b03b-4cceec1d19a4 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:33.261666 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1341/2719] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:33:33 2022] POST /identity/v3/projects => generated 367 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:33:33.267002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96f9b0-5a78-4701-8820-ca825e3710d6 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:33.277449 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96f9b0-5a78-4701-8820-ca825e3710d6 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:33.348412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4122554-a2ba-4d7c-bb0c-7e733e5d2e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:33.349179 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4122554-a2ba-4d7c-bb0c-7e733e5d2e66 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:33.349471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4122554-a2ba-4d7c-bb0c-7e733e5d2e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:33.349745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4122554-a2ba-4d7c-bb0c-7e733e5d2e66 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:33.350449 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4122554-a2ba-4d7c-bb0c-7e733e5d2e66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:33.352397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4122554-a2ba-4d7c-bb0c-7e733e5d2e66 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:33.483511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1379/2720] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:33:33 2022] POST /identity/v3/users => generated 284 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:33:33.488348 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e222e-a363-40da-b03b-4cceec1d19a4 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:33.504199 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e222e-a363-40da-b03b-4cceec1d19a4 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:33.509054 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf30bb-ae55-4f9b-8ace-c8f2d80bf7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:33.509651 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf30bb-ae55-4f9b-8ace-c8f2d80bf7ef admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:33.509977 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf30bb-ae55-4f9b-8ace-c8f2d80bf7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:33.510267 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf30bb-ae55-4f9b-8ace-c8f2d80bf7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:33.510940 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf30bb-ae55-4f9b-8ace-c8f2d80bf7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:33.512623 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf30bb-ae55-4f9b-8ace-c8f2d80bf7ef admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:33.523845 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1342/2721] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:33:33.528105 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4122554-a2ba-4d7c-bb0c-7e733e5d2e66 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:33.538566 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4122554-a2ba-4d7c-bb0c-7e733e5d2e66 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:33.543786 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1769f-cd5b-454d-871b-ef835ca9c26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:33.544411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1769f-cd5b-454d-871b-ef835ca9c26d admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:33.544685 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1769f-cd5b-454d-871b-ef835ca9c26d admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:33.545120 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1769f-cd5b-454d-871b-ef835ca9c26d admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:33.545780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1769f-cd5b-454d-871b-ef835ca9c26d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:33.547522 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1769f-cd5b-454d-871b-ef835ca9c26d admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:33.558974 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1380/2722] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:33:33.563906 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf30bb-ae55-4f9b-8ace-c8f2d80bf7ef admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:33.574677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf30bb-ae55-4f9b-8ace-c8f2d80bf7ef admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:33.580597 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420f6bd-5f78-41ea-9427-a12dce7ffdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:33.581295 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420f6bd-5f78-41ea-9427-a12dce7ffdcb admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:33.581583 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420f6bd-5f78-41ea-9427-a12dce7ffdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:33.581902 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420f6bd-5f78-41ea-9427-a12dce7ffdcb admin admin] PATH_INFO: `/v3/projects/fa33405055f14416bc7f32f47ba8d310/users/a448ef8d3ff147e7b44d8117395dfbdf/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:33.584671 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:33.600642 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420f6bd-5f78-41ea-9427-a12dce7ffdcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa33405055f14416bc7f32f47ba8d310, user_id=a448ef8d3ff147e7b44d8117395dfbdf, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:33.603883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420f6bd-5f78-41ea-9427-a12dce7ffdcb admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:33.697191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1343/2723] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:33:33 2022] PUT /identity/v3/projects/fa33405055f14416bc7f32f47ba8d310/users/a448ef8d3ff147e7b44d8117395dfbdf/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:33:33.709034 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ddc7e-add6-4bec-84e5-543e2a556482 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:33.709486 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ddc7e-add6-4bec-84e5-543e2a556482 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:33.709778 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ddc7e-add6-4bec-84e5-543e2a556482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:33.746159 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-da0ddc7e-add6-4bec-84e5-543e2a556482 None None] MFA Rules not processed for user `a448ef8d3ff147e7b44d8117395dfbdf`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:33:33.747593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-da0ddc7e-add6-4bec-84e5-543e2a556482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:33.832660 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1381/2724] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:33:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:33:33.849390 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420f6bd-5f78-41ea-9427-a12dce7ffdcb admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:33.851903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-9420f6bd-5f78-41ea-9427-a12dce7ffdcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:33.940145 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420f6bd-5f78-41ea-9427-a12dce7ffdcb admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:33.943974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fa9ef-ecf7-4fc6-8046-69f006f0c90d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72840602ec264a74855b601c8d1ddf89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:33.944620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fa9ef-ecf7-4fc6-8046-69f006f0c90d service glance] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:33.945249 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fa9ef-ecf7-4fc6-8046-69f006f0c90d service glance] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:33.945249 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fa9ef-ecf7-4fc6-8046-69f006f0c90d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:33.955611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745fa9ef-ecf7-4fc6-8046-69f006f0c90d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:33.958097 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745fa9ef-ecf7-4fc6-8046-69f006f0c90d service glance] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:33.967648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1344/2725] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:33:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:33:42.196575 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ddc7e-add6-4bec-84e5-543e2a556482 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:33:42.198220 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-da0ddc7e-add6-4bec-84e5-543e2a556482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:42.250247 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:42.267946 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ddc7e-add6-4bec-84e5-543e2a556482 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:33:42.271582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d61527-a65e-41e9-b8a1-98d6d25c805e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:33:42.272193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d61527-a65e-41e9-b8a1-98d6d25c805e service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:33:42.272476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d61527-a65e-41e9-b8a1-98d6d25c805e service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:33:42.272752 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d61527-a65e-41e9-b8a1-98d6d25c805e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:33:42.274693 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-a7d61527-a65e-41e9-b8a1-98d6d25c805e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:33:42.284987 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d61527-a65e-41e9-b8a1-98d6d25c805e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:33:42.286550 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d61527-a65e-41e9-b8a1-98d6d25c805e service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:33:42.295008 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1382/2726] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:33:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:33:43.963158 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:52.429230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=10 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:16.024825 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fa9ef-ecf7-4fc6-8046-69f006f0c90d service glance] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:16.027584 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-745fa9ef-ecf7-4fc6-8046-69f006f0c90d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:16.157731 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fa9ef-ecf7-4fc6-8046-69f006f0c90d service glance] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:16.164588 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea115b-74e2-40ea-8fd2-391359595fc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:16.165789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea115b-74e2-40ea-8fd2-391359595fc4 service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:16.168755 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea115b-74e2-40ea-8fd2-391359595fc4 service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:16.169262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea115b-74e2-40ea-8fd2-391359595fc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:16.171643 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-c3ea115b-74e2-40ea-8fd2-391359595fc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:16.189579 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea115b-74e2-40ea-8fd2-391359595fc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:16.191790 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea115b-74e2-40ea-8fd2-391359595fc4 service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:16.207264 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1345/2727] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:34:20.324222 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d61527-a65e-41e9-b8a1-98d6d25c805e service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:20.391660 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d61527-a65e-41e9-b8a1-98d6d25c805e service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:20.397105 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc240e1-0c10-4d9f-83bd-dd16a415a40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:20.397783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc240e1-0c10-4d9f-83bd-dd16a415a40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:20.398107 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc240e1-0c10-4d9f-83bd-dd16a415a40c admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:20.398382 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc240e1-0c10-4d9f-83bd-dd16a415a40c admin admin] PATH_INFO: `/v3/users/a448ef8d3ff147e7b44d8117395dfbdf` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:20.399516 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc240e1-0c10-4d9f-83bd-dd16a415a40c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a448ef8d3ff147e7b44d8117395dfbdf)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:20.401560 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc240e1-0c10-4d9f-83bd-dd16a415a40c admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:20.692750 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-dcc240e1-0c10-4d9f-83bd-dd16a415a40c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a448ef8d3ff147e7b44d8117395dfbdf'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:20.693474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-dcc240e1-0c10-4d9f-83bd-dd16a415a40c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a448ef8d3ff147e7b44d8117395dfbdf'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:20.706643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-dcc240e1-0c10-4d9f-83bd-dd16a415a40c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a448ef8d3ff147e7b44d8117395dfbdf'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:20.713656 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-dcc240e1-0c10-4d9f-83bd-dd16a415a40c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a448ef8d3ff147e7b44d8117395dfbdf'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:20.714503 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-dcc240e1-0c10-4d9f-83bd-dd16a415a40c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a448ef8d3ff147e7b44d8117395dfbdf'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:20.804973 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1383/2728] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:34:20 2022] DELETE /identity/v3/users/a448ef8d3ff147e7b44d8117395dfbdf => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:34:20.805189 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea115b-74e2-40ea-8fd2-391359595fc4 service nova] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:20.811107 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758cb3e-cccb-4d85-9eff-7a3658d0a700 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:20.811402 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758cb3e-cccb-4d85-9eff-7a3658d0a700 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:20.811685 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758cb3e-cccb-4d85-9eff-7a3658d0a700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:20.820151 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea115b-74e2-40ea-8fd2-391359595fc4 service nova] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:20.834616 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-3758cb3e-cccb-4d85-9eff-7a3658d0a700 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:20.835878 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-3758cb3e-cccb-4d85-9eff-7a3658d0a700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:20.890198 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7c349-d00a-478a-8dff-9bb9b7758b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:20.893587 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7c349-d00a-478a-8dff-9bb9b7758b3f service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:20.893786 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7c349-d00a-478a-8dff-9bb9b7758b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:20.894076 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7c349-d00a-478a-8dff-9bb9b7758b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:20.903671 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e5b7c349-d00a-478a-8dff-9bb9b7758b3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:20.928799 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1384/2729] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:20.939566 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758cb3e-cccb-4d85-9eff-7a3658d0a700 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:20.941387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-3758cb3e-cccb-4d85-9eff-7a3658d0a700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:20.955013 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758cb3e-cccb-4d85-9eff-7a3658d0a700 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:20.958953 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce257dc-d292-4747-ae42-b37eb52d7227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:20.959630 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce257dc-d292-4747-ae42-b37eb52d7227 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:20.959911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce257dc-d292-4747-ae42-b37eb52d7227 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:20.960184 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce257dc-d292-4747-ae42-b37eb52d7227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:20.972275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce257dc-d292-4747-ae42-b37eb52d7227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:20.972926 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce257dc-d292-4747-ae42-b37eb52d7227 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:20.981570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7c349-d00a-478a-8dff-9bb9b7758b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:20.983356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7c349-d00a-478a-8dff-9bb9b7758b3f service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:20.985923 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1385/2730] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:34:20.995289 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1346/2731] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:34:21.641165 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce257dc-d292-4747-ae42-b37eb52d7227 service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:21.642806 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-7ce257dc-d292-4747-ae42-b37eb52d7227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:21.659489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce257dc-d292-4747-ae42-b37eb52d7227 service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:21.668294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c71c13-b1dc-4160-b435-90788c4cd6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:21.668294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c71c13-b1dc-4160-b435-90788c4cd6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:21.668294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c71c13-b1dc-4160-b435-90788c4cd6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:21.668294 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c71c13-b1dc-4160-b435-90788c4cd6bd admin admin] PATH_INFO: `/v3/projects/fa33405055f14416bc7f32f47ba8d310` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:21.668822 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c71c13-b1dc-4160-b435-90788c4cd6bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa33405055f14416bc7f32f47ba8d310)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:21.671592 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c71c13-b1dc-4160-b435-90788c4cd6bd admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:21.673372 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:21.846936 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c9c71c13-b1dc-4160-b435-90788c4cd6bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa33405055f14416bc7f32f47ba8d310', 'request_id': 'req-c9c71c13-b1dc-4160-b435-90788c4cd6bd'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:21.853898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c9c71c13-b1dc-4160-b435-90788c4cd6bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa33405055f14416bc7f32f47ba8d310', 'request_id': 'req-c9c71c13-b1dc-4160-b435-90788c4cd6bd'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:21.861255 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c9c71c13-b1dc-4160-b435-90788c4cd6bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa33405055f14416bc7f32f47ba8d310', 'request_id': 'req-c9c71c13-b1dc-4160-b435-90788c4cd6bd'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:21.942356 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c9c71c13-b1dc-4160-b435-90788c4cd6bd admin admin] The token cache is being invalidate because project fa33405055f14416bc7f32f47ba8d310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:34:21.942652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c9c71c13-b1dc-4160-b435-90788c4cd6bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:21.943338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-c9c71c13-b1dc-4160-b435-90788c4cd6bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:21.944998 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1386/2732] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:34:21 2022] DELETE /identity/v3/projects/fa33405055f14416bc7f32f47ba8d310 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:21.950667 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f7770-0c3f-4a02-b4ac-c7d96ba7aba1 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:21.951239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f7770-0c3f-4a02-b4ac-c7d96ba7aba1 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:21.951239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f7770-0c3f-4a02-b4ac-c7d96ba7aba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:21.975997 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-404f7770-0c3f-4a02-b4ac-c7d96ba7aba1 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:21.977711 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-404f7770-0c3f-4a02-b4ac-c7d96ba7aba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:22.033928 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=100 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:22.082621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1347/2733] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:22.084438 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9d060-b98b-49c0-8329-03901feab828 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:22.084734 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9d060-b98b-49c0-8329-03901feab828 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:22.085012 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9d060-b98b-49c0-8329-03901feab828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:22.113225 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-a8f9d060-b98b-49c0-8329-03901feab828 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:22.117705 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-a8f9d060-b98b-49c0-8329-03901feab828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:22.126936 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1387/2734] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:22.131160 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f7770-0c3f-4a02-b4ac-c7d96ba7aba1 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:22.157327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f7770-0c3f-4a02-b4ac-c7d96ba7aba1 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:22.157327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ed2cf-cbf6-4699-987c-9bae818ae9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:22.157327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ed2cf-cbf6-4699-987c-9bae818ae9cf admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:22.157327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ed2cf-cbf6-4699-987c-9bae818ae9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:22.157739 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ed2cf-cbf6-4699-987c-9bae818ae9cf admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:22.157739 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ed2cf-cbf6-4699-987c-9bae818ae9cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:34:22.157739 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ed2cf-cbf6-4699-987c-9bae818ae9cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:22.157739 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ed2cf-cbf6-4699-987c-9bae818ae9cf admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:22.175766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1348/2735] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:34:22.176922 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9d060-b98b-49c0-8329-03901feab828 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:22.188201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9d060-b98b-49c0-8329-03901feab828 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:22.193958 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a105854-03f0-4150-953f-07634f2e1f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:22.195002 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a105854-03f0-4150-953f-07634f2e1f65 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:22.196093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a105854-03f0-4150-953f-07634f2e1f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:22.196513 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a105854-03f0-4150-953f-07634f2e1f65 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:22.197214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a105854-03f0-4150-953f-07634f2e1f65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:22.199394 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a105854-03f0-4150-953f-07634f2e1f65 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:22.508606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1388/2736] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:34:22 2022] POST /identity/v3/projects => generated 373 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:34:22.546309 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ed2cf-cbf6-4699-987c-9bae818ae9cf admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:22.546309 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ed2cf-cbf6-4699-987c-9bae818ae9cf admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:22.596289 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62a48e-9b83-4757-bc23-869862a500b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:22.597041 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62a48e-9b83-4757-bc23-869862a500b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:22.597255 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62a48e-9b83-4757-bc23-869862a500b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:22.597581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62a48e-9b83-4757-bc23-869862a500b8 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:22.598235 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62a48e-9b83-4757-bc23-869862a500b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:22.600245 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62a48e-9b83-4757-bc23-869862a500b8 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:22.747214 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1349/2737] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:34:22 2022] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:34:22.751887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a105854-03f0-4150-953f-07634f2e1f65 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:22.762994 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a105854-03f0-4150-953f-07634f2e1f65 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:22.769300 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56c1bc-401d-4c09-bc20-a412d4b8687d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:22.769991 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56c1bc-401d-4c09-bc20-a412d4b8687d admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:22.770352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56c1bc-401d-4c09-bc20-a412d4b8687d admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:22.770662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56c1bc-401d-4c09-bc20-a412d4b8687d admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:22.771440 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56c1bc-401d-4c09-bc20-a412d4b8687d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:22.773530 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56c1bc-401d-4c09-bc20-a412d4b8687d admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:22.795730 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1389/2738] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:34:22.797265 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62a48e-9b83-4757-bc23-869862a500b8 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:22.810244 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62a48e-9b83-4757-bc23-869862a500b8 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:22.816636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1524f38-9f58-4fdc-9b50-d616cda92fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:22.817371 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1524f38-9f58-4fdc-9b50-d616cda92fac admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:22.817757 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1524f38-9f58-4fdc-9b50-d616cda92fac admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:22.818114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1524f38-9f58-4fdc-9b50-d616cda92fac admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:22.819012 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1524f38-9f58-4fdc-9b50-d616cda92fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:22.822527 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1524f38-9f58-4fdc-9b50-d616cda92fac admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:22.844377 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1350/2739] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:34:22.845568 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56c1bc-401d-4c09-bc20-a412d4b8687d admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:22.859681 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56c1bc-401d-4c09-bc20-a412d4b8687d admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:22.867208 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd1892-5246-4d8a-909f-1b81d13f984b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:22.867621 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd1892-5246-4d8a-909f-1b81d13f984b admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:22.868010 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd1892-5246-4d8a-909f-1b81d13f984b admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:22.868383 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd1892-5246-4d8a-909f-1b81d13f984b admin admin] PATH_INFO: `/v3/projects/58aed09680924896882c4ac74f96b49d/users/0ca79e7b2eee43f8bfc66b710c64f975/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:22.887268 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd1892-5246-4d8a-909f-1b81d13f984b admin admin] RBAC: Authorizing `identity:create_grant(project_id=58aed09680924896882c4ac74f96b49d, user_id=0ca79e7b2eee43f8bfc66b710c64f975, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:22.891351 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd1892-5246-4d8a-909f-1b81d13f984b admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:23.017464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1390/2740] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:34:22 2022] PUT /identity/v3/projects/58aed09680924896882c4ac74f96b49d/users/0ca79e7b2eee43f8bfc66b710c64f975/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:34:23.028130 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0e459-e5c8-4e4f-910c-9ff21055fb24 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:23.028691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0e459-e5c8-4e4f-910c-9ff21055fb24 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:23.028691 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0e459-e5c8-4e4f-910c-9ff21055fb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:23.067413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-29e0e459-e5c8-4e4f-910c-9ff21055fb24 None None] MFA Rules not processed for user `0ca79e7b2eee43f8bfc66b710c64f975`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:23.068946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-29e0e459-e5c8-4e4f-910c-9ff21055fb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:23.153326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1351/2741] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:34:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:23.165094 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd1892-5246-4d8a-909f-1b81d13f984b admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:23.166872 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-abbd1892-5246-4d8a-909f-1b81d13f984b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:23.235287 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd1892-5246-4d8a-909f-1b81d13f984b admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:23.239194 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37562de0-0d36-4a34-9bdf-d0aa4a23a795 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:23.239807 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37562de0-0d36-4a34-9bdf-d0aa4a23a795 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:23.240097 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37562de0-0d36-4a34-9bdf-d0aa4a23a795 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:23.240377 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37562de0-0d36-4a34-9bdf-d0aa4a23a795 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:23.250436 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37562de0-0d36-4a34-9bdf-d0aa4a23a795 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:23.251851 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37562de0-0d36-4a34-9bdf-d0aa4a23a795 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:23.261837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1391/2742] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:34:23.292251 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0e459-e5c8-4e4f-910c-9ff21055fb24 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:23.334907 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:23.368815 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0e459-e5c8-4e4f-910c-9ff21055fb24 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:23.376321 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404b5c5-8146-4f8a-b9b9-9a6e100528a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:23.377101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404b5c5-8146-4f8a-b9b9-9a6e100528a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:23.377379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404b5c5-8146-4f8a-b9b9-9a6e100528a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:23.377670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404b5c5-8146-4f8a-b9b9-9a6e100528a3 admin admin] PATH_INFO: `/v3/users/0ca79e7b2eee43f8bfc66b710c64f975` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:23.379057 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404b5c5-8146-4f8a-b9b9-9a6e100528a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ca79e7b2eee43f8bfc66b710c64f975)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:23.381765 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404b5c5-8146-4f8a-b9b9-9a6e100528a3 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:23.774106 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-4404b5c5-8146-4f8a-b9b9-9a6e100528a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ca79e7b2eee43f8bfc66b710c64f975'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:23.774836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-4404b5c5-8146-4f8a-b9b9-9a6e100528a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ca79e7b2eee43f8bfc66b710c64f975'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:23.783952 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-4404b5c5-8146-4f8a-b9b9-9a6e100528a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ca79e7b2eee43f8bfc66b710c64f975'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:23.799495 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-4404b5c5-8146-4f8a-b9b9-9a6e100528a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ca79e7b2eee43f8bfc66b710c64f975'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:23.800432 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-4404b5c5-8146-4f8a-b9b9-9a6e100528a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ca79e7b2eee43f8bfc66b710c64f975'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:23.916919 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1352/2743] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:34:23 2022] DELETE /identity/v3/users/0ca79e7b2eee43f8bfc66b710c64f975 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:23.924332 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d4240-6137-4d10-81d6-37645822aa90 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:23.924943 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d4240-6137-4d10-81d6-37645822aa90 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:23.925092 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d4240-6137-4d10-81d6-37645822aa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:23.951489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-fa4d4240-6137-4d10-81d6-37645822aa90 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:23.952957 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-fa4d4240-6137-4d10-81d6-37645822aa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:23.979840 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:24.016832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1392/2744] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:34:24.026762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404b5c5-8146-4f8a-b9b9-9a6e100528a3 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:24.028191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-4404b5c5-8146-4f8a-b9b9-9a6e100528a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:24.096369 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404b5c5-8146-4f8a-b9b9-9a6e100528a3 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:24.100230 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a81ba5-c6b0-40d7-8fb7-b09cfea6c3a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:24.100899 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a81ba5-c6b0-40d7-8fb7-b09cfea6c3a9 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:24.101107 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a81ba5-c6b0-40d7-8fb7-b09cfea6c3a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:24.101384 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a81ba5-c6b0-40d7-8fb7-b09cfea6c3a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:24.114203 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a81ba5-c6b0-40d7-8fb7-b09cfea6c3a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:24.116758 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a81ba5-c6b0-40d7-8fb7-b09cfea6c3a9 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:24.134909 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1353/2745] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:34:24.648160 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d4240-6137-4d10-81d6-37645822aa90 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:24.648160 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-fa4d4240-6137-4d10-81d6-37645822aa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:24.663318 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d4240-6137-4d10-81d6-37645822aa90 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:24.674494 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffd60e-05c6-4a70-a17a-77abaab23f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:24.675849 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffd60e-05c6-4a70-a17a-77abaab23f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:24.676276 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffd60e-05c6-4a70-a17a-77abaab23f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:24.676767 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffd60e-05c6-4a70-a17a-77abaab23f59 admin admin] PATH_INFO: `/v3/projects/58aed09680924896882c4ac74f96b49d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:24.678707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffd60e-05c6-4a70-a17a-77abaab23f59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58aed09680924896882c4ac74f96b49d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:24.682006 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffd60e-05c6-4a70-a17a-77abaab23f59 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:24.846390 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b7ffd60e-05c6-4a70-a17a-77abaab23f59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58aed09680924896882c4ac74f96b49d', 'request_id': 'req-b7ffd60e-05c6-4a70-a17a-77abaab23f59'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:24.853321 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b7ffd60e-05c6-4a70-a17a-77abaab23f59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58aed09680924896882c4ac74f96b49d', 'request_id': 'req-b7ffd60e-05c6-4a70-a17a-77abaab23f59'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:24.860480 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b7ffd60e-05c6-4a70-a17a-77abaab23f59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58aed09680924896882c4ac74f96b49d', 'request_id': 'req-b7ffd60e-05c6-4a70-a17a-77abaab23f59'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:24.971214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b7ffd60e-05c6-4a70-a17a-77abaab23f59 admin admin] The token cache is being invalidate because project 58aed09680924896882c4ac74f96b49d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:34:24.971984 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b7ffd60e-05c6-4a70-a17a-77abaab23f59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:24.972298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-b7ffd60e-05c6-4a70-a17a-77abaab23f59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:24.973887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1393/2746] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:34:24 2022] DELETE /identity/v3/projects/58aed09680924896882c4ac74f96b49d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:27.871621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a81ba5-c6b0-40d7-8fb7-b09cfea6c3a9 service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:27.874302 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-a7a81ba5-c6b0-40d7-8fb7-b09cfea6c3a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:27.958628 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:27.979787 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a81ba5-c6b0-40d7-8fb7-b09cfea6c3a9 service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:28.079953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f58a97-f2b8-4af2-9958-02ce6436bcb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:28.080506 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f58a97-f2b8-4af2-9958-02ce6436bcb7 service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:28.080787 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f58a97-f2b8-4af2-9958-02ce6436bcb7 service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:28.081161 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f58a97-f2b8-4af2-9958-02ce6436bcb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:28.083656 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-17f58a97-f2b8-4af2-9958-02ce6436bcb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:28.117870 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f58a97-f2b8-4af2-9958-02ce6436bcb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:28.121728 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f58a97-f2b8-4af2-9958-02ce6436bcb7 service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:28.150599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1354/2747] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:34:30.757602 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffd60e-05c6-4a70-a17a-77abaab23f59 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:30.759130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-b7ffd60e-05c6-4a70-a17a-77abaab23f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:30.834471 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffd60e-05c6-4a70-a17a-77abaab23f59 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:30.838409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bcc44-ef59-428d-a6e6-0433dd7ccd08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:30.839092 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bcc44-ef59-428d-a6e6-0433dd7ccd08 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:30.839374 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bcc44-ef59-428d-a6e6-0433dd7ccd08 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:30.839707 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bcc44-ef59-428d-a6e6-0433dd7ccd08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:30.841590 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f60bcc44-ef59-428d-a6e6-0433dd7ccd08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:30.933890 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bcc44-ef59-428d-a6e6-0433dd7ccd08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:30.936080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bcc44-ef59-428d-a6e6-0433dd7ccd08 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:30.948115 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1394/2748] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:34:35.103032 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd1f82-46b3-426c-970f-6b3386368858 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:35.103690 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd1f82-46b3-426c-970f-6b3386368858 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:35.103971 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd1f82-46b3-426c-970f-6b3386368858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:35.126146 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-02dd1f82-46b3-426c-970f-6b3386368858 None None] MFA Rules not processed for user `e343f998e5e34447bd2b5f0a2627bbdf`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:34:35.127387 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-02dd1f82-46b3-426c-970f-6b3386368858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:35.191430 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1355/2749] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:34:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:34:35.457423 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bcc44-ef59-428d-a6e6-0433dd7ccd08 service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:35.458997 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f60bcc44-ef59-428d-a6e6-0433dd7ccd08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:35.466664 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:35.551623 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bcc44-ef59-428d-a6e6-0433dd7ccd08 service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:35.556817 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6faef-2140-4cac-9bbc-e90f932468b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0f9604ee2e43b4967cbdc779e63e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:35.557440 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6faef-2140-4cac-9bbc-e90f932468b1 service placement] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:35.557723 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6faef-2140-4cac-9bbc-e90f932468b1 service placement] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:35.558048 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6faef-2140-4cac-9bbc-e90f932468b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:35.560740 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-34c6faef-2140-4cac-9bbc-e90f932468b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:35.572798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6faef-2140-4cac-9bbc-e90f932468b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:35.573008 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd1f82-46b3-426c-970f-6b3386368858 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:35.574460 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6faef-2140-4cac-9bbc-e90f932468b1 service placement] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:35.574600 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-02dd1f82-46b3-426c-970f-6b3386368858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:35.588425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1395/2750] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:34:35.599465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd1f82-46b3-426c-970f-6b3386368858 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:35.602921 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdadddc-047c-4ea5-ba88-02ccfd3a7fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:35.604157 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdadddc-047c-4ea5-ba88-02ccfd3a7fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:35.604949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdadddc-047c-4ea5-ba88-02ccfd3a7fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:35.605683 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdadddc-047c-4ea5-ba88-02ccfd3a7fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:35.609076 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-dfdadddc-047c-4ea5-ba88-02ccfd3a7fd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:35.633287 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdadddc-047c-4ea5-ba88-02ccfd3a7fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:35.635049 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdadddc-047c-4ea5-ba88-02ccfd3a7fd0 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:35.645290 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1356/2751] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:34:36.304462 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6faef-2140-4cac-9bbc-e90f932468b1 service placement] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:36.315670 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6faef-2140-4cac-9bbc-e90f932468b1 service placement] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:36.321012 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd506047-2875-4c46-b664-9fa1b7d6e5a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0f9604ee2e43b4967cbdc779e63e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:36.321640 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd506047-2875-4c46-b664-9fa1b7d6e5a4 service placement] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:36.321960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd506047-2875-4c46-b664-9fa1b7d6e5a4 service placement] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:36.322245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd506047-2875-4c46-b664-9fa1b7d6e5a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:36.324100 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-fd506047-2875-4c46-b664-9fa1b7d6e5a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:36.338249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd506047-2875-4c46-b664-9fa1b7d6e5a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:36.339879 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd506047-2875-4c46-b664-9fa1b7d6e5a4 service placement] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:36.351971 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1396/2752] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:34:39.863022 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdadddc-047c-4ea5-ba88-02ccfd3a7fd0 service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:39.864958 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-dfdadddc-047c-4ea5-ba88-02ccfd3a7fd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:39.882638 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdadddc-047c-4ea5-ba88-02ccfd3a7fd0 service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:39.897323 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0e117-2d3c-4ce0-a94f-8ce91d3d6593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:39.897323 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0e117-2d3c-4ce0-a94f-8ce91d3d6593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:39.897323 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0e117-2d3c-4ce0-a94f-8ce91d3d6593 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:39.897323 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0e117-2d3c-4ce0-a94f-8ce91d3d6593 admin admin] PATH_INFO: `/v3/users/1083cf32e76243ce9a88100374812ab7` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:39.897846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0e117-2d3c-4ce0-a94f-8ce91d3d6593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1083cf32e76243ce9a88100374812ab7)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:39.897846 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0e117-2d3c-4ce0-a94f-8ce91d3d6593 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:40.223226 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-1cb0e117-2d3c-4ce0-a94f-8ce91d3d6593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1083cf32e76243ce9a88100374812ab7'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:40.223876 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-1cb0e117-2d3c-4ce0-a94f-8ce91d3d6593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1083cf32e76243ce9a88100374812ab7'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:40.232129 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-1cb0e117-2d3c-4ce0-a94f-8ce91d3d6593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1083cf32e76243ce9a88100374812ab7'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:40.240221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:40.245286 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-1cb0e117-2d3c-4ce0-a94f-8ce91d3d6593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1083cf32e76243ce9a88100374812ab7'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:40.246050 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-1cb0e117-2d3c-4ce0-a94f-8ce91d3d6593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1083cf32e76243ce9a88100374812ab7'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:40.334984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1357/2753] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:34:39 2022] DELETE /identity/v3/users/1083cf32e76243ce9a88100374812ab7 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:40.758006 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd506047-2875-4c46-b664-9fa1b7d6e5a4 service placement] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:40.771077 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd506047-2875-4c46-b664-9fa1b7d6e5a4 service placement] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:40.866151 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386db85-0bd6-431a-af33-4c00386ddaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:40.866892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386db85-0bd6-431a-af33-4c00386ddaa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:40.867249 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386db85-0bd6-431a-af33-4c00386ddaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:40.867601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386db85-0bd6-431a-af33-4c00386ddaa1 admin admin] PATH_INFO: `/v3/projects/184566a121dd41218042897eeff2b216` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:40.868891 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386db85-0bd6-431a-af33-4c00386ddaa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=184566a121dd41218042897eeff2b216)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:40.870921 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386db85-0bd6-431a-af33-4c00386ddaa1 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:41.033422 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-5386db85-0bd6-431a-af33-4c00386ddaa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '184566a121dd41218042897eeff2b216', 'request_id': 'req-5386db85-0bd6-431a-af33-4c00386ddaa1'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:41.051410 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-5386db85-0bd6-431a-af33-4c00386ddaa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '184566a121dd41218042897eeff2b216', 'request_id': 'req-5386db85-0bd6-431a-af33-4c00386ddaa1'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:41.058846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-5386db85-0bd6-431a-af33-4c00386ddaa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '184566a121dd41218042897eeff2b216', 'request_id': 'req-5386db85-0bd6-431a-af33-4c00386ddaa1'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:41.169325 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-5386db85-0bd6-431a-af33-4c00386ddaa1 admin admin] The token cache is being invalidate because project 184566a121dd41218042897eeff2b216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:34:41.169646 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-5386db85-0bd6-431a-af33-4c00386ddaa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:41.170403 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-5386db85-0bd6-431a-af33-4c00386ddaa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:41.172048 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1397/2754] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:34:40 2022] DELETE /identity/v3/projects/184566a121dd41218042897eeff2b216 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:41.176555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0e117-2d3c-4ce0-a94f-8ce91d3d6593 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:41.178237 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-1cb0e117-2d3c-4ce0-a94f-8ce91d3d6593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:41.193108 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0e117-2d3c-4ce0-a94f-8ce91d3d6593 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:41.266226 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7e57e-1477-49ff-9c7c-be6fcb704749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:41.266931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7e57e-1477-49ff-9c7c-be6fcb704749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:41.267224 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7e57e-1477-49ff-9c7c-be6fcb704749 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:41.267688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7e57e-1477-49ff-9c7c-be6fcb704749 admin admin] PATH_INFO: `/v3/users/4061b6a81dfa4b9981ff1feec0781b9d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:41.269125 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7e57e-1477-49ff-9c7c-be6fcb704749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4061b6a81dfa4b9981ff1feec0781b9d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:41.271535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7e57e-1477-49ff-9c7c-be6fcb704749 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:41.577340 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-85d7e57e-1477-49ff-9c7c-be6fcb704749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4061b6a81dfa4b9981ff1feec0781b9d'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:41.578170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-85d7e57e-1477-49ff-9c7c-be6fcb704749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4061b6a81dfa4b9981ff1feec0781b9d'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:41.590361 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-85d7e57e-1477-49ff-9c7c-be6fcb704749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4061b6a81dfa4b9981ff1feec0781b9d'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:41.606767 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-85d7e57e-1477-49ff-9c7c-be6fcb704749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4061b6a81dfa4b9981ff1feec0781b9d'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:41.607739 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-85d7e57e-1477-49ff-9c7c-be6fcb704749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4061b6a81dfa4b9981ff1feec0781b9d'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:41.723605 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1358/2755] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:34:41 2022] DELETE /identity/v3/users/4061b6a81dfa4b9981ff1feec0781b9d => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:34:42.035504 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386db85-0bd6-431a-af33-4c00386ddaa1 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:42.035504 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-5386db85-0bd6-431a-af33-4c00386ddaa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:42.049185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386db85-0bd6-431a-af33-4c00386ddaa1 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:42.076265 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:42.133723 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04394890-52a7-4776-95a3-efb3c61cca1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:42.135271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04394890-52a7-4776-95a3-efb3c61cca1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:42.135271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04394890-52a7-4776-95a3-efb3c61cca1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:42.135271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04394890-52a7-4776-95a3-efb3c61cca1c admin admin] PATH_INFO: `/v3/projects/bbbe8d91849e41e79f8a1489966c68f0` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:42.136474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04394890-52a7-4776-95a3-efb3c61cca1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbbe8d91849e41e79f8a1489966c68f0)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:42.138477 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04394890-52a7-4776-95a3-efb3c61cca1c admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:42.273786 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-04394890-52a7-4776-95a3-efb3c61cca1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbbe8d91849e41e79f8a1489966c68f0', 'request_id': 'req-04394890-52a7-4776-95a3-efb3c61cca1c'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:42.282382 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-04394890-52a7-4776-95a3-efb3c61cca1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbbe8d91849e41e79f8a1489966c68f0', 'request_id': 'req-04394890-52a7-4776-95a3-efb3c61cca1c'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:42.288837 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-04394890-52a7-4776-95a3-efb3c61cca1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbbe8d91849e41e79f8a1489966c68f0', 'request_id': 'req-04394890-52a7-4776-95a3-efb3c61cca1c'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:42.396167 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-04394890-52a7-4776-95a3-efb3c61cca1c admin admin] The token cache is being invalidate because project bbbe8d91849e41e79f8a1489966c68f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:34:42.396517 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-04394890-52a7-4776-95a3-efb3c61cca1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:42.397192 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-04394890-52a7-4776-95a3-efb3c61cca1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:34:42.398745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1398/2756] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:34:42 2022] DELETE /identity/v3/projects/bbbe8d91849e41e79f8a1489966c68f0 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:34:46.108539 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7e57e-1477-49ff-9c7c-be6fcb704749 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:34:46.110076 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-85d7e57e-1477-49ff-9c7c-be6fcb704749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:46.183034 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:46.190010 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7e57e-1477-49ff-9c7c-be6fcb704749 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:34:46.260117 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4a43e-e483-463f-a204-0085bffe84fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:34:46.260983 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4a43e-e483-463f-a204-0085bffe84fe service nova] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:34:46.261277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4a43e-e483-463f-a204-0085bffe84fe service nova] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:34:46.261591 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4a43e-e483-463f-a204-0085bffe84fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:34:46.264493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-66d4a43e-e483-463f-a204-0085bffe84fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:34:46.278088 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4a43e-e483-463f-a204-0085bffe84fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:34:46.279850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4a43e-e483-463f-a204-0085bffe84fe service nova] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:34:46.290879 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1359/2757] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:34:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:34:52.756451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:56.394448 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=33 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:07.528103 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04394890-52a7-4776-95a3-efb3c61cca1c admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:07.529652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-04394890-52a7-4776-95a3-efb3c61cca1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:07.603271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04394890-52a7-4776-95a3-efb3c61cca1c admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:07.609161 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da531eb4-e83d-4c8f-88dc-8ec141ad7911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:07.610485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da531eb4-e83d-4c8f-88dc-8ec141ad7911 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:07.612706 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da531eb4-e83d-4c8f-88dc-8ec141ad7911 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:07.615674 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da531eb4-e83d-4c8f-88dc-8ec141ad7911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:07.620090 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-da531eb4-e83d-4c8f-88dc-8ec141ad7911 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:07.718150 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da531eb4-e83d-4c8f-88dc-8ec141ad7911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:07.720038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da531eb4-e83d-4c8f-88dc-8ec141ad7911 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:07.743034 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1399/2758] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:35:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:35:17.740231 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=61 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:26.582948 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4a43e-e483-463f-a204-0085bffe84fe service nova] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:26.593747 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4a43e-e483-463f-a204-0085bffe84fe service nova] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:26.598010 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098b3bb-fc30-45c7-8461-c18b3ce9e2f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:26.598617 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098b3bb-fc30-45c7-8461-c18b3ce9e2f3 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:26.598894 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098b3bb-fc30-45c7-8461-c18b3ce9e2f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:26.599164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098b3bb-fc30-45c7-8461-c18b3ce9e2f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:26.601157 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-6098b3bb-fc30-45c7-8461-c18b3ce9e2f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:26.674101 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098b3bb-fc30-45c7-8461-c18b3ce9e2f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:26.675658 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098b3bb-fc30-45c7-8461-c18b3ce9e2f3 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:26.688195 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1360/2759] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:35:35.176224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da531eb4-e83d-4c8f-88dc-8ec141ad7911 service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:35.177784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-da531eb4-e83d-4c8f-88dc-8ec141ad7911 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:35.193045 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da531eb4-e83d-4c8f-88dc-8ec141ad7911 service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:35.197732 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad153cd-61c7-4866-b5c0-aa14213e046e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:35.198403 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad153cd-61c7-4866-b5c0-aa14213e046e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:35.198684 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad153cd-61c7-4866-b5c0-aa14213e046e admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:35.198961 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad153cd-61c7-4866-b5c0-aa14213e046e admin admin] PATH_INFO: `/v3/users/e2940758d8424054bf3a68a42b79bb81` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:35.200106 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad153cd-61c7-4866-b5c0-aa14213e046e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2940758d8424054bf3a68a42b79bb81)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:35.203770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad153cd-61c7-4866-b5c0-aa14213e046e admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:35.442615 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7ad153cd-61c7-4866-b5c0-aa14213e046e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2940758d8424054bf3a68a42b79bb81'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:35.443235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7ad153cd-61c7-4866-b5c0-aa14213e046e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2940758d8424054bf3a68a42b79bb81'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:35.455848 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7ad153cd-61c7-4866-b5c0-aa14213e046e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2940758d8424054bf3a68a42b79bb81'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:35.464989 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7ad153cd-61c7-4866-b5c0-aa14213e046e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2940758d8424054bf3a68a42b79bb81'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:35.466119 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-7ad153cd-61c7-4866-b5c0-aa14213e046e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2940758d8424054bf3a68a42b79bb81'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:35.552720 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1400/2760] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:35:35 2022] DELETE /identity/v3/users/e2940758d8424054bf3a68a42b79bb81 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:35:35.811178 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098b3bb-fc30-45c7-8461-c18b3ce9e2f3 service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:35.827660 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098b3bb-fc30-45c7-8461-c18b3ce9e2f3 service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:35.891581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2e150-6411-452c-a259-718b3129ba52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:35.892295 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2e150-6411-452c-a259-718b3129ba52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:35.892586 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2e150-6411-452c-a259-718b3129ba52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:35.892903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2e150-6411-452c-a259-718b3129ba52 admin admin] PATH_INFO: `/v3/projects/d0d9b4769b124ec69714a30d02bb8557` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:35.894262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2e150-6411-452c-a259-718b3129ba52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0d9b4769b124ec69714a30d02bb8557)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:35.896677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2e150-6411-452c-a259-718b3129ba52 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:36.005235 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-93d2e150-6411-452c-a259-718b3129ba52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d9b4769b124ec69714a30d02bb8557', 'request_id': 'req-93d2e150-6411-452c-a259-718b3129ba52'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:36.011702 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-93d2e150-6411-452c-a259-718b3129ba52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d9b4769b124ec69714a30d02bb8557', 'request_id': 'req-93d2e150-6411-452c-a259-718b3129ba52'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:36.018372 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-93d2e150-6411-452c-a259-718b3129ba52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d9b4769b124ec69714a30d02bb8557', 'request_id': 'req-93d2e150-6411-452c-a259-718b3129ba52'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:36.129330 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-93d2e150-6411-452c-a259-718b3129ba52 admin admin] The token cache is being invalidate because project d0d9b4769b124ec69714a30d02bb8557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:35:36.129635 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-93d2e150-6411-452c-a259-718b3129ba52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:36.130313 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-93d2e150-6411-452c-a259-718b3129ba52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:36.131820 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1361/2761] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:35:35 2022] DELETE /identity/v3/projects/d0d9b4769b124ec69714a30d02bb8557 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:35:36.136125 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad153cd-61c7-4866-b5c0-aa14213e046e admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:36.138875 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-7ad153cd-61c7-4866-b5c0-aa14213e046e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:36.157356 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad153cd-61c7-4866-b5c0-aa14213e046e admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:36.218387 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7066769-db5b-464b-8a02-5efe4e23c8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:36.219130 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7066769-db5b-464b-8a02-5efe4e23c8b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:36.219323 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7066769-db5b-464b-8a02-5efe4e23c8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:36.219597 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7066769-db5b-464b-8a02-5efe4e23c8b7 admin admin] PATH_INFO: `/v3/users/558225cbbac34934948da9b212dfc6a0` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:36.236743 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7066769-db5b-464b-8a02-5efe4e23c8b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=558225cbbac34934948da9b212dfc6a0)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:36.239110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7066769-db5b-464b-8a02-5efe4e23c8b7 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:36.428772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-f7066769-db5b-464b-8a02-5efe4e23c8b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '558225cbbac34934948da9b212dfc6a0'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:36.429451 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-f7066769-db5b-464b-8a02-5efe4e23c8b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '558225cbbac34934948da9b212dfc6a0'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:36.441492 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:36.442868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-f7066769-db5b-464b-8a02-5efe4e23c8b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '558225cbbac34934948da9b212dfc6a0'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:36.450524 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-f7066769-db5b-464b-8a02-5efe4e23c8b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '558225cbbac34934948da9b212dfc6a0'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:36.451874 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-f7066769-db5b-464b-8a02-5efe4e23c8b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '558225cbbac34934948da9b212dfc6a0'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:36.534994 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1401/2762] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:35:36 2022] DELETE /identity/v3/users/558225cbbac34934948da9b212dfc6a0 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:35:36.866628 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2e150-6411-452c-a259-718b3129ba52 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:36.866628 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-93d2e150-6411-452c-a259-718b3129ba52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:36.879424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2e150-6411-452c-a259-718b3129ba52 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:36.902135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:36.954092 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526ab8f-aaa8-4486-b7be-9a51db2ad6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:36.954092 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526ab8f-aaa8-4486-b7be-9a51db2ad6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:36.954092 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526ab8f-aaa8-4486-b7be-9a51db2ad6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:36.954092 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526ab8f-aaa8-4486-b7be-9a51db2ad6f9 admin admin] PATH_INFO: `/v3/projects/41f32b62a4f64ba69edc44f63a37574d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:36.957951 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526ab8f-aaa8-4486-b7be-9a51db2ad6f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41f32b62a4f64ba69edc44f63a37574d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:36.960015 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526ab8f-aaa8-4486-b7be-9a51db2ad6f9 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:37.130724 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a526ab8f-aaa8-4486-b7be-9a51db2ad6f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41f32b62a4f64ba69edc44f63a37574d', 'request_id': 'req-a526ab8f-aaa8-4486-b7be-9a51db2ad6f9'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:37.138097 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a526ab8f-aaa8-4486-b7be-9a51db2ad6f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41f32b62a4f64ba69edc44f63a37574d', 'request_id': 'req-a526ab8f-aaa8-4486-b7be-9a51db2ad6f9'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:37.145881 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a526ab8f-aaa8-4486-b7be-9a51db2ad6f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41f32b62a4f64ba69edc44f63a37574d', 'request_id': 'req-a526ab8f-aaa8-4486-b7be-9a51db2ad6f9'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:37.238664 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a526ab8f-aaa8-4486-b7be-9a51db2ad6f9 admin admin] The token cache is being invalidate because project 41f32b62a4f64ba69edc44f63a37574d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:35:37.238911 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a526ab8f-aaa8-4486-b7be-9a51db2ad6f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:37.239569 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a526ab8f-aaa8-4486-b7be-9a51db2ad6f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:35:37.241128 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1362/2763] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:35:36 2022] DELETE /identity/v3/projects/41f32b62a4f64ba69edc44f63a37574d => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:35:46.734439 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=7,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:47.260350 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:49.743193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5493255-95d9-464e-9d7c-5d97adad7b20 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:49.743953 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5493255-95d9-464e-9d7c-5d97adad7b20 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:49.743953 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5493255-95d9-464e-9d7c-5d97adad7b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:49.764722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-e5493255-95d9-464e-9d7c-5d97adad7b20 None None] MFA Rules not processed for user `e343f998e5e34447bd2b5f0a2627bbdf`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:35:49.766026 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-e5493255-95d9-464e-9d7c-5d97adad7b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:49.830184 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1402/2764] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:35:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:35:50.153349 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526ab8f-aaa8-4486-b7be-9a51db2ad6f9 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:35:50.155094 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-a526ab8f-aaa8-4486-b7be-9a51db2ad6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:50.216592 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526ab8f-aaa8-4486-b7be-9a51db2ad6f9 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:35:50.221334 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3d2db-210d-4598-aa85-89abab1f8edf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:35:50.221980 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3d2db-210d-4598-aa85-89abab1f8edf service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:35:50.222260 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3d2db-210d-4598-aa85-89abab1f8edf service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:35:50.222536 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3d2db-210d-4598-aa85-89abab1f8edf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:35:50.224560 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-3ba3d2db-210d-4598-aa85-89abab1f8edf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:35:50.234794 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3d2db-210d-4598-aa85-89abab1f8edf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:35:50.236421 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3d2db-210d-4598-aa85-89abab1f8edf service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:35:50.244727 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1363/2765] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:35:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:35:59.822447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=25 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:00.240989 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=26 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:41.554345 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5493255-95d9-464e-9d7c-5d97adad7b20 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:41.558061 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-e5493255-95d9-464e-9d7c-5d97adad7b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:41.634420 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5493255-95d9-464e-9d7c-5d97adad7b20 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:41.639968 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc6c2e-c008-4cef-b230-e6130e2975f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632071470f7d409ab7b0129d120320c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:41.640582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc6c2e-c008-4cef-b230-e6130e2975f6 service nova] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:41.640862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc6c2e-c008-4cef-b230-e6130e2975f6 service nova] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:41.641136 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc6c2e-c008-4cef-b230-e6130e2975f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:41.643396 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f8cc6c2e-c008-4cef-b230-e6130e2975f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:41.654564 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc6c2e-c008-4cef-b230-e6130e2975f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:41.656162 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc6c2e-c008-4cef-b230-e6130e2975f6 service nova] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:41.666852 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1403/2766] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:47.501612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3d2db-210d-4598-aa85-89abab1f8edf service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:36:47.503091 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-3ba3d2db-210d-4598-aa85-89abab1f8edf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:47.577555 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3d2db-210d-4598-aa85-89abab1f8edf service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:36:47.592241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15504542-0f8a-4d77-94d2-e5466e6ce024 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0f9604ee2e43b4967cbdc779e63e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:36:47.592241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15504542-0f8a-4d77-94d2-e5466e6ce024 service placement] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:36:47.592241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15504542-0f8a-4d77-94d2-e5466e6ce024 service placement] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:36:47.592241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15504542-0f8a-4d77-94d2-e5466e6ce024 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:36:47.592717 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-15504542-0f8a-4d77-94d2-e5466e6ce024 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:36:47.601005 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15504542-0f8a-4d77-94d2-e5466e6ce024 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:36:47.602652 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15504542-0f8a-4d77-94d2-e5466e6ce024 service placement] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:36:47.613368 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1364/2767] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:36:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:36:51.662350 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=34 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:57.608816 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=32 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:06.527326 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc6c2e-c008-4cef-b230-e6130e2975f6 service nova] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:06.537222 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc6c2e-c008-4cef-b230-e6130e2975f6 service nova] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:06.540898 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317884ed-e326-4653-8771-ea3e50c64ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:06.541489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317884ed-e326-4653-8771-ea3e50c64ffa service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:06.541775 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317884ed-e326-4653-8771-ea3e50c64ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:06.542084 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317884ed-e326-4653-8771-ea3e50c64ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:06.543820 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-317884ed-e326-4653-8771-ea3e50c64ffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:06.610710 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317884ed-e326-4653-8771-ea3e50c64ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:06.612738 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317884ed-e326-4653-8771-ea3e50c64ffa service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:06.623108 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1404/2768] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:10.318158 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15504542-0f8a-4d77-94d2-e5466e6ce024 service placement] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:10.319665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-15504542-0f8a-4d77-94d2-e5466e6ce024 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:10.335570 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15504542-0f8a-4d77-94d2-e5466e6ce024 service placement] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:10.340505 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013387b9-2294-4aa6-8215-cfab2bda5a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:10.341156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013387b9-2294-4aa6-8215-cfab2bda5a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:10.341439 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013387b9-2294-4aa6-8215-cfab2bda5a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:10.341751 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013387b9-2294-4aa6-8215-cfab2bda5a11 admin admin] PATH_INFO: `/v3/users/e343f998e5e34447bd2b5f0a2627bbdf` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:10.342946 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013387b9-2294-4aa6-8215-cfab2bda5a11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e343f998e5e34447bd2b5f0a2627bbdf)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:10.345119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013387b9-2294-4aa6-8215-cfab2bda5a11 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:10.583562 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-013387b9-2294-4aa6-8215-cfab2bda5a11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e343f998e5e34447bd2b5f0a2627bbdf'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:10.584390 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-013387b9-2294-4aa6-8215-cfab2bda5a11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e343f998e5e34447bd2b5f0a2627bbdf'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:10.592354 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-013387b9-2294-4aa6-8215-cfab2bda5a11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e343f998e5e34447bd2b5f0a2627bbdf'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:10.608429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-013387b9-2294-4aa6-8215-cfab2bda5a11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e343f998e5e34447bd2b5f0a2627bbdf'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:10.609169 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-013387b9-2294-4aa6-8215-cfab2bda5a11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e343f998e5e34447bd2b5f0a2627bbdf'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:10.687262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1365/2769] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:10 2022] DELETE /identity/v3/users/e343f998e5e34447bd2b5f0a2627bbdf => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:10.996853 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317884ed-e326-4653-8771-ea3e50c64ffa service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:11.008369 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317884ed-e326-4653-8771-ea3e50c64ffa service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:11.073580 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839c25f-dbf0-4333-9a60-98feb680d00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:11.074255 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839c25f-dbf0-4333-9a60-98feb680d00e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:11.074541 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839c25f-dbf0-4333-9a60-98feb680d00e admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:11.074818 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839c25f-dbf0-4333-9a60-98feb680d00e admin admin] PATH_INFO: `/v3/projects/d0e4c1f5dfdb49abb0ca5ca324976acb` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:11.075978 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839c25f-dbf0-4333-9a60-98feb680d00e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0e4c1f5dfdb49abb0ca5ca324976acb)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:11.077935 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839c25f-dbf0-4333-9a60-98feb680d00e admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:11.202760 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6839c25f-dbf0-4333-9a60-98feb680d00e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'request_id': 'req-6839c25f-dbf0-4333-9a60-98feb680d00e'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:11.209839 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6839c25f-dbf0-4333-9a60-98feb680d00e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'request_id': 'req-6839c25f-dbf0-4333-9a60-98feb680d00e'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:11.215798 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6839c25f-dbf0-4333-9a60-98feb680d00e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'request_id': 'req-6839c25f-dbf0-4333-9a60-98feb680d00e'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:11.316668 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6839c25f-dbf0-4333-9a60-98feb680d00e admin admin] The token cache is being invalidate because project d0e4c1f5dfdb49abb0ca5ca324976acb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:11.316883 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6839c25f-dbf0-4333-9a60-98feb680d00e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:11.318092 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6839c25f-dbf0-4333-9a60-98feb680d00e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:11.319728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1405/2770] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:10 2022] DELETE /identity/v3/projects/d0e4c1f5dfdb49abb0ca5ca324976acb => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:11.324701 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3342c5-cd10-4195-90fd-444594e77453 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:11.325402 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3342c5-cd10-4195-90fd-444594e77453 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:11.325402 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3342c5-cd10-4195-90fd-444594e77453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:11.346926 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-6b3342c5-cd10-4195-90fd-444594e77453 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:11.348223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-6b3342c5-cd10-4195-90fd-444594e77453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:11.411102 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1366/2771] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:11.419480 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b241ce-10af-43a4-b93c-a6a28478c46d None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:11.419766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b241ce-10af-43a4-b93c-a6a28478c46d None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:11.420071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b241ce-10af-43a4-b93c-a6a28478c46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:11.440096 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-63b241ce-10af-43a4-b93c-a6a28478c46d None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:11.441302 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-63b241ce-10af-43a4-b93c-a6a28478c46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:11.449994 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1406/2772] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:11.454421 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3342c5-cd10-4195-90fd-444594e77453 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:11.465527 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3342c5-cd10-4195-90fd-444594e77453 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:11.470617 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a461a43-5b31-4979-999b-5b30424c896d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:11.471231 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a461a43-5b31-4979-999b-5b30424c896d admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:11.471516 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a461a43-5b31-4979-999b-5b30424c896d admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:11.471795 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a461a43-5b31-4979-999b-5b30424c896d admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:11.472450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a461a43-5b31-4979-999b-5b30424c896d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:37:11.472760 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a461a43-5b31-4979-999b-5b30424c896d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:11.474625 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a461a43-5b31-4979-999b-5b30424c896d admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:11.486648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1367/2773] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:37:11.491641 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b241ce-10af-43a4-b93c-a6a28478c46d None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:11.500964 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b241ce-10af-43a4-b93c-a6a28478c46d None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:11.506440 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fd886-107d-49ac-a0a5-2e44cd7cffa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:11.507038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fd886-107d-49ac-a0a5-2e44cd7cffa8 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:11.507323 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fd886-107d-49ac-a0a5-2e44cd7cffa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:11.507629 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fd886-107d-49ac-a0a5-2e44cd7cffa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:11.508267 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fd886-107d-49ac-a0a5-2e44cd7cffa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:11.510232 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fd886-107d-49ac-a0a5-2e44cd7cffa8 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:11.527036 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:11.644750 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1407/2774] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:11 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:11.649272 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a461a43-5b31-4979-999b-5b30424c896d admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:11.659777 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a461a43-5b31-4979-999b-5b30424c896d admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:11.725718 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c50ccb-4eea-4db2-9f80-1c42f9f8a568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:11.726372 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c50ccb-4eea-4db2-9f80-1c42f9f8a568 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:11.726656 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c50ccb-4eea-4db2-9f80-1c42f9f8a568 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:11.726962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c50ccb-4eea-4db2-9f80-1c42f9f8a568 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:11.727607 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c50ccb-4eea-4db2-9f80-1c42f9f8a568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:11.729517 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c50ccb-4eea-4db2-9f80-1c42f9f8a568 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:11.737637 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:11.814513 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1368/2775] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:11 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:11.820093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fd886-107d-49ac-a0a5-2e44cd7cffa8 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:11.830752 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fd886-107d-49ac-a0a5-2e44cd7cffa8 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:11.836246 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62653292-0e83-45f3-9087-0e29e6815a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:11.836942 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62653292-0e83-45f3-9087-0e29e6815a74 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:11.837229 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62653292-0e83-45f3-9087-0e29e6815a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:11.837500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62653292-0e83-45f3-9087-0e29e6815a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:11.838186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62653292-0e83-45f3-9087-0e29e6815a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:11.839826 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62653292-0e83-45f3-9087-0e29e6815a74 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:11.851394 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1408/2776] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:11.855857 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c50ccb-4eea-4db2-9f80-1c42f9f8a568 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:11.867186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c50ccb-4eea-4db2-9f80-1c42f9f8a568 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:11.871979 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d6137-48c3-43f4-9c44-2390c44abbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:11.872602 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d6137-48c3-43f4-9c44-2390c44abbd3 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:11.872884 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d6137-48c3-43f4-9c44-2390c44abbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:11.873163 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d6137-48c3-43f4-9c44-2390c44abbd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:11.873847 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d6137-48c3-43f4-9c44-2390c44abbd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:11.875502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d6137-48c3-43f4-9c44-2390c44abbd3 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:11.887409 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1369/2777] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:11.891784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62653292-0e83-45f3-9087-0e29e6815a74 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:11.903073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62653292-0e83-45f3-9087-0e29e6815a74 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:11.910619 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54698e76-f448-4654-a4b0-1e0f0011b5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:11.912205 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54698e76-f448-4654-a4b0-1e0f0011b5e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:11.912646 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54698e76-f448-4654-a4b0-1e0f0011b5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:11.913109 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54698e76-f448-4654-a4b0-1e0f0011b5e8 admin admin] PATH_INFO: `/v3/projects/5d3ab4bda88d45b2be6237447e43d7d6/users/734e8112d66648679bc3cc5f610c4c1c/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:11.929277 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54698e76-f448-4654-a4b0-1e0f0011b5e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d3ab4bda88d45b2be6237447e43d7d6, user_id=734e8112d66648679bc3cc5f610c4c1c, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:11.931979 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54698e76-f448-4654-a4b0-1e0f0011b5e8 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:12.089475 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1409/2778] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:11 2022] PUT /identity/v3/projects/5d3ab4bda88d45b2be6237447e43d7d6/users/734e8112d66648679bc3cc5f610c4c1c/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:12.101232 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571fb70-907c-48fd-aabb-c7935042a161 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:12.101522 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571fb70-907c-48fd-aabb-c7935042a161 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:12.101801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571fb70-907c-48fd-aabb-c7935042a161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:12.131041 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-0571fb70-907c-48fd-aabb-c7935042a161 None None] MFA Rules not processed for user `734e8112d66648679bc3cc5f610c4c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:12.132311 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-0571fb70-907c-48fd-aabb-c7935042a161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:12.198114 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1370/2779] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:37:12.202824 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54698e76-f448-4654-a4b0-1e0f0011b5e8 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:12.267554 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54698e76-f448-4654-a4b0-1e0f0011b5e8 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:12.272897 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3bdac-d8fa-4eb3-b2f0-351bb7896148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:12.273502 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3bdac-d8fa-4eb3-b2f0-351bb7896148 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:12.273787 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3bdac-d8fa-4eb3-b2f0-351bb7896148 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:12.274098 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3bdac-d8fa-4eb3-b2f0-351bb7896148 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:12.274751 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3bdac-d8fa-4eb3-b2f0-351bb7896148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:12.276713 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3bdac-d8fa-4eb3-b2f0-351bb7896148 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:12.382088 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1410/2780] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:12 2022] POST /identity/v3/projects => generated 365 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:12.386241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571fb70-907c-48fd-aabb-c7935042a161 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:12.398391 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571fb70-907c-48fd-aabb-c7935042a161 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:12.458628 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e9dc1-3481-413a-9c04-c430448430a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:12.459159 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e9dc1-3481-413a-9c04-c430448430a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:12.459440 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e9dc1-3481-413a-9c04-c430448430a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:12.459715 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e9dc1-3481-413a-9c04-c430448430a1 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:12.460375 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e9dc1-3481-413a-9c04-c430448430a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:12.462326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e9dc1-3481-413a-9c04-c430448430a1 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:12.603324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1371/2781] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:12 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:37:12.607548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3bdac-d8fa-4eb3-b2f0-351bb7896148 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:12.618148 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3bdac-d8fa-4eb3-b2f0-351bb7896148 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:12.624037 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d87e94-ed66-4fde-a9c6-1a6cbac3bb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:12.624637 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d87e94-ed66-4fde-a9c6-1a6cbac3bb24 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:12.624920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d87e94-ed66-4fde-a9c6-1a6cbac3bb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:12.625280 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d87e94-ed66-4fde-a9c6-1a6cbac3bb24 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:12.625871 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d87e94-ed66-4fde-a9c6-1a6cbac3bb24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:12.627482 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d87e94-ed66-4fde-a9c6-1a6cbac3bb24 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:12.639275 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1411/2782] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:12.649042 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e9dc1-3481-413a-9c04-c430448430a1 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:12.659781 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e9dc1-3481-413a-9c04-c430448430a1 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:12.664944 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdfabf-924e-427d-8a6c-85b23b057014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:12.665612 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdfabf-924e-427d-8a6c-85b23b057014 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:12.665936 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdfabf-924e-427d-8a6c-85b23b057014 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:12.666217 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdfabf-924e-427d-8a6c-85b23b057014 admin admin] PATH_INFO: `/v3/projects/e6f4e8602e584f94bd91061083f64862/users/09dc36e7e2ca4f1cb48948099c076970/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:12.682571 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdfabf-924e-427d-8a6c-85b23b057014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6f4e8602e584f94bd91061083f64862, user_id=09dc36e7e2ca4f1cb48948099c076970, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:12.685250 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdfabf-924e-427d-8a6c-85b23b057014 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:12.757932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1372/2783] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:12 2022] PUT /identity/v3/projects/e6f4e8602e584f94bd91061083f64862/users/09dc36e7e2ca4f1cb48948099c076970/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:12.762101 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d87e94-ed66-4fde-a9c6-1a6cbac3bb24 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:12.773386 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d87e94-ed66-4fde-a9c6-1a6cbac3bb24 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:12.831037 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48abc4-7e08-43c1-9289-6829e6e309b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:12.831647 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48abc4-7e08-43c1-9289-6829e6e309b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:12.831936 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48abc4-7e08-43c1-9289-6829e6e309b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:12.832214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48abc4-7e08-43c1-9289-6829e6e309b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:12.833485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48abc4-7e08-43c1-9289-6829e6e309b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:12.835401 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48abc4-7e08-43c1-9289-6829e6e309b8 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:12.845831 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1412/2784] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:12.850425 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdfabf-924e-427d-8a6c-85b23b057014 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:12.861150 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdfabf-924e-427d-8a6c-85b23b057014 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:12.866435 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8d4af-6609-41a1-b016-57de2002f0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:12.869606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8d4af-6609-41a1-b016-57de2002f0d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:12.869606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8d4af-6609-41a1-b016-57de2002f0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:12.869606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8d4af-6609-41a1-b016-57de2002f0d0 admin admin] PATH_INFO: `/v3/projects/e6f4e8602e584f94bd91061083f64862/users/09dc36e7e2ca4f1cb48948099c076970/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:12.869606 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8d4af-6609-41a1-b016-57de2002f0d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6f4e8602e584f94bd91061083f64862, user_id=09dc36e7e2ca4f1cb48948099c076970, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:12.872305 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8d4af-6609-41a1-b016-57de2002f0d0 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:12.883935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1373/2785] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:12 2022] PUT /identity/v3/projects/e6f4e8602e584f94bd91061083f64862/users/09dc36e7e2ca4f1cb48948099c076970/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:12.896884 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12537d-1207-4cc1-b7fe-aebb4089ba6b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:12.897164 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12537d-1207-4cc1-b7fe-aebb4089ba6b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:12.897439 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12537d-1207-4cc1-b7fe-aebb4089ba6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:12.926026 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-8d12537d-1207-4cc1-b7fe-aebb4089ba6b None None] MFA Rules not processed for user `09dc36e7e2ca4f1cb48948099c076970`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:12.927462 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-8d12537d-1207-4cc1-b7fe-aebb4089ba6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:12.946948 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:13.000878 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1413/2786] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:13.013162 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8d4af-6609-41a1-b016-57de2002f0d0 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:13.014911 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-80e8d4af-6609-41a1-b016-57de2002f0d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:13.037633 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:13.076936 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8d4af-6609-41a1-b016-57de2002f0d0 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:13.080750 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b547d14-404b-42ad-a443-d86371aad478 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:13.081339 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b547d14-404b-42ad-a443-d86371aad478 service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:13.081868 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b547d14-404b-42ad-a443-d86371aad478 service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:13.082328 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b547d14-404b-42ad-a443-d86371aad478 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:13.092303 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b547d14-404b-42ad-a443-d86371aad478 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:13.094070 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b547d14-404b-42ad-a443-d86371aad478 service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:13.104899 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1374/2787] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:13.368080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12537d-1207-4cc1-b7fe-aebb4089ba6b None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:13.377906 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12537d-1207-4cc1-b7fe-aebb4089ba6b None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:13.381726 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e15cf8-1e4d-4725-a41a-7dbe54ab3582 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:13.382369 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e15cf8-1e4d-4725-a41a-7dbe54ab3582 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:13.382653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e15cf8-1e4d-4725-a41a-7dbe54ab3582 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:13.382929 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e15cf8-1e4d-4725-a41a-7dbe54ab3582 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:13.443126 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e15cf8-1e4d-4725-a41a-7dbe54ab3582 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:13.444628 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e15cf8-1e4d-4725-a41a-7dbe54ab3582 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:13.453841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1414/2788] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:17.012025 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b547d14-404b-42ad-a443-d86371aad478 service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:17.090893 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b547d14-404b-42ad-a443-d86371aad478 service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:17.096153 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dad56-8353-49eb-a4be-17e1a7fd1909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:17.096731 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dad56-8353-49eb-a4be-17e1a7fd1909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:17.097113 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dad56-8353-49eb-a4be-17e1a7fd1909 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:17.097282 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dad56-8353-49eb-a4be-17e1a7fd1909 admin admin] PATH_INFO: `/v3/users/734e8112d66648679bc3cc5f610c4c1c` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:17.098527 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dad56-8353-49eb-a4be-17e1a7fd1909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=734e8112d66648679bc3cc5f610c4c1c)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:17.100560 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dad56-8353-49eb-a4be-17e1a7fd1909 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:17.314329 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-319dad56-8353-49eb-a4be-17e1a7fd1909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '734e8112d66648679bc3cc5f610c4c1c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:17.314926 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-319dad56-8353-49eb-a4be-17e1a7fd1909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '734e8112d66648679bc3cc5f610c4c1c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:17.322870 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-319dad56-8353-49eb-a4be-17e1a7fd1909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '734e8112d66648679bc3cc5f610c4c1c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:17.337088 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-319dad56-8353-49eb-a4be-17e1a7fd1909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '734e8112d66648679bc3cc5f610c4c1c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:17.337969 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-319dad56-8353-49eb-a4be-17e1a7fd1909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '734e8112d66648679bc3cc5f610c4c1c'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:17.406829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1375/2789] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:17 2022] DELETE /identity/v3/users/734e8112d66648679bc3cc5f610c4c1c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:17.412226 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80822a1b-1e4b-45c0-b19b-dd2bb5fa7012 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:17.412912 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80822a1b-1e4b-45c0-b19b-dd2bb5fa7012 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:17.412912 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80822a1b-1e4b-45c0-b19b-dd2bb5fa7012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:17.433301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-80822a1b-1e4b-45c0-b19b-dd2bb5fa7012 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:17.434625 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-80822a1b-1e4b-45c0-b19b-dd2bb5fa7012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:17.501376 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1415/2790] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:37:17.511984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dad56-8353-49eb-a4be-17e1a7fd1909 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:17.513418 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-319dad56-8353-49eb-a4be-17e1a7fd1909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:17.563299 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:17.578511 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dad56-8353-49eb-a4be-17e1a7fd1909 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:17.579451 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda7061-c525-4d35-8c3c-1908f498b7c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:17.580099 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda7061-c525-4d35-8c3c-1908f498b7c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:17.580387 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda7061-c525-4d35-8c3c-1908f498b7c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:17.580664 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda7061-c525-4d35-8c3c-1908f498b7c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:17.590496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda7061-c525-4d35-8c3c-1908f498b7c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:17.591922 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda7061-c525-4d35-8c3c-1908f498b7c5 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:17.602399 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1376/2791] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:18.020895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80822a1b-1e4b-45c0-b19b-dd2bb5fa7012 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:18.028140 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-80822a1b-1e4b-45c0-b19b-dd2bb5fa7012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:18.038518 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80822a1b-1e4b-45c0-b19b-dd2bb5fa7012 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:18.053530 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d9f56-8c62-4419-a315-32d4022a6f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:18.054406 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d9f56-8c62-4419-a315-32d4022a6f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:18.054814 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d9f56-8c62-4419-a315-32d4022a6f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:18.055098 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d9f56-8c62-4419-a315-32d4022a6f63 admin admin] PATH_INFO: `/v3/projects/5d3ab4bda88d45b2be6237447e43d7d6` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:18.056415 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d9f56-8c62-4419-a315-32d4022a6f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d3ab4bda88d45b2be6237447e43d7d6)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:18.058457 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d9f56-8c62-4419-a315-32d4022a6f63 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:18.222005 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-739d9f56-8c62-4419-a315-32d4022a6f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d3ab4bda88d45b2be6237447e43d7d6', 'request_id': 'req-739d9f56-8c62-4419-a315-32d4022a6f63'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:18.224214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:18.231020 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-739d9f56-8c62-4419-a315-32d4022a6f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d3ab4bda88d45b2be6237447e43d7d6', 'request_id': 'req-739d9f56-8c62-4419-a315-32d4022a6f63'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:18.237192 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-739d9f56-8c62-4419-a315-32d4022a6f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d3ab4bda88d45b2be6237447e43d7d6', 'request_id': 'req-739d9f56-8c62-4419-a315-32d4022a6f63'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:18.354473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-739d9f56-8c62-4419-a315-32d4022a6f63 admin admin] The token cache is being invalidate because project 5d3ab4bda88d45b2be6237447e43d7d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:18.354770 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-739d9f56-8c62-4419-a315-32d4022a6f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:18.356626 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-739d9f56-8c62-4419-a315-32d4022a6f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:18.357875 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1416/2792] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:18 2022] DELETE /identity/v3/projects/5d3ab4bda88d45b2be6237447e43d7d6 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:18.362543 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda7061-c525-4d35-8c3c-1908f498b7c5 service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:18.375382 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda7061-c525-4d35-8c3c-1908f498b7c5 service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:18.440401 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cce34-50f9-4360-a20e-145061897266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:18.441051 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cce34-50f9-4360-a20e-145061897266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:18.441337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cce34-50f9-4360-a20e-145061897266 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:18.441709 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cce34-50f9-4360-a20e-145061897266 admin admin] PATH_INFO: `/v3/users/09dc36e7e2ca4f1cb48948099c076970` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:18.443105 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cce34-50f9-4360-a20e-145061897266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09dc36e7e2ca4f1cb48948099c076970)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:18.444975 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cce34-50f9-4360-a20e-145061897266 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:18.621131 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-414cce34-50f9-4360-a20e-145061897266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09dc36e7e2ca4f1cb48948099c076970'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:18.622157 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-414cce34-50f9-4360-a20e-145061897266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09dc36e7e2ca4f1cb48948099c076970'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:18.632148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-414cce34-50f9-4360-a20e-145061897266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09dc36e7e2ca4f1cb48948099c076970'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:18.646532 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-414cce34-50f9-4360-a20e-145061897266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09dc36e7e2ca4f1cb48948099c076970'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:18.647326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-414cce34-50f9-4360-a20e-145061897266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09dc36e7e2ca4f1cb48948099c076970'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:18.717938 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1377/2793] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:18 2022] DELETE /identity/v3/users/09dc36e7e2ca4f1cb48948099c076970 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:19.337179 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d9f56-8c62-4419-a315-32d4022a6f63 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:19.338700 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-739d9f56-8c62-4419-a315-32d4022a6f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:19.358151 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d9f56-8c62-4419-a315-32d4022a6f63 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:19.425312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72885a-8661-47ad-9acb-798579e634aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:19.426561 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72885a-8661-47ad-9acb-798579e634aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:19.426876 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72885a-8661-47ad-9acb-798579e634aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:19.427124 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72885a-8661-47ad-9acb-798579e634aa admin admin] PATH_INFO: `/v3/projects/e6f4e8602e584f94bd91061083f64862` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:19.428519 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72885a-8661-47ad-9acb-798579e634aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6f4e8602e584f94bd91061083f64862)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:19.430486 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72885a-8661-47ad-9acb-798579e634aa admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:19.556581 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9f72885a-8661-47ad-9acb-798579e634aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6f4e8602e584f94bd91061083f64862', 'request_id': 'req-9f72885a-8661-47ad-9acb-798579e634aa'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:19.563085 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9f72885a-8661-47ad-9acb-798579e634aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6f4e8602e584f94bd91061083f64862', 'request_id': 'req-9f72885a-8661-47ad-9acb-798579e634aa'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:19.569362 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9f72885a-8661-47ad-9acb-798579e634aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6f4e8602e584f94bd91061083f64862', 'request_id': 'req-9f72885a-8661-47ad-9acb-798579e634aa'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:19.646412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9f72885a-8661-47ad-9acb-798579e634aa admin admin] The token cache is being invalidate because project e6f4e8602e584f94bd91061083f64862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:19.646649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9f72885a-8661-47ad-9acb-798579e634aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:19.647260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9f72885a-8661-47ad-9acb-798579e634aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:19.648873 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1417/2794] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:19 2022] DELETE /identity/v3/projects/e6f4e8602e584f94bd91061083f64862 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:19.653979 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d75118-2d0e-4acd-a19c-dd238c3fa37e None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:19.654533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d75118-2d0e-4acd-a19c-dd238c3fa37e None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:19.654533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d75118-2d0e-4acd-a19c-dd238c3fa37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:19.682581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-93d75118-2d0e-4acd-a19c-dd238c3fa37e None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:19.684282 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-93d75118-2d0e-4acd-a19c-dd238c3fa37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:19.759640 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1378/2795] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:19.767495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fca601-a8e4-4e98-933a-d56b46b3cb0b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:19.767808 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fca601-a8e4-4e98-933a-d56b46b3cb0b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:19.768076 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fca601-a8e4-4e98-933a-d56b46b3cb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:19.789914 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-67fca601-a8e4-4e98-933a-d56b46b3cb0b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:19.791131 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-67fca601-a8e4-4e98-933a-d56b46b3cb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:19.800029 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1418/2796] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:19.804435 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d75118-2d0e-4acd-a19c-dd238c3fa37e None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:19.811676 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:19.816408 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d75118-2d0e-4acd-a19c-dd238c3fa37e None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:19.821571 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067333e3-6672-4f91-ad33-384b99dce3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:19.822181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067333e3-6672-4f91-ad33-384b99dce3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:19.827154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067333e3-6672-4f91-ad33-384b99dce3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:19.827154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067333e3-6672-4f91-ad33-384b99dce3b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:19.827154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067333e3-6672-4f91-ad33-384b99dce3b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:37:19.827154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067333e3-6672-4f91-ad33-384b99dce3b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:19.827154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067333e3-6672-4f91-ad33-384b99dce3b4 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:19.839416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1379/2797] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 02 21:37:19.845388 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fca601-a8e4-4e98-933a-d56b46b3cb0b None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:19.856286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fca601-a8e4-4e98-933a-d56b46b3cb0b None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:19.860993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb76d7-4a10-444e-9b8d-020da04c9a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:19.861591 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb76d7-4a10-444e-9b8d-020da04c9a52 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:19.861912 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb76d7-4a10-444e-9b8d-020da04c9a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:19.862187 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb76d7-4a10-444e-9b8d-020da04c9a52 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:19.862813 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb76d7-4a10-444e-9b8d-020da04c9a52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:19.864751 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb76d7-4a10-444e-9b8d-020da04c9a52 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:19.998789 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1419/2798] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:19 2022] POST /identity/v3/projects => generated 369 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:37:20.003048 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067333e3-6672-4f91-ad33-384b99dce3b4 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:20.014010 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067333e3-6672-4f91-ad33-384b99dce3b4 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:20.092257 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1796c1f-b4ac-4bfd-97f3-2047b0e9975e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:20.093119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1796c1f-b4ac-4bfd-97f3-2047b0e9975e admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:20.093879 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1796c1f-b4ac-4bfd-97f3-2047b0e9975e admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:20.093879 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1796c1f-b4ac-4bfd-97f3-2047b0e9975e admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:20.094314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1796c1f-b4ac-4bfd-97f3-2047b0e9975e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:20.096315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1796c1f-b4ac-4bfd-97f3-2047b0e9975e admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:20.196296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1380/2799] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:20 2022] POST /identity/v3/users => generated 285 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:20.201005 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb76d7-4a10-444e-9b8d-020da04c9a52 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:20.212780 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb76d7-4a10-444e-9b8d-020da04c9a52 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:20.217933 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846174d-2826-41c1-bb2f-3d78d5bffef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:20.218594 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846174d-2826-41c1-bb2f-3d78d5bffef2 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:20.218900 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846174d-2826-41c1-bb2f-3d78d5bffef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:20.219175 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846174d-2826-41c1-bb2f-3d78d5bffef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:20.219819 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846174d-2826-41c1-bb2f-3d78d5bffef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:20.221428 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846174d-2826-41c1-bb2f-3d78d5bffef2 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:20.232673 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1420/2800] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:37:20.237254 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1796c1f-b4ac-4bfd-97f3-2047b0e9975e admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:20.248381 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1796c1f-b4ac-4bfd-97f3-2047b0e9975e admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:20.253194 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a2f82-9449-4dcf-9e2d-bbe314e47ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:20.253761 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a2f82-9449-4dcf-9e2d-bbe314e47ccc admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:20.254804 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a2f82-9449-4dcf-9e2d-bbe314e47ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:20.255093 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a2f82-9449-4dcf-9e2d-bbe314e47ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:20.255749 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a2f82-9449-4dcf-9e2d-bbe314e47ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:20.257359 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a2f82-9449-4dcf-9e2d-bbe314e47ccc admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:20.268515 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1381/2801] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:20.273723 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846174d-2826-41c1-bb2f-3d78d5bffef2 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:20.284349 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846174d-2826-41c1-bb2f-3d78d5bffef2 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:20.289392 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30ff0f-9647-47d0-bf39-3dd201528e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:20.290069 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30ff0f-9647-47d0-bf39-3dd201528e9f admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:20.290350 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30ff0f-9647-47d0-bf39-3dd201528e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:20.290627 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30ff0f-9647-47d0-bf39-3dd201528e9f admin admin] PATH_INFO: `/v3/projects/da604f854cdb4f489c6dd4e4bc427b1e/users/1876d00943e3406d827eebbb09c08445/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:20.306258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30ff0f-9647-47d0-bf39-3dd201528e9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=da604f854cdb4f489c6dd4e4bc427b1e, user_id=1876d00943e3406d827eebbb09c08445, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:20.308907 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30ff0f-9647-47d0-bf39-3dd201528e9f admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:20.425678 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1421/2802] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:20 2022] PUT /identity/v3/projects/da604f854cdb4f489c6dd4e4bc427b1e/users/1876d00943e3406d827eebbb09c08445/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:20.438973 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906bffa-4500-4929-ab2f-1ef1b4229dfa None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:20.439562 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906bffa-4500-4929-ab2f-1ef1b4229dfa None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:20.439562 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906bffa-4500-4929-ab2f-1ef1b4229dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:20.480461 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-e906bffa-4500-4929-ab2f-1ef1b4229dfa None None] MFA Rules not processed for user `1876d00943e3406d827eebbb09c08445`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:20.481718 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e906bffa-4500-4929-ab2f-1ef1b4229dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:20.565419 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1382/2803] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:37:20.571560 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30ff0f-9647-47d0-bf39-3dd201528e9f admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:20.578031 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:20.644311 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30ff0f-9647-47d0-bf39-3dd201528e9f admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:20.649689 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c22b54-91df-4376-b695-c4bdcaf5c0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:20.650356 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c22b54-91df-4376-b695-c4bdcaf5c0cf admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:20.650651 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c22b54-91df-4376-b695-c4bdcaf5c0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:20.651223 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c22b54-91df-4376-b695-c4bdcaf5c0cf admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:20.652076 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c22b54-91df-4376-b695-c4bdcaf5c0cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:20.654553 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c22b54-91df-4376-b695-c4bdcaf5c0cf admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:20.798541 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1422/2804] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:20 2022] POST /identity/v3/projects => generated 369 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:20.804052 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906bffa-4500-4929-ab2f-1ef1b4229dfa None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:20.817452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906bffa-4500-4929-ab2f-1ef1b4229dfa None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:20.878688 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca2246-ccfc-4a4e-9116-9d549cb1b554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:20.879533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca2246-ccfc-4a4e-9116-9d549cb1b554 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:20.879951 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca2246-ccfc-4a4e-9116-9d549cb1b554 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:20.880238 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca2246-ccfc-4a4e-9116-9d549cb1b554 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:20.880879 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca2246-ccfc-4a4e-9116-9d549cb1b554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:20.882830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca2246-ccfc-4a4e-9116-9d549cb1b554 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:20.891358 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:20.969164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1383/2805] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:20 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:20.974385 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c22b54-91df-4376-b695-c4bdcaf5c0cf admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:20.985752 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c22b54-91df-4376-b695-c4bdcaf5c0cf admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:20.994481 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06051b-062d-4f67-a2c2-c31ff693303e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:20.995464 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06051b-062d-4f67-a2c2-c31ff693303e admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:20.996720 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06051b-062d-4f67-a2c2-c31ff693303e admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:20.997080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06051b-062d-4f67-a2c2-c31ff693303e admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:20.997795 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06051b-062d-4f67-a2c2-c31ff693303e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:21.002630 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06051b-062d-4f67-a2c2-c31ff693303e admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:21.016370 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1423/2806] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:37:21.022378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca2246-ccfc-4a4e-9116-9d549cb1b554 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:21.032964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca2246-ccfc-4a4e-9116-9d549cb1b554 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:21.038665 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f9a5a-c99d-4d4b-b4b1-d6bd2d373192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:21.039298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f9a5a-c99d-4d4b-b4b1-d6bd2d373192 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:21.039574 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f9a5a-c99d-4d4b-b4b1-d6bd2d373192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:21.039852 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f9a5a-c99d-4d4b-b4b1-d6bd2d373192 admin admin] PATH_INFO: `/v3/projects/e1ddcbc5017f4935bf8cf594f5ffa1b2/users/0c2517664c1d4e9ca6cf8844cf14c8dd/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:21.057328 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f9a5a-c99d-4d4b-b4b1-d6bd2d373192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ddcbc5017f4935bf8cf594f5ffa1b2, user_id=0c2517664c1d4e9ca6cf8844cf14c8dd, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:21.060603 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f9a5a-c99d-4d4b-b4b1-d6bd2d373192 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:21.199435 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1384/2807] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:21 2022] PUT /identity/v3/projects/e1ddcbc5017f4935bf8cf594f5ffa1b2/users/0c2517664c1d4e9ca6cf8844cf14c8dd/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:37:21.204103 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06051b-062d-4f67-a2c2-c31ff693303e admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:21.215388 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06051b-062d-4f67-a2c2-c31ff693303e admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:21.286615 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb28534-f6d5-4582-80bf-c00c070ac0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:21.287271 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb28534-f6d5-4582-80bf-c00c070ac0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:21.287558 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb28534-f6d5-4582-80bf-c00c070ac0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:21.287836 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb28534-f6d5-4582-80bf-c00c070ac0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:21.288841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb28534-f6d5-4582-80bf-c00c070ac0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:21.290744 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb28534-f6d5-4582-80bf-c00c070ac0b2 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:21.302863 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1424/2808] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:21.308573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f9a5a-c99d-4d4b-b4b1-d6bd2d373192 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:21.323535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f9a5a-c99d-4d4b-b4b1-d6bd2d373192 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:21.328971 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240d39a-c6d5-4484-b35f-ec9995e2da51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:21.329659 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240d39a-c6d5-4484-b35f-ec9995e2da51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:21.329981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240d39a-c6d5-4484-b35f-ec9995e2da51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:21.330259 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240d39a-c6d5-4484-b35f-ec9995e2da51 admin admin] PATH_INFO: `/v3/projects/e1ddcbc5017f4935bf8cf594f5ffa1b2/users/0c2517664c1d4e9ca6cf8844cf14c8dd/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:21.332753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240d39a-c6d5-4484-b35f-ec9995e2da51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ddcbc5017f4935bf8cf594f5ffa1b2, user_id=0c2517664c1d4e9ca6cf8844cf14c8dd, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:21.335419 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240d39a-c6d5-4484-b35f-ec9995e2da51 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:21.359006 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1385/2809] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:21 2022] PUT /identity/v3/projects/e1ddcbc5017f4935bf8cf594f5ffa1b2/users/0c2517664c1d4e9ca6cf8844cf14c8dd/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:21.369936 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f15806-307e-4e15-8f61-616f54f3edb0 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:21.370260 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f15806-307e-4e15-8f61-616f54f3edb0 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:21.370653 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f15806-307e-4e15-8f61-616f54f3edb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:21.405888 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-f3f15806-307e-4e15-8f61-616f54f3edb0 None None] MFA Rules not processed for user `0c2517664c1d4e9ca6cf8844cf14c8dd`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:21.407738 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f3f15806-307e-4e15-8f61-616f54f3edb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:21.500186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:21.504410 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1425/2810] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:21.519089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240d39a-c6d5-4484-b35f-ec9995e2da51 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:21.521663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-f240d39a-c6d5-4484-b35f-ec9995e2da51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:21.604742 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240d39a-c6d5-4484-b35f-ec9995e2da51 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:21.611406 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59f944-a110-40e7-ae4f-17a0149a3476 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:21.612892 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59f944-a110-40e7-ae4f-17a0149a3476 service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:21.613638 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59f944-a110-40e7-ae4f-17a0149a3476 service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:21.613638 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59f944-a110-40e7-ae4f-17a0149a3476 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:21.623676 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59f944-a110-40e7-ae4f-17a0149a3476 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:21.625679 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59f944-a110-40e7-ae4f-17a0149a3476 service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:21.639914 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1386/2811] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:25.592822 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f15806-307e-4e15-8f61-616f54f3edb0 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:25.660248 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f15806-307e-4e15-8f61-616f54f3edb0 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:25.665411 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686f684-7380-4865-830c-c8a2a969ba1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:25.666078 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686f684-7380-4865-830c-c8a2a969ba1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:25.666360 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686f684-7380-4865-830c-c8a2a969ba1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:25.666634 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686f684-7380-4865-830c-c8a2a969ba1f admin admin] PATH_INFO: `/v3/users/1876d00943e3406d827eebbb09c08445` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:25.667765 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686f684-7380-4865-830c-c8a2a969ba1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1876d00943e3406d827eebbb09c08445)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:25.669853 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686f684-7380-4865-830c-c8a2a969ba1f admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:25.902537 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-d686f684-7380-4865-830c-c8a2a969ba1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1876d00943e3406d827eebbb09c08445'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:25.903403 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-d686f684-7380-4865-830c-c8a2a969ba1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1876d00943e3406d827eebbb09c08445'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:25.916631 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-d686f684-7380-4865-830c-c8a2a969ba1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1876d00943e3406d827eebbb09c08445'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:25.924097 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-d686f684-7380-4865-830c-c8a2a969ba1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1876d00943e3406d827eebbb09c08445'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:25.924745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-d686f684-7380-4865-830c-c8a2a969ba1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1876d00943e3406d827eebbb09c08445'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:26.018250 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1426/2812] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:25 2022] DELETE /identity/v3/users/1876d00943e3406d827eebbb09c08445 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:26.023265 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259a003-65d6-4ef1-8eee-be046c9821b6 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:26.023777 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259a003-65d6-4ef1-8eee-be046c9821b6 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:26.023939 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259a003-65d6-4ef1-8eee-be046c9821b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:26.043314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-0259a003-65d6-4ef1-8eee-be046c9821b6 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:26.044533 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-0259a003-65d6-4ef1-8eee-be046c9821b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:26.107980 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1387/2813] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:26.118744 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686f684-7380-4865-830c-c8a2a969ba1f admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:26.120186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-d686f684-7380-4865-830c-c8a2a969ba1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:26.180046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686f684-7380-4865-830c-c8a2a969ba1f admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:26.183620 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a77879-995e-496b-9060-808dd91aa072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:26.184230 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a77879-995e-496b-9060-808dd91aa072 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:26.184512 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a77879-995e-496b-9060-808dd91aa072 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:26.184795 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a77879-995e-496b-9060-808dd91aa072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:26.195171 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a77879-995e-496b-9060-808dd91aa072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:26.196617 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a77879-995e-496b-9060-808dd91aa072 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:26.207053 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1427/2814] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:26.642431 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259a003-65d6-4ef1-8eee-be046c9821b6 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:26.644106 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-0259a003-65d6-4ef1-8eee-be046c9821b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:26.662624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259a003-65d6-4ef1-8eee-be046c9821b6 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:26.669864 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a460fa-b558-4ea2-bf16-bf1c10682166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:26.671209 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a460fa-b558-4ea2-bf16-bf1c10682166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:26.671573 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a460fa-b558-4ea2-bf16-bf1c10682166 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:26.671903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a460fa-b558-4ea2-bf16-bf1c10682166 admin admin] PATH_INFO: `/v3/projects/da604f854cdb4f489c6dd4e4bc427b1e` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:26.673891 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a460fa-b558-4ea2-bf16-bf1c10682166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da604f854cdb4f489c6dd4e4bc427b1e)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:26.677668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a460fa-b558-4ea2-bf16-bf1c10682166 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:26.803154 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-c2a460fa-b558-4ea2-bf16-bf1c10682166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da604f854cdb4f489c6dd4e4bc427b1e', 'request_id': 'req-c2a460fa-b558-4ea2-bf16-bf1c10682166'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:26.804406 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:26.810853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-c2a460fa-b558-4ea2-bf16-bf1c10682166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da604f854cdb4f489c6dd4e4bc427b1e', 'request_id': 'req-c2a460fa-b558-4ea2-bf16-bf1c10682166'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:26.816790 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-c2a460fa-b558-4ea2-bf16-bf1c10682166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da604f854cdb4f489c6dd4e4bc427b1e', 'request_id': 'req-c2a460fa-b558-4ea2-bf16-bf1c10682166'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:26.942740 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-c2a460fa-b558-4ea2-bf16-bf1c10682166 admin admin] The token cache is being invalidate because project da604f854cdb4f489c6dd4e4bc427b1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:26.942978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-c2a460fa-b558-4ea2-bf16-bf1c10682166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:26.943599 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-c2a460fa-b558-4ea2-bf16-bf1c10682166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:26.945783 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1388/2815] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:26 2022] DELETE /identity/v3/projects/da604f854cdb4f489c6dd4e4bc427b1e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:26.950197 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a77879-995e-496b-9060-808dd91aa072 service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:26.960674 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a77879-995e-496b-9060-808dd91aa072 service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:26.980200 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:27.019568 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bd94a-8dd2-4545-b5b1-ddd9ee94946d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:27.020203 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bd94a-8dd2-4545-b5b1-ddd9ee94946d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:27.020488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bd94a-8dd2-4545-b5b1-ddd9ee94946d admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:27.020766 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bd94a-8dd2-4545-b5b1-ddd9ee94946d admin admin] PATH_INFO: `/v3/users/0c2517664c1d4e9ca6cf8844cf14c8dd` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:27.021998 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bd94a-8dd2-4545-b5b1-ddd9ee94946d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c2517664c1d4e9ca6cf8844cf14c8dd)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:27.024548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bd94a-8dd2-4545-b5b1-ddd9ee94946d admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:27.227388 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9d8bd94a-8dd2-4545-b5b1-ddd9ee94946d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c2517664c1d4e9ca6cf8844cf14c8dd'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:27.227997 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9d8bd94a-8dd2-4545-b5b1-ddd9ee94946d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c2517664c1d4e9ca6cf8844cf14c8dd'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:27.240073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9d8bd94a-8dd2-4545-b5b1-ddd9ee94946d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c2517664c1d4e9ca6cf8844cf14c8dd'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:27.248220 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9d8bd94a-8dd2-4545-b5b1-ddd9ee94946d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c2517664c1d4e9ca6cf8844cf14c8dd'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:27.248931 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-9d8bd94a-8dd2-4545-b5b1-ddd9ee94946d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c2517664c1d4e9ca6cf8844cf14c8dd'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:27.357126 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1428/2816] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:26 2022] DELETE /identity/v3/users/0c2517664c1d4e9ca6cf8844cf14c8dd => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:27.866722 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a460fa-b558-4ea2-bf16-bf1c10682166 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:27.868313 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-c2a460fa-b558-4ea2-bf16-bf1c10682166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:27.886239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a460fa-b558-4ea2-bf16-bf1c10682166 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:27.952837 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c42cc3-75d5-4939-bad9-6e3262b03d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:27.953489 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c42cc3-75d5-4939-bad9-6e3262b03d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:27.953773 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c42cc3-75d5-4939-bad9-6e3262b03d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:27.954105 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c42cc3-75d5-4939-bad9-6e3262b03d78 admin admin] PATH_INFO: `/v3/projects/e1ddcbc5017f4935bf8cf594f5ffa1b2` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:27.955243 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c42cc3-75d5-4939-bad9-6e3262b03d78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1ddcbc5017f4935bf8cf594f5ffa1b2)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:27.957480 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c42cc3-75d5-4939-bad9-6e3262b03d78 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:28.298471 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-40c42cc3-75d5-4939-bad9-6e3262b03d78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1ddcbc5017f4935bf8cf594f5ffa1b2', 'request_id': 'req-40c42cc3-75d5-4939-bad9-6e3262b03d78'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:28.304808 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-40c42cc3-75d5-4939-bad9-6e3262b03d78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1ddcbc5017f4935bf8cf594f5ffa1b2', 'request_id': 'req-40c42cc3-75d5-4939-bad9-6e3262b03d78'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:28.311156 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-40c42cc3-75d5-4939-bad9-6e3262b03d78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1ddcbc5017f4935bf8cf594f5ffa1b2', 'request_id': 'req-40c42cc3-75d5-4939-bad9-6e3262b03d78'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:28.464730 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-40c42cc3-75d5-4939-bad9-6e3262b03d78 admin admin] The token cache is being invalidate because project e1ddcbc5017f4935bf8cf594f5ffa1b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:28.465005 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-40c42cc3-75d5-4939-bad9-6e3262b03d78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:28.465666 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-40c42cc3-75d5-4939-bad9-6e3262b03d78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:28.467501 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1389/2817] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:27 2022] DELETE /identity/v3/projects/e1ddcbc5017f4935bf8cf594f5ffa1b2 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:28.472427 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc94b6-ddd2-4c24-b939-8e097fd2ee11 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:28.472932 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc94b6-ddd2-4c24-b939-8e097fd2ee11 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:28.473043 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc94b6-ddd2-4c24-b939-8e097fd2ee11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:28.502088 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-69dc94b6-ddd2-4c24-b939-8e097fd2ee11 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:28.502088 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-69dc94b6-ddd2-4c24-b939-8e097fd2ee11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:28.556714 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1429/2818] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:28.564729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e7b1b-4da0-40ff-8971-7a047b36ec86 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:28.565020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e7b1b-4da0-40ff-8971-7a047b36ec86 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:28.565302 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e7b1b-4da0-40ff-8971-7a047b36ec86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:28.587357 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-a65e7b1b-4da0-40ff-8971-7a047b36ec86 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:28.588754 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-a65e7b1b-4da0-40ff-8971-7a047b36ec86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:28.597005 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1390/2819] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:28.601761 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc94b6-ddd2-4c24-b939-8e097fd2ee11 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:28.611947 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc94b6-ddd2-4c24-b939-8e097fd2ee11 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:28.616606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b328fd-1565-4860-b22e-53fb2c978918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:28.618154 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b328fd-1565-4860-b22e-53fb2c978918 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:28.618566 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b328fd-1565-4860-b22e-53fb2c978918 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:28.618844 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b328fd-1565-4860-b22e-53fb2c978918 admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:28.619494 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b328fd-1565-4860-b22e-53fb2c978918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:37:28.619896 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b328fd-1565-4860-b22e-53fb2c978918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:28.621404 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b328fd-1565-4860-b22e-53fb2c978918 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:28.634466 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1430/2820] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:37:28.639043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e7b1b-4da0-40ff-8971-7a047b36ec86 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:28.648670 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e7b1b-4da0-40ff-8971-7a047b36ec86 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:28.653596 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ec610-0657-47b8-8265-4e77296c2e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:28.654246 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ec610-0657-47b8-8265-4e77296c2e74 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:28.654523 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ec610-0657-47b8-8265-4e77296c2e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:28.654799 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ec610-0657-47b8-8265-4e77296c2e74 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:28.655470 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ec610-0657-47b8-8265-4e77296c2e74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:28.657383 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ec610-0657-47b8-8265-4e77296c2e74 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:28.773333 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1391/2821] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:28 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:28.778001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b328fd-1565-4860-b22e-53fb2c978918 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:28.788555 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b328fd-1565-4860-b22e-53fb2c978918 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:28.817071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:28.850194 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a03659-900d-43b5-b57a-9182750c256c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:28.850800 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a03659-900d-43b5-b57a-9182750c256c admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:28.851178 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a03659-900d-43b5-b57a-9182750c256c admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:28.851485 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a03659-900d-43b5-b57a-9182750c256c admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:28.852470 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a03659-900d-43b5-b57a-9182750c256c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:28.854498 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a03659-900d-43b5-b57a-9182750c256c admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:29.042563 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1431/2822] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:28 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:29.046686 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ec610-0657-47b8-8265-4e77296c2e74 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:29.058068 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ec610-0657-47b8-8265-4e77296c2e74 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:29.063212 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b6cff-0bdf-4850-8016-563bf5c6a415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:29.063828 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b6cff-0bdf-4850-8016-563bf5c6a415 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:29.064112 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b6cff-0bdf-4850-8016-563bf5c6a415 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:29.064390 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b6cff-0bdf-4850-8016-563bf5c6a415 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:29.065047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b6cff-0bdf-4850-8016-563bf5c6a415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:29.066793 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b6cff-0bdf-4850-8016-563bf5c6a415 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:29.078268 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1392/2823] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:29.082546 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a03659-900d-43b5-b57a-9182750c256c admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:29.094177 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a03659-900d-43b5-b57a-9182750c256c admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:29.099717 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98799225-f274-4ad4-bb80-accfad1521c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:29.100337 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98799225-f274-4ad4-bb80-accfad1521c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:29.100624 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98799225-f274-4ad4-bb80-accfad1521c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:29.100902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98799225-f274-4ad4-bb80-accfad1521c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:29.101662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98799225-f274-4ad4-bb80-accfad1521c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:29.103378 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98799225-f274-4ad4-bb80-accfad1521c5 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:29.117199 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1432/2824] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:29.119135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b6cff-0bdf-4850-8016-563bf5c6a415 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:29.130058 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b6cff-0bdf-4850-8016-563bf5c6a415 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:29.135540 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbc3d1-207e-4c16-8e21-962ce72eac1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:29.136204 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbc3d1-207e-4c16-8e21-962ce72eac1e admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:29.136483 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbc3d1-207e-4c16-8e21-962ce72eac1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:29.136762 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbc3d1-207e-4c16-8e21-962ce72eac1e admin admin] PATH_INFO: `/v3/projects/89d2d5782b9f4d8780af707a309a55c3/users/a57294ccdc2048e49c34c56cca0cbc44/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:29.153731 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbc3d1-207e-4c16-8e21-962ce72eac1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d2d5782b9f4d8780af707a309a55c3, user_id=a57294ccdc2048e49c34c56cca0cbc44, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:29.156450 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbc3d1-207e-4c16-8e21-962ce72eac1e admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:29.236919 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1393/2825] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:29 2022] PUT /identity/v3/projects/89d2d5782b9f4d8780af707a309a55c3/users/a57294ccdc2048e49c34c56cca0cbc44/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:29.303667 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b4700-362e-454e-aedf-2232a66e3a72 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:29.303892 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b4700-362e-454e-aedf-2232a66e3a72 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:29.304144 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b4700-362e-454e-aedf-2232a66e3a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:29.335951 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-622b4700-362e-454e-aedf-2232a66e3a72 None None] MFA Rules not processed for user `a57294ccdc2048e49c34c56cca0cbc44`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:29.337868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-622b4700-362e-454e-aedf-2232a66e3a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:29.408312 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1433/2826] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:29.412924 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbc3d1-207e-4c16-8e21-962ce72eac1e admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:29.419221 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:29.480528 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbc3d1-207e-4c16-8e21-962ce72eac1e admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:29.485426 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28035e0-e2cb-4220-9b62-0d2700e16702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:29.486081 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28035e0-e2cb-4220-9b62-0d2700e16702 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:29.486367 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28035e0-e2cb-4220-9b62-0d2700e16702 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:29.486648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28035e0-e2cb-4220-9b62-0d2700e16702 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:29.487314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28035e0-e2cb-4220-9b62-0d2700e16702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:29.489229 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28035e0-e2cb-4220-9b62-0d2700e16702 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:29.670835 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1394/2827] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:29 2022] POST /identity/v3/projects => generated 387 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:29.675025 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b4700-362e-454e-aedf-2232a66e3a72 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:29.687089 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b4700-362e-454e-aedf-2232a66e3a72 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:29.748979 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a45e0-bfae-4617-b116-f49f3bbab350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:29.749602 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a45e0-bfae-4617-b116-f49f3bbab350 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:29.749911 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a45e0-bfae-4617-b116-f49f3bbab350 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:29.750186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a45e0-bfae-4617-b116-f49f3bbab350 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:29.750835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a45e0-bfae-4617-b116-f49f3bbab350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:29.752774 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a45e0-bfae-4617-b116-f49f3bbab350 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:29.842549 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1434/2828] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:29 2022] POST /identity/v3/users => generated 300 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:29.846814 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28035e0-e2cb-4220-9b62-0d2700e16702 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:29.858813 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28035e0-e2cb-4220-9b62-0d2700e16702 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:29.863611 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77219f0d-e96a-4ab7-86ae-fc0a9552b4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:29.864223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77219f0d-e96a-4ab7-86ae-fc0a9552b4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:29.864505 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77219f0d-e96a-4ab7-86ae-fc0a9552b4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:29.864784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77219f0d-e96a-4ab7-86ae-fc0a9552b4a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:29.865437 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77219f0d-e96a-4ab7-86ae-fc0a9552b4a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:29.867700 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77219f0d-e96a-4ab7-86ae-fc0a9552b4a0 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:29.878953 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1395/2829] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:29.893184 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a45e0-bfae-4617-b116-f49f3bbab350 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:29.904327 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a45e0-bfae-4617-b116-f49f3bbab350 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:29.909289 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904e71b-aba0-402b-b348-66f629e8dacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:29.909997 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904e71b-aba0-402b-b348-66f629e8dacf admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:29.910286 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904e71b-aba0-402b-b348-66f629e8dacf admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:29.910567 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904e71b-aba0-402b-b348-66f629e8dacf admin admin] PATH_INFO: `/v3/projects/c1320e10b15a41309895b6e51c0997bf/users/1d442782e0454d048b4fa9f1edd9c8a4/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:29.927908 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904e71b-aba0-402b-b348-66f629e8dacf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1320e10b15a41309895b6e51c0997bf, user_id=1d442782e0454d048b4fa9f1edd9c8a4, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:29.931392 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904e71b-aba0-402b-b348-66f629e8dacf admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:30.013520 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1435/2830] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:29 2022] PUT /identity/v3/projects/c1320e10b15a41309895b6e51c0997bf/users/1d442782e0454d048b4fa9f1edd9c8a4/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:30.017593 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77219f0d-e96a-4ab7-86ae-fc0a9552b4a0 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:30.028296 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77219f0d-e96a-4ab7-86ae-fc0a9552b4a0 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:30.089615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997d321-f655-4202-a59a-cf2f4910fb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:30.090368 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997d321-f655-4202-a59a-cf2f4910fb28 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:30.090567 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997d321-f655-4202-a59a-cf2f4910fb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:30.090838 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997d321-f655-4202-a59a-cf2f4910fb28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:30.091495 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997d321-f655-4202-a59a-cf2f4910fb28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:30.093451 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997d321-f655-4202-a59a-cf2f4910fb28 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:30.112885 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1396/2831] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:30.117391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904e71b-aba0-402b-b348-66f629e8dacf admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:30.123132 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:30.129170 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904e71b-aba0-402b-b348-66f629e8dacf admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:30.134361 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394ed30-cb25-40f2-aa87-e0787edf18a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:30.139296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394ed30-cb25-40f2-aa87-e0787edf18a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:30.139296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394ed30-cb25-40f2-aa87-e0787edf18a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:30.139296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394ed30-cb25-40f2-aa87-e0787edf18a5 admin admin] PATH_INFO: `/v3/projects/c1320e10b15a41309895b6e51c0997bf/users/1d442782e0454d048b4fa9f1edd9c8a4/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:30.139296 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394ed30-cb25-40f2-aa87-e0787edf18a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1320e10b15a41309895b6e51c0997bf, user_id=1d442782e0454d048b4fa9f1edd9c8a4, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:30.141241 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394ed30-cb25-40f2-aa87-e0787edf18a5 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:30.154773 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1436/2832] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:30 2022] PUT /identity/v3/projects/c1320e10b15a41309895b6e51c0997bf/users/1d442782e0454d048b4fa9f1edd9c8a4/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:30.165914 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add9ee8-772b-4610-a0a6-1f2964749bd0 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:30.166198 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add9ee8-772b-4610-a0a6-1f2964749bd0 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:30.166476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add9ee8-772b-4610-a0a6-1f2964749bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:30.196526 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-8add9ee8-772b-4610-a0a6-1f2964749bd0 None None] MFA Rules not processed for user `1d442782e0454d048b4fa9f1edd9c8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:30.197764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8add9ee8-772b-4610-a0a6-1f2964749bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:30.268155 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:30.271149 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1397/2833] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:37:30.288185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394ed30-cb25-40f2-aa87-e0787edf18a5 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:30.288185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-4394ed30-cb25-40f2-aa87-e0787edf18a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:30.346762 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394ed30-cb25-40f2-aa87-e0787edf18a5 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:30.350511 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd61fbd-049c-4182-b81b-ca2b0f90739c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:30.351176 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd61fbd-049c-4182-b81b-ca2b0f90739c service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:30.352146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd61fbd-049c-4182-b81b-ca2b0f90739c service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:30.352542 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd61fbd-049c-4182-b81b-ca2b0f90739c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:30.362748 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd61fbd-049c-4182-b81b-ca2b0f90739c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:30.364221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd61fbd-049c-4182-b81b-ca2b0f90739c service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:30.374861 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1437/2834] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:30 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:30.405127 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add9ee8-772b-4610-a0a6-1f2964749bd0 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:30.490661 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add9ee8-772b-4610-a0a6-1f2964749bd0 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:30.497353 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0a098-5698-40a5-a135-9ae49633ed72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:30.498391 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0a098-5698-40a5-a135-9ae49633ed72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:30.498792 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0a098-5698-40a5-a135-9ae49633ed72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:30.499099 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0a098-5698-40a5-a135-9ae49633ed72 admin admin] PATH_INFO: `/v3/users/a57294ccdc2048e49c34c56cca0cbc44` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:30.500443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0a098-5698-40a5-a135-9ae49633ed72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a57294ccdc2048e49c34c56cca0cbc44)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:30.502489 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0a098-5698-40a5-a135-9ae49633ed72 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:30.747711 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a4a0a098-5698-40a5-a135-9ae49633ed72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a57294ccdc2048e49c34c56cca0cbc44'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:30.748329 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a4a0a098-5698-40a5-a135-9ae49633ed72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a57294ccdc2048e49c34c56cca0cbc44'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:30.755923 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a4a0a098-5698-40a5-a135-9ae49633ed72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a57294ccdc2048e49c34c56cca0cbc44'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:30.769313 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a4a0a098-5698-40a5-a135-9ae49633ed72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a57294ccdc2048e49c34c56cca0cbc44'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:30.770080 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-a4a0a098-5698-40a5-a135-9ae49633ed72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a57294ccdc2048e49c34c56cca0cbc44'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:30.851803 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1398/2835] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:30 2022] DELETE /identity/v3/users/a57294ccdc2048e49c34c56cca0cbc44 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:30.856573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73543c7c-e3a1-4399-985e-5e45191f6732 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:30.857164 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73543c7c-e3a1-4399-985e-5e45191f6732 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:30.857164 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73543c7c-e3a1-4399-985e-5e45191f6732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:30.878378 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-73543c7c-e3a1-4399-985e-5e45191f6732 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:30.879595 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-73543c7c-e3a1-4399-985e-5e45191f6732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:30.948518 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1438/2836] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:30.959023 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0a098-5698-40a5-a135-9ae49633ed72 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:30.960629 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-a4a0a098-5698-40a5-a135-9ae49633ed72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:31.024854 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0a098-5698-40a5-a135-9ae49633ed72 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:31.028714 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcb198-72a7-46d4-8dcc-e4bbf9a087a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:31.029341 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcb198-72a7-46d4-8dcc-e4bbf9a087a9 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:31.029628 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcb198-72a7-46d4-8dcc-e4bbf9a087a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:31.029943 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcb198-72a7-46d4-8dcc-e4bbf9a087a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:31.040263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcb198-72a7-46d4-8dcc-e4bbf9a087a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:31.041721 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcb198-72a7-46d4-8dcc-e4bbf9a087a9 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:31.052704 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1399/2837] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:31.529310 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73543c7c-e3a1-4399-985e-5e45191f6732 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:31.530794 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-73543c7c-e3a1-4399-985e-5e45191f6732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:31.543844 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73543c7c-e3a1-4399-985e-5e45191f6732 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:31.549855 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25a188-b6ed-4197-8c8a-4d6bc0e12bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:31.550513 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25a188-b6ed-4197-8c8a-4d6bc0e12bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:31.550799 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25a188-b6ed-4197-8c8a-4d6bc0e12bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:31.551073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25a188-b6ed-4197-8c8a-4d6bc0e12bf8 admin admin] PATH_INFO: `/v3/projects/89d2d5782b9f4d8780af707a309a55c3` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:31.552212 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25a188-b6ed-4197-8c8a-4d6bc0e12bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d2d5782b9f4d8780af707a309a55c3)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:31.555145 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25a188-b6ed-4197-8c8a-4d6bc0e12bf8 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:31.671596 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0c25a188-b6ed-4197-8c8a-4d6bc0e12bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d2d5782b9f4d8780af707a309a55c3', 'request_id': 'req-0c25a188-b6ed-4197-8c8a-4d6bc0e12bf8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:31.677823 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0c25a188-b6ed-4197-8c8a-4d6bc0e12bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d2d5782b9f4d8780af707a309a55c3', 'request_id': 'req-0c25a188-b6ed-4197-8c8a-4d6bc0e12bf8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:31.683669 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0c25a188-b6ed-4197-8c8a-4d6bc0e12bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d2d5782b9f4d8780af707a309a55c3', 'request_id': 'req-0c25a188-b6ed-4197-8c8a-4d6bc0e12bf8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:31.800936 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0c25a188-b6ed-4197-8c8a-4d6bc0e12bf8 admin admin] The token cache is being invalidate because project 89d2d5782b9f4d8780af707a309a55c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:31.801210 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0c25a188-b6ed-4197-8c8a-4d6bc0e12bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:31.801841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0c25a188-b6ed-4197-8c8a-4d6bc0e12bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:31.803458 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1439/2838] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:31 2022] DELETE /identity/v3/projects/89d2d5782b9f4d8780af707a309a55c3 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:37:31.807784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcb198-72a7-46d4-8dcc-e4bbf9a087a9 service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:31.817920 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcb198-72a7-46d4-8dcc-e4bbf9a087a9 service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:31.838801 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:31.881740 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347c824-8331-4bf2-b2c7-ea1c38a96267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:31.882524 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347c824-8331-4bf2-b2c7-ea1c38a96267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:31.882976 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347c824-8331-4bf2-b2c7-ea1c38a96267 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:31.883275 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347c824-8331-4bf2-b2c7-ea1c38a96267 admin admin] PATH_INFO: `/v3/users/1d442782e0454d048b4fa9f1edd9c8a4` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:31.884424 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347c824-8331-4bf2-b2c7-ea1c38a96267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d442782e0454d048b4fa9f1edd9c8a4)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:31.886887 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347c824-8331-4bf2-b2c7-ea1c38a96267 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:32.145963 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-3347c824-8331-4bf2-b2c7-ea1c38a96267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d442782e0454d048b4fa9f1edd9c8a4'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:32.148827 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-3347c824-8331-4bf2-b2c7-ea1c38a96267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d442782e0454d048b4fa9f1edd9c8a4'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:32.157677 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-3347c824-8331-4bf2-b2c7-ea1c38a96267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d442782e0454d048b4fa9f1edd9c8a4'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:32.172927 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-3347c824-8331-4bf2-b2c7-ea1c38a96267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d442782e0454d048b4fa9f1edd9c8a4'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:32.174514 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-3347c824-8331-4bf2-b2c7-ea1c38a96267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d442782e0454d048b4fa9f1edd9c8a4'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:32.262952 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1400/2839] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:31 2022] DELETE /identity/v3/users/1d442782e0454d048b4fa9f1edd9c8a4 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:32.681878 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25a188-b6ed-4197-8c8a-4d6bc0e12bf8 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:32.683611 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-0c25a188-b6ed-4197-8c8a-4d6bc0e12bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:32.701997 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25a188-b6ed-4197-8c8a-4d6bc0e12bf8 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:32.718301 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:32.768603 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a813b-24b5-4ad9-a95a-ef0435977f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:32.769242 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a813b-24b5-4ad9-a95a-ef0435977f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:32.769527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a813b-24b5-4ad9-a95a-ef0435977f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:32.769801 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a813b-24b5-4ad9-a95a-ef0435977f4d admin admin] PATH_INFO: `/v3/projects/c1320e10b15a41309895b6e51c0997bf` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:32.770973 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a813b-24b5-4ad9-a95a-ef0435977f4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1320e10b15a41309895b6e51c0997bf)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:32.772886 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a813b-24b5-4ad9-a95a-ef0435977f4d admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:32.897202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-cc7a813b-24b5-4ad9-a95a-ef0435977f4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1320e10b15a41309895b6e51c0997bf', 'request_id': 'req-cc7a813b-24b5-4ad9-a95a-ef0435977f4d'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:32.904035 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-cc7a813b-24b5-4ad9-a95a-ef0435977f4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1320e10b15a41309895b6e51c0997bf', 'request_id': 'req-cc7a813b-24b5-4ad9-a95a-ef0435977f4d'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:32.909660 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-cc7a813b-24b5-4ad9-a95a-ef0435977f4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1320e10b15a41309895b6e51c0997bf', 'request_id': 'req-cc7a813b-24b5-4ad9-a95a-ef0435977f4d'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:33.022166 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-cc7a813b-24b5-4ad9-a95a-ef0435977f4d admin admin] The token cache is being invalidate because project c1320e10b15a41309895b6e51c0997bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:33.026299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-cc7a813b-24b5-4ad9-a95a-ef0435977f4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:33.026299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-cc7a813b-24b5-4ad9-a95a-ef0435977f4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:33.026299 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1440/2840] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:32 2022] DELETE /identity/v3/projects/c1320e10b15a41309895b6e51c0997bf => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:37:33.029741 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea987e7d-a266-4b13-a210-9407b8db4707 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:33.030270 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea987e7d-a266-4b13-a210-9407b8db4707 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:33.030400 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea987e7d-a266-4b13-a210-9407b8db4707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:33.051124 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-ea987e7d-a266-4b13-a210-9407b8db4707 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:33.055300 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-ea987e7d-a266-4b13-a210-9407b8db4707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:33.115060 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1401/2841] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:33.122800 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0b9e7-d4ea-4165-a4c6-0e1090dca458 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:33.123092 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0b9e7-d4ea-4165-a4c6-0e1090dca458 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:33.123375 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0b9e7-d4ea-4165-a4c6-0e1090dca458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:33.144655 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-8eb0b9e7-d4ea-4165-a4c6-0e1090dca458 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:33.145887 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-8eb0b9e7-d4ea-4165-a4c6-0e1090dca458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:33.154750 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1441/2842] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:33.158966 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea987e7d-a266-4b13-a210-9407b8db4707 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:33.169524 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea987e7d-a266-4b13-a210-9407b8db4707 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:33.174163 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f88cd-f417-4f47-83db-da544e7711bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:33.174825 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f88cd-f417-4f47-83db-da544e7711bf admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:33.175048 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f88cd-f417-4f47-83db-da544e7711bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:33.175321 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f88cd-f417-4f47-83db-da544e7711bf admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:33.175980 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f88cd-f417-4f47-83db-da544e7711bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:37:33.176281 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f88cd-f417-4f47-83db-da544e7711bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:33.177903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f88cd-f417-4f47-83db-da544e7711bf admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:33.189789 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1402/2843] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:37:33.194207 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0b9e7-d4ea-4165-a4c6-0e1090dca458 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:33.205641 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0b9e7-d4ea-4165-a4c6-0e1090dca458 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:33.211198 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c42d65-d9fa-4ada-80c5-4ccfead5e5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:33.212438 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c42d65-d9fa-4ada-80c5-4ccfead5e5cd admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:33.212732 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c42d65-d9fa-4ada-80c5-4ccfead5e5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:33.213006 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c42d65-d9fa-4ada-80c5-4ccfead5e5cd admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:33.213642 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c42d65-d9fa-4ada-80c5-4ccfead5e5cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:33.215720 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c42d65-d9fa-4ada-80c5-4ccfead5e5cd admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:33.304338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1442/2844] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:33 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:33.308443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f88cd-f417-4f47-83db-da544e7711bf admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:33.318980 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f88cd-f417-4f47-83db-da544e7711bf admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:33.349768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:33.390868 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc9a87-2013-4a9b-8d93-7c8feaab431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:33.391785 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc9a87-2013-4a9b-8d93-7c8feaab431a admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:33.392231 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc9a87-2013-4a9b-8d93-7c8feaab431a admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:33.392658 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc9a87-2013-4a9b-8d93-7c8feaab431a admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:33.393649 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc9a87-2013-4a9b-8d93-7c8feaab431a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:33.396525 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc9a87-2013-4a9b-8d93-7c8feaab431a admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:33.520493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1403/2845] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:33 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:33.525729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c42d65-d9fa-4ada-80c5-4ccfead5e5cd admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:33.536186 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c42d65-d9fa-4ada-80c5-4ccfead5e5cd admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:33.540862 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d310200-7587-4379-b3c2-ac6cf0d92e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:33.546425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d310200-7587-4379-b3c2-ac6cf0d92e0a admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:33.546425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d310200-7587-4379-b3c2-ac6cf0d92e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:33.546425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d310200-7587-4379-b3c2-ac6cf0d92e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:33.546425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d310200-7587-4379-b3c2-ac6cf0d92e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:33.546425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d310200-7587-4379-b3c2-ac6cf0d92e0a admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:33.555224 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1443/2846] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:33.560274 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc9a87-2013-4a9b-8d93-7c8feaab431a admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:33.571753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc9a87-2013-4a9b-8d93-7c8feaab431a admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:33.576610 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298959c-01e4-4f00-ad2c-6b0852609b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:33.577219 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298959c-01e4-4f00-ad2c-6b0852609b9f admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:33.577498 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298959c-01e4-4f00-ad2c-6b0852609b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:33.577771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298959c-01e4-4f00-ad2c-6b0852609b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:33.578451 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298959c-01e4-4f00-ad2c-6b0852609b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:33.580051 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298959c-01e4-4f00-ad2c-6b0852609b9f admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:33.591250 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1404/2847] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:33.595803 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d310200-7587-4379-b3c2-ac6cf0d92e0a admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:33.606520 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d310200-7587-4379-b3c2-ac6cf0d92e0a admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:33.612166 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e776ea-eaf5-4311-b6e8-3888f8916355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:33.614422 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e776ea-eaf5-4311-b6e8-3888f8916355 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:33.614422 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e776ea-eaf5-4311-b6e8-3888f8916355 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:33.614422 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e776ea-eaf5-4311-b6e8-3888f8916355 admin admin] PATH_INFO: `/v3/projects/69cd7fe8f9df4feaaae5ce6326d076dc/users/f6f4d8a75c3d4ecb9bed914f4aec7db8/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:33.629172 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e776ea-eaf5-4311-b6e8-3888f8916355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69cd7fe8f9df4feaaae5ce6326d076dc, user_id=f6f4d8a75c3d4ecb9bed914f4aec7db8, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:33.631881 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e776ea-eaf5-4311-b6e8-3888f8916355 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:33.768414 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1444/2848] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:33 2022] PUT /identity/v3/projects/69cd7fe8f9df4feaaae5ce6326d076dc/users/f6f4d8a75c3d4ecb9bed914f4aec7db8/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:33.780693 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e69f6d-d2ba-4a84-9656-e965eec5cd74 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:33.780987 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e69f6d-d2ba-4a84-9656-e965eec5cd74 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:33.781326 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e69f6d-d2ba-4a84-9656-e965eec5cd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:33.810663 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-86e69f6d-d2ba-4a84-9656-e965eec5cd74 None None] MFA Rules not processed for user `f6f4d8a75c3d4ecb9bed914f4aec7db8`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:33.812452 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-86e69f6d-d2ba-4a84-9656-e965eec5cd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:33.882414 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1405/2849] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:33.887793 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e776ea-eaf5-4311-b6e8-3888f8916355 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:33.938031 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:33.955235 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e776ea-eaf5-4311-b6e8-3888f8916355 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:33.959920 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e561e9-5f54-49b4-a9e6-f1d6cb4ec54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:33.960582 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e561e9-5f54-49b4-a9e6-f1d6cb4ec54a admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:33.961039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e561e9-5f54-49b4-a9e6-f1d6cb4ec54a admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:33.961548 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e561e9-5f54-49b4-a9e6-f1d6cb4ec54a admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:33.962238 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e561e9-5f54-49b4-a9e6-f1d6cb4ec54a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:33.964192 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e561e9-5f54-49b4-a9e6-f1d6cb4ec54a admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:34.098379 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1445/2850] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:33 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:34.102535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e69f6d-d2ba-4a84-9656-e965eec5cd74 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:34.113540 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e69f6d-d2ba-4a84-9656-e965eec5cd74 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:34.175038 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab9b76-9b0b-4c89-afe2-9672ef587b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:34.175684 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab9b76-9b0b-4c89-afe2-9672ef587b4f admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:34.175930 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab9b76-9b0b-4c89-afe2-9672ef587b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:34.176207 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab9b76-9b0b-4c89-afe2-9672ef587b4f admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:34.176917 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab9b76-9b0b-4c89-afe2-9672ef587b4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:34.178865 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab9b76-9b0b-4c89-afe2-9672ef587b4f admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:34.285838 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1406/2851] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:34 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:34.290636 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e561e9-5f54-49b4-a9e6-f1d6cb4ec54a admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:34.301544 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e561e9-5f54-49b4-a9e6-f1d6cb4ec54a admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:34.307647 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67cfdc-f985-4612-82a7-03c602827f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:34.308295 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67cfdc-f985-4612-82a7-03c602827f19 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:34.308573 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67cfdc-f985-4612-82a7-03c602827f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:34.308843 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67cfdc-f985-4612-82a7-03c602827f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:34.309489 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67cfdc-f985-4612-82a7-03c602827f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:34.311127 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67cfdc-f985-4612-82a7-03c602827f19 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:34.322602 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1446/2852] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:34.326951 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab9b76-9b0b-4c89-afe2-9672ef587b4f admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:34.337779 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab9b76-9b0b-4c89-afe2-9672ef587b4f admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:34.343277 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fe627-4c9d-4031-957e-6d9595fbb6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:34.344001 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fe627-4c9d-4031-957e-6d9595fbb6bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:34.344209 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fe627-4c9d-4031-957e-6d9595fbb6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:34.348562 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fe627-4c9d-4031-957e-6d9595fbb6bc admin admin] PATH_INFO: `/v3/projects/468fb8fa3db54196856cc71858128fdf/users/8ea80d75c34f438ebe896ce91c89705c/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:34.362815 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fe627-4c9d-4031-957e-6d9595fbb6bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=468fb8fa3db54196856cc71858128fdf, user_id=8ea80d75c34f438ebe896ce91c89705c, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:34.365496 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fe627-4c9d-4031-957e-6d9595fbb6bc admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:34.435753 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1407/2853] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:34 2022] PUT /identity/v3/projects/468fb8fa3db54196856cc71858128fdf/users/8ea80d75c34f438ebe896ce91c89705c/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:34.440081 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67cfdc-f985-4612-82a7-03c602827f19 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:34.452819 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67cfdc-f985-4612-82a7-03c602827f19 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:34.516541 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009b8cc-8575-4bf1-bf1a-3cbf7d7ac0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:34.517146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009b8cc-8575-4bf1-bf1a-3cbf7d7ac0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:34.517430 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009b8cc-8575-4bf1-bf1a-3cbf7d7ac0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:34.517710 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009b8cc-8575-4bf1-bf1a-3cbf7d7ac0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:34.518380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009b8cc-8575-4bf1-bf1a-3cbf7d7ac0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:34.519984 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009b8cc-8575-4bf1-bf1a-3cbf7d7ac0f4 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:34.536014 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1447/2854] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:34.540461 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fe627-4c9d-4031-957e-6d9595fbb6bc admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:34.546088 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:34.551456 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fe627-4c9d-4031-957e-6d9595fbb6bc admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:34.556395 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e8486-1571-496e-bee4-12d3315e217b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:34.562935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e8486-1571-496e-bee4-12d3315e217b admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:34.562935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e8486-1571-496e-bee4-12d3315e217b admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:34.562935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e8486-1571-496e-bee4-12d3315e217b admin admin] PATH_INFO: `/v3/projects/468fb8fa3db54196856cc71858128fdf/users/8ea80d75c34f438ebe896ce91c89705c/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:34.562935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e8486-1571-496e-bee4-12d3315e217b admin admin] RBAC: Authorizing `identity:create_grant(project_id=468fb8fa3db54196856cc71858128fdf, user_id=8ea80d75c34f438ebe896ce91c89705c, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:34.562935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e8486-1571-496e-bee4-12d3315e217b admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:34.574051 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1408/2855] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:34 2022] PUT /identity/v3/projects/468fb8fa3db54196856cc71858128fdf/users/8ea80d75c34f438ebe896ce91c89705c/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:34.584412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b5c83-2bb1-4ba1-9b02-aeb25eb44a64 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:34.584698 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b5c83-2bb1-4ba1-9b02-aeb25eb44a64 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:34.585003 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b5c83-2bb1-4ba1-9b02-aeb25eb44a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:34.614843 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-fd6b5c83-2bb1-4ba1-9b02-aeb25eb44a64 None None] MFA Rules not processed for user `8ea80d75c34f438ebe896ce91c89705c`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:34.616332 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-fd6b5c83-2bb1-4ba1-9b02-aeb25eb44a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:34.687417 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1448/2856] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:34.700263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e8486-1571-496e-bee4-12d3315e217b admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:34.702188 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-da5e8486-1571-496e-bee4-12d3315e217b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:34.764836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e8486-1571-496e-bee4-12d3315e217b admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:34.768769 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22c427-7796-42d1-8f39-851ed635949d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:34.769382 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22c427-7796-42d1-8f39-851ed635949d service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:34.769786 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22c427-7796-42d1-8f39-851ed635949d service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:34.769990 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22c427-7796-42d1-8f39-851ed635949d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:34.779912 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22c427-7796-42d1-8f39-851ed635949d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:34.781346 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22c427-7796-42d1-8f39-851ed635949d service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:34.791629 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1409/2857] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:34.862240 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b5c83-2bb1-4ba1-9b02-aeb25eb44a64 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:34.905046 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:34.927216 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b5c83-2bb1-4ba1-9b02-aeb25eb44a64 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:34.932054 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f25822-13c7-45f4-a9b2-0c14b1ab6c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:34.932691 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f25822-13c7-45f4-a9b2-0c14b1ab6c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:34.932979 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f25822-13c7-45f4-a9b2-0c14b1ab6c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:34.933258 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f25822-13c7-45f4-a9b2-0c14b1ab6c2a admin admin] PATH_INFO: `/v3/users/f6f4d8a75c3d4ecb9bed914f4aec7db8` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:34.934622 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f25822-13c7-45f4-a9b2-0c14b1ab6c2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6f4d8a75c3d4ecb9bed914f4aec7db8)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:34.936559 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f25822-13c7-45f4-a9b2-0c14b1ab6c2a admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:35.159465 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-69f25822-13c7-45f4-a9b2-0c14b1ab6c2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6f4d8a75c3d4ecb9bed914f4aec7db8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:35.160338 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-69f25822-13c7-45f4-a9b2-0c14b1ab6c2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6f4d8a75c3d4ecb9bed914f4aec7db8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:35.173552 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-69f25822-13c7-45f4-a9b2-0c14b1ab6c2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6f4d8a75c3d4ecb9bed914f4aec7db8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:35.180974 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-69f25822-13c7-45f4-a9b2-0c14b1ab6c2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6f4d8a75c3d4ecb9bed914f4aec7db8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:35.182513 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-69f25822-13c7-45f4-a9b2-0c14b1ab6c2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6f4d8a75c3d4ecb9bed914f4aec7db8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:35.279422 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1449/2858] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:34 2022] DELETE /identity/v3/users/f6f4d8a75c3d4ecb9bed914f4aec7db8 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:35.284960 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984d934-e3a5-43b9-af6b-ddde60a352be None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:35.286077 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984d934-e3a5-43b9-af6b-ddde60a352be None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:35.286077 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984d934-e3a5-43b9-af6b-ddde60a352be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:35.306752 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-1984d934-e3a5-43b9-af6b-ddde60a352be None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:35.307996 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-1984d934-e3a5-43b9-af6b-ddde60a352be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:35.377560 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1410/2859] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:35.388847 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f25822-13c7-45f4-a9b2-0c14b1ab6c2a admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:35.390343 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-69f25822-13c7-45f4-a9b2-0c14b1ab6c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:35.454662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f25822-13c7-45f4-a9b2-0c14b1ab6c2a admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:35.458608 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e51d5c-1dd4-4b02-8d10-311148d540a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:35.459334 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e51d5c-1dd4-4b02-8d10-311148d540a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:35.459657 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e51d5c-1dd4-4b02-8d10-311148d540a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:35.459982 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e51d5c-1dd4-4b02-8d10-311148d540a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:35.470649 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e51d5c-1dd4-4b02-8d10-311148d540a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:35.472088 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e51d5c-1dd4-4b02-8d10-311148d540a3 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:35.482796 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1450/2860] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:35.915440 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984d934-e3a5-43b9-af6b-ddde60a352be None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:35.917482 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-1984d934-e3a5-43b9-af6b-ddde60a352be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:35.933270 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984d934-e3a5-43b9-af6b-ddde60a352be None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:35.943746 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cd694-fa87-48f1-bef3-126a89c1d962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:35.944607 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cd694-fa87-48f1-bef3-126a89c1d962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:35.945431 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cd694-fa87-48f1-bef3-126a89c1d962 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:35.945726 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cd694-fa87-48f1-bef3-126a89c1d962 admin admin] PATH_INFO: `/v3/projects/69cd7fe8f9df4feaaae5ce6326d076dc` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:35.947119 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cd694-fa87-48f1-bef3-126a89c1d962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69cd7fe8f9df4feaaae5ce6326d076dc)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:35.949093 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cd694-fa87-48f1-bef3-126a89c1d962 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:36.084200 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-118cd694-fa87-48f1-bef3-126a89c1d962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69cd7fe8f9df4feaaae5ce6326d076dc', 'request_id': 'req-118cd694-fa87-48f1-bef3-126a89c1d962'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:36.092464 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-118cd694-fa87-48f1-bef3-126a89c1d962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69cd7fe8f9df4feaaae5ce6326d076dc', 'request_id': 'req-118cd694-fa87-48f1-bef3-126a89c1d962'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:36.098816 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-118cd694-fa87-48f1-bef3-126a89c1d962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69cd7fe8f9df4feaaae5ce6326d076dc', 'request_id': 'req-118cd694-fa87-48f1-bef3-126a89c1d962'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:36.252318 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-118cd694-fa87-48f1-bef3-126a89c1d962 admin admin] The token cache is being invalidate because project 69cd7fe8f9df4feaaae5ce6326d076dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:36.252615 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-118cd694-fa87-48f1-bef3-126a89c1d962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:36.253260 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-118cd694-fa87-48f1-bef3-126a89c1d962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:36.254853 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1411/2861] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:35 2022] DELETE /identity/v3/projects/69cd7fe8f9df4feaaae5ce6326d076dc => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:36.259894 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e51d5c-1dd4-4b02-8d10-311148d540a3 service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:36.270350 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e51d5c-1dd4-4b02-8d10-311148d540a3 service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:36.336303 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad94f8a-38af-470f-b8e5-fc18d27f81c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:36.336815 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad94f8a-38af-470f-b8e5-fc18d27f81c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:36.337099 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad94f8a-38af-470f-b8e5-fc18d27f81c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:36.337368 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad94f8a-38af-470f-b8e5-fc18d27f81c3 admin admin] PATH_INFO: `/v3/users/8ea80d75c34f438ebe896ce91c89705c` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:36.338615 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad94f8a-38af-470f-b8e5-fc18d27f81c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ea80d75c34f438ebe896ce91c89705c)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:36.340530 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad94f8a-38af-470f-b8e5-fc18d27f81c3 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:36.342488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:36.530373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0ad94f8a-38af-470f-b8e5-fc18d27f81c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ea80d75c34f438ebe896ce91c89705c'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:36.531355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0ad94f8a-38af-470f-b8e5-fc18d27f81c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ea80d75c34f438ebe896ce91c89705c'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:36.546093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0ad94f8a-38af-470f-b8e5-fc18d27f81c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ea80d75c34f438ebe896ce91c89705c'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:36.553677 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0ad94f8a-38af-470f-b8e5-fc18d27f81c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ea80d75c34f438ebe896ce91c89705c'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:36.555070 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-0ad94f8a-38af-470f-b8e5-fc18d27f81c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ea80d75c34f438ebe896ce91c89705c'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:36.652823 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1451/2862] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:36 2022] DELETE /identity/v3/users/8ea80d75c34f438ebe896ce91c89705c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:37:37.345446 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cd694-fa87-48f1-bef3-126a89c1d962 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:37.348885 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-118cd694-fa87-48f1-bef3-126a89c1d962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:37.363398 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cd694-fa87-48f1-bef3-126a89c1d962 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:37.378105 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:37.433582 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cece81-4277-4f36-b380-fbd8a1142a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:37.434261 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cece81-4277-4f36-b380-fbd8a1142a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:37.434543 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cece81-4277-4f36-b380-fbd8a1142a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:37.434823 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cece81-4277-4f36-b380-fbd8a1142a73 admin admin] PATH_INFO: `/v3/projects/468fb8fa3db54196856cc71858128fdf` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:37.435962 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cece81-4277-4f36-b380-fbd8a1142a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=468fb8fa3db54196856cc71858128fdf)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:37.437901 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cece81-4277-4f36-b380-fbd8a1142a73 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:37.592185 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-31cece81-4277-4f36-b380-fbd8a1142a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '468fb8fa3db54196856cc71858128fdf', 'request_id': 'req-31cece81-4277-4f36-b380-fbd8a1142a73'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:37.599068 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-31cece81-4277-4f36-b380-fbd8a1142a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '468fb8fa3db54196856cc71858128fdf', 'request_id': 'req-31cece81-4277-4f36-b380-fbd8a1142a73'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:37.610218 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-31cece81-4277-4f36-b380-fbd8a1142a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '468fb8fa3db54196856cc71858128fdf', 'request_id': 'req-31cece81-4277-4f36-b380-fbd8a1142a73'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:37.708044 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-31cece81-4277-4f36-b380-fbd8a1142a73 admin admin] The token cache is being invalidate because project 468fb8fa3db54196856cc71858128fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:37.708468 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-31cece81-4277-4f36-b380-fbd8a1142a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:37.709139 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-31cece81-4277-4f36-b380-fbd8a1142a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:37.711239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1412/2863] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:37 2022] DELETE /identity/v3/projects/468fb8fa3db54196856cc71858128fdf => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:37.717228 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8841e-0723-41e4-8a02-773cdac60470 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:37.717742 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8841e-0723-41e4-8a02-773cdac60470 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:37.718013 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8841e-0723-41e4-8a02-773cdac60470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:37.740110 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-71f8841e-0723-41e4-8a02-773cdac60470 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:37.741276 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-71f8841e-0723-41e4-8a02-773cdac60470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:37.803866 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1452/2864] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:37.812923 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a782771-9edd-4261-b33f-13c1aea43169 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:37.813211 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a782771-9edd-4261-b33f-13c1aea43169 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:37.813494 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a782771-9edd-4261-b33f-13c1aea43169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:37.836598 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-7a782771-9edd-4261-b33f-13c1aea43169 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:37.837818 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-7a782771-9edd-4261-b33f-13c1aea43169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:37.846512 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1413/2865] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:37.850902 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8841e-0723-41e4-8a02-773cdac60470 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:37.865217 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8841e-0723-41e4-8a02-773cdac60470 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:37.875606 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cd42f-04a9-4a5a-8c45-63651112c24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:37.876222 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cd42f-04a9-4a5a-8c45-63651112c24a admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:37.876543 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cd42f-04a9-4a5a-8c45-63651112c24a admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:37.876783 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cd42f-04a9-4a5a-8c45-63651112c24a admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:37.877433 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cd42f-04a9-4a5a-8c45-63651112c24a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:37:37.877738 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cd42f-04a9-4a5a-8c45-63651112c24a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:37.879406 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cd42f-04a9-4a5a-8c45-63651112c24a admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:37.894915 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1453/2866] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:37:37.900374 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a782771-9edd-4261-b33f-13c1aea43169 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:37.910099 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a782771-9edd-4261-b33f-13c1aea43169 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:37.915398 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee1485-a577-4fb6-890f-737b5d6fb8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:37.915984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee1485-a577-4fb6-890f-737b5d6fb8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:37.916266 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee1485-a577-4fb6-890f-737b5d6fb8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:37.916537 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee1485-a577-4fb6-890f-737b5d6fb8c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:37.917170 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee1485-a577-4fb6-890f-737b5d6fb8c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:37.919180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee1485-a577-4fb6-890f-737b5d6fb8c3 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:38.016076 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1414/2867] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:37 2022] POST /identity/v3/projects => generated 401 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:37:38.020863 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cd42f-04a9-4a5a-8c45-63651112c24a admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:38.032193 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cd42f-04a9-4a5a-8c45-63651112c24a admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:38.102331 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4404b5-ea10-4bfa-aeaa-272ef0c27d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:38.102857 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4404b5-ea10-4bfa-aeaa-272ef0c27d87 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:38.103149 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4404b5-ea10-4bfa-aeaa-272ef0c27d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:38.103425 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4404b5-ea10-4bfa-aeaa-272ef0c27d87 admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:38.104071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4404b5-ea10-4bfa-aeaa-272ef0c27d87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:38.106038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4404b5-ea10-4bfa-aeaa-272ef0c27d87 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:38.117850 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:38.239803 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1454/2868] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:38 2022] POST /identity/v3/users => generated 301 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:38.244484 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee1485-a577-4fb6-890f-737b5d6fb8c3 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:38.255314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee1485-a577-4fb6-890f-737b5d6fb8c3 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:38.261097 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe130e3-3b71-4d63-aaf4-5f3e2a3bb090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:38.261798 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe130e3-3b71-4d63-aaf4-5f3e2a3bb090 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:38.262109 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe130e3-3b71-4d63-aaf4-5f3e2a3bb090 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:38.262386 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe130e3-3b71-4d63-aaf4-5f3e2a3bb090 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:38.263047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe130e3-3b71-4d63-aaf4-5f3e2a3bb090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:38.264648 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe130e3-3b71-4d63-aaf4-5f3e2a3bb090 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:38.275905 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1415/2869] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:38.280398 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4404b5-ea10-4bfa-aeaa-272ef0c27d87 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:38.291396 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4404b5-ea10-4bfa-aeaa-272ef0c27d87 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:38.296403 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65df635-5985-4377-bf4d-e6ffe8c44bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:38.298594 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65df635-5985-4377-bf4d-e6ffe8c44bae admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:38.298594 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65df635-5985-4377-bf4d-e6ffe8c44bae admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:38.298594 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65df635-5985-4377-bf4d-e6ffe8c44bae admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:38.298594 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65df635-5985-4377-bf4d-e6ffe8c44bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:38.299979 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65df635-5985-4377-bf4d-e6ffe8c44bae admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:38.314247 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1455/2870] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:38.318795 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe130e3-3b71-4d63-aaf4-5f3e2a3bb090 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:38.330627 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe130e3-3b71-4d63-aaf4-5f3e2a3bb090 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:38.335854 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb548a-b04f-433a-8ad7-ae4f32df60ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:38.336890 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb548a-b04f-433a-8ad7-ae4f32df60ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:38.337174 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb548a-b04f-433a-8ad7-ae4f32df60ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:38.337454 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb548a-b04f-433a-8ad7-ae4f32df60ed admin admin] PATH_INFO: `/v3/projects/1badb9fce6134fd6914997aaa3b158bf/users/196f761ad11e48bbbf3dbe0e8ad179f2/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:38.355139 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb548a-b04f-433a-8ad7-ae4f32df60ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1badb9fce6134fd6914997aaa3b158bf, user_id=196f761ad11e48bbbf3dbe0e8ad179f2, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:38.357699 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb548a-b04f-433a-8ad7-ae4f32df60ed admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:38.453380 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1416/2871] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:38 2022] PUT /identity/v3/projects/1badb9fce6134fd6914997aaa3b158bf/users/196f761ad11e48bbbf3dbe0e8ad179f2/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:38.464029 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524676fa-77f3-48d9-8543-02874eec43db None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:38.464317 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524676fa-77f3-48d9-8543-02874eec43db None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:38.464626 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524676fa-77f3-48d9-8543-02874eec43db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:38.494848 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-524676fa-77f3-48d9-8543-02874eec43db None None] MFA Rules not processed for user `196f761ad11e48bbbf3dbe0e8ad179f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:38.496073 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-524676fa-77f3-48d9-8543-02874eec43db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:38.562950 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1456/2872] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:38 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:38.567540 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb548a-b04f-433a-8ad7-ae4f32df60ed admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:38.618140 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:38.635524 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb548a-b04f-433a-8ad7-ae4f32df60ed admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:38.640718 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575599f-e669-48a9-8214-4973adb3cdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:38.641335 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575599f-e669-48a9-8214-4973adb3cdfa admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:38.641620 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575599f-e669-48a9-8214-4973adb3cdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:38.641931 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575599f-e669-48a9-8214-4973adb3cdfa admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:38.642584 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575599f-e669-48a9-8214-4973adb3cdfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:38.644668 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575599f-e669-48a9-8214-4973adb3cdfa admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:38.745636 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1417/2873] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:38 2022] POST /identity/v3/projects => generated 397 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:38.750035 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524676fa-77f3-48d9-8543-02874eec43db None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:38.762849 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524676fa-77f3-48d9-8543-02874eec43db None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:38.820868 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daeddd-c047-40a1-9a74-afbe981112cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:38.821472 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daeddd-c047-40a1-9a74-afbe981112cd admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:38.821918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daeddd-c047-40a1-9a74-afbe981112cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:38.822214 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daeddd-c047-40a1-9a74-afbe981112cd admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:38.822844 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70daeddd-c047-40a1-9a74-afbe981112cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:38.824754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70daeddd-c047-40a1-9a74-afbe981112cd admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:38.916241 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1457/2874] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:38 2022] POST /identity/v3/users => generated 305 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:38.920822 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575599f-e669-48a9-8214-4973adb3cdfa admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:38.934978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575599f-e669-48a9-8214-4973adb3cdfa admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:38.940581 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2783b-d937-45ff-adb2-7b419c0299c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:38.941198 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2783b-d937-45ff-adb2-7b419c0299c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:38.941484 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2783b-d937-45ff-adb2-7b419c0299c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:38.941791 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2783b-d937-45ff-adb2-7b419c0299c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:38.942477 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2783b-d937-45ff-adb2-7b419c0299c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:38.944085 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2783b-d937-45ff-adb2-7b419c0299c2 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:38.954903 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1418/2875] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:38.959158 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daeddd-c047-40a1-9a74-afbe981112cd admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:38.970071 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daeddd-c047-40a1-9a74-afbe981112cd admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:38.974816 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe0ba0-25ac-4874-bca7-1c5c44e45aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:38.978514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe0ba0-25ac-4874-bca7-1c5c44e45aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:38.978514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe0ba0-25ac-4874-bca7-1c5c44e45aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:38.978514 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe0ba0-25ac-4874-bca7-1c5c44e45aa6 admin admin] PATH_INFO: `/v3/projects/1c0e786159774705b01b56686b64e5b4/users/4904d94a4f6545b4a3cb80853173d6ac/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:38.998786 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe0ba0-25ac-4874-bca7-1c5c44e45aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c0e786159774705b01b56686b64e5b4, user_id=4904d94a4f6545b4a3cb80853173d6ac, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:39.001475 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe0ba0-25ac-4874-bca7-1c5c44e45aa6 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:39.150646 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1458/2876] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:38 2022] PUT /identity/v3/projects/1c0e786159774705b01b56686b64e5b4/users/4904d94a4f6545b4a3cb80853173d6ac/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:39.154734 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2783b-d937-45ff-adb2-7b419c0299c2 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:39.165378 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2783b-d937-45ff-adb2-7b419c0299c2 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:39.227982 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdafba-58e0-4b7c-83b8-e1668b3bcdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:39.228516 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdafba-58e0-4b7c-83b8-e1668b3bcdce admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:39.228798 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdafba-58e0-4b7c-83b8-e1668b3bcdce admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:39.229077 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdafba-58e0-4b7c-83b8-e1668b3bcdce admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:39.229736 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdafba-58e0-4b7c-83b8-e1668b3bcdce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:39.231456 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdafba-58e0-4b7c-83b8-e1668b3bcdce admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:39.242510 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1419/2877] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:39.246655 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe0ba0-25ac-4874-bca7-1c5c44e45aa6 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:39.257872 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe0ba0-25ac-4874-bca7-1c5c44e45aa6 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:39.262772 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35298423-4a2b-4619-b108-51912161654e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:39.263433 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35298423-4a2b-4619-b108-51912161654e admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:39.263711 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35298423-4a2b-4619-b108-51912161654e admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:39.263985 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35298423-4a2b-4619-b108-51912161654e admin admin] PATH_INFO: `/v3/projects/1c0e786159774705b01b56686b64e5b4/users/4904d94a4f6545b4a3cb80853173d6ac/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:39.265934 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35298423-4a2b-4619-b108-51912161654e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c0e786159774705b01b56686b64e5b4, user_id=4904d94a4f6545b4a3cb80853173d6ac, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:39.268577 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35298423-4a2b-4619-b108-51912161654e admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:39.283638 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1459/2878] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:39 2022] PUT /identity/v3/projects/1c0e786159774705b01b56686b64e5b4/users/4904d94a4f6545b4a3cb80853173d6ac/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:39.295873 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb9d73-bcb6-4bae-912b-c9e45763089c None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:39.296308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb9d73-bcb6-4bae-912b-c9e45763089c None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:39.296709 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb9d73-bcb6-4bae-912b-c9e45763089c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:39.327417 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-c6fb9d73-bcb6-4bae-912b-c9e45763089c None None] MFA Rules not processed for user `4904d94a4f6545b4a3cb80853173d6ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:39.328658 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-c6fb9d73-bcb6-4bae-912b-c9e45763089c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:39.400633 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1420/2879] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:39 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:39.411631 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35298423-4a2b-4619-b108-51912161654e admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:39.413424 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-35298423-4a2b-4619-b108-51912161654e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:39.447371 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:39.477160 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35298423-4a2b-4619-b108-51912161654e admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:39.480993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903228b-63c9-4bfe-a351-410d92d17608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:39.481539 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903228b-63c9-4bfe-a351-410d92d17608 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:39.481846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903228b-63c9-4bfe-a351-410d92d17608 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:39.482160 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903228b-63c9-4bfe-a351-410d92d17608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:39.493502 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903228b-63c9-4bfe-a351-410d92d17608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:39.494981 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903228b-63c9-4bfe-a351-410d92d17608 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:39.504854 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1460/2880] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:39 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:39.798896 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb9d73-bcb6-4bae-912b-c9e45763089c None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:39.809738 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb9d73-bcb6-4bae-912b-c9e45763089c None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:39.813358 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c8f58-2546-4fef-a912-006573430d0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:39.814003 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c8f58-2546-4fef-a912-006573430d0c service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:39.814282 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c8f58-2546-4fef-a912-006573430d0c service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:39.814551 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c8f58-2546-4fef-a912-006573430d0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:39.850525 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:39.880563 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c8f58-2546-4fef-a912-006573430d0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:39.882045 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c8f58-2546-4fef-a912-006573430d0c service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:39.891365 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1421/2881] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:39 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:45.551048 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903228b-63c9-4bfe-a351-410d92d17608 service cinder] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:45.615146 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903228b-63c9-4bfe-a351-410d92d17608 service cinder] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:45.620631 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7eb54-ace5-4130-ba2b-a7f04b4bf2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:45.621269 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7eb54-ace5-4130-ba2b-a7f04b4bf2dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:45.621552 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7eb54-ace5-4130-ba2b-a7f04b4bf2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:45.621885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7eb54-ace5-4130-ba2b-a7f04b4bf2dd admin admin] PATH_INFO: `/v3/users/196f761ad11e48bbbf3dbe0e8ad179f2` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:45.623021 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7eb54-ace5-4130-ba2b-a7f04b4bf2dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=196f761ad11e48bbbf3dbe0e8ad179f2)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:45.624936 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7eb54-ace5-4130-ba2b-a7f04b4bf2dd admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:45.815662 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-69a7eb54-ace5-4130-ba2b-a7f04b4bf2dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '196f761ad11e48bbbf3dbe0e8ad179f2'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:45.816476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-69a7eb54-ace5-4130-ba2b-a7f04b4bf2dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '196f761ad11e48bbbf3dbe0e8ad179f2'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:45.830746 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-69a7eb54-ace5-4130-ba2b-a7f04b4bf2dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '196f761ad11e48bbbf3dbe0e8ad179f2'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:45.837993 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-69a7eb54-ace5-4130-ba2b-a7f04b4bf2dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '196f761ad11e48bbbf3dbe0e8ad179f2'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:45.838729 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-69a7eb54-ace5-4130-ba2b-a7f04b4bf2dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '196f761ad11e48bbbf3dbe0e8ad179f2'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:45.967473 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1461/2882] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:45 2022] DELETE /identity/v3/users/196f761ad11e48bbbf3dbe0e8ad179f2 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:45.972244 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a30841-0c79-4cc8-a597-e141ee3539dc None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:45.972740 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a30841-0c79-4cc8-a597-e141ee3539dc None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:45.972844 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a30841-0c79-4cc8-a597-e141ee3539dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:45.992324 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-e2a30841-0c79-4cc8-a597-e141ee3539dc None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:45.994403 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e2a30841-0c79-4cc8-a597-e141ee3539dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:46.061223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1422/2883] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:46.071215 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7eb54-ace5-4130-ba2b-a7f04b4bf2dd admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:46.073600 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-69a7eb54-ace5-4130-ba2b-a7f04b4bf2dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:46.132666 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:46.137278 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7eb54-ace5-4130-ba2b-a7f04b4bf2dd admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:46.141039 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb554798-2c89-45b1-9bd2-9d5cbff91b59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:46.141655 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb554798-2c89-45b1-9bd2-9d5cbff91b59 service neutron] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:46.142038 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb554798-2c89-45b1-9bd2-9d5cbff91b59 service neutron] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:46.142250 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb554798-2c89-45b1-9bd2-9d5cbff91b59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:46.152828 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb554798-2c89-45b1-9bd2-9d5cbff91b59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:46.154373 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb554798-2c89-45b1-9bd2-9d5cbff91b59 service neutron] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:46.164289 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1462/2884] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:46.602047 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a30841-0c79-4cc8-a597-e141ee3539dc None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:46.603580 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-e2a30841-0c79-4cc8-a597-e141ee3539dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:46.616262 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a30841-0c79-4cc8-a597-e141ee3539dc None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:46.622558 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d36201-a96c-4914-9f03-eac9027b0a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:46.623310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d36201-a96c-4914-9f03-eac9027b0a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:46.623657 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d36201-a96c-4914-9f03-eac9027b0a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:46.624005 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d36201-a96c-4914-9f03-eac9027b0a06 admin admin] PATH_INFO: `/v3/projects/1badb9fce6134fd6914997aaa3b158bf` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:46.625230 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d36201-a96c-4914-9f03-eac9027b0a06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1badb9fce6134fd6914997aaa3b158bf)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:46.627283 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d36201-a96c-4914-9f03-eac9027b0a06 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:46.791175 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-05d36201-a96c-4914-9f03-eac9027b0a06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1badb9fce6134fd6914997aaa3b158bf', 'request_id': 'req-05d36201-a96c-4914-9f03-eac9027b0a06'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:46.797553 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-05d36201-a96c-4914-9f03-eac9027b0a06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1badb9fce6134fd6914997aaa3b158bf', 'request_id': 'req-05d36201-a96c-4914-9f03-eac9027b0a06'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:46.803564 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-05d36201-a96c-4914-9f03-eac9027b0a06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1badb9fce6134fd6914997aaa3b158bf', 'request_id': 'req-05d36201-a96c-4914-9f03-eac9027b0a06'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:46.903491 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-05d36201-a96c-4914-9f03-eac9027b0a06 admin admin] The token cache is being invalidate because project 1badb9fce6134fd6914997aaa3b158bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:46.903704 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-05d36201-a96c-4914-9f03-eac9027b0a06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:46.904331 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-05d36201-a96c-4914-9f03-eac9027b0a06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:46.905886 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1423/2885] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:46 2022] DELETE /identity/v3/projects/1badb9fce6134fd6914997aaa3b158bf => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:46.909900 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb554798-2c89-45b1-9bd2-9d5cbff91b59 service neutron] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:46.920640 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb554798-2c89-45b1-9bd2-9d5cbff91b59 service neutron] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:46.977397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccef2e4-b733-4335-adc6-a3e0bae50c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:46.978592 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccef2e4-b733-4335-adc6-a3e0bae50c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:46.978876 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccef2e4-b733-4335-adc6-a3e0bae50c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:46.979153 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccef2e4-b733-4335-adc6-a3e0bae50c13 admin admin] PATH_INFO: `/v3/users/4904d94a4f6545b4a3cb80853173d6ac` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:46.980355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccef2e4-b733-4335-adc6-a3e0bae50c13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4904d94a4f6545b4a3cb80853173d6ac)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:46.982316 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccef2e4-b733-4335-adc6-a3e0bae50c13 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:47.224093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-dccef2e4-b733-4335-adc6-a3e0bae50c13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4904d94a4f6545b4a3cb80853173d6ac'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:47.224748 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-dccef2e4-b733-4335-adc6-a3e0bae50c13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4904d94a4f6545b4a3cb80853173d6ac'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:47.237612 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-dccef2e4-b733-4335-adc6-a3e0bae50c13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4904d94a4f6545b4a3cb80853173d6ac'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:47.245337 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-dccef2e4-b733-4335-adc6-a3e0bae50c13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4904d94a4f6545b4a3cb80853173d6ac'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:47.246116 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-dccef2e4-b733-4335-adc6-a3e0bae50c13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4904d94a4f6545b4a3cb80853173d6ac'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:47.326474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1463/2886] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:46 2022] DELETE /identity/v3/users/4904d94a4f6545b4a3cb80853173d6ac => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:47.854598 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d36201-a96c-4914-9f03-eac9027b0a06 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:47.864488 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-05d36201-a96c-4914-9f03-eac9027b0a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:47.871517 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d36201-a96c-4914-9f03-eac9027b0a06 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:47.933582 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580ec2f-fe3b-4086-9b47-15a484b8e062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:47.934371 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580ec2f-fe3b-4086-9b47-15a484b8e062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:47.934553 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580ec2f-fe3b-4086-9b47-15a484b8e062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:47.934830 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580ec2f-fe3b-4086-9b47-15a484b8e062 admin admin] PATH_INFO: `/v3/projects/1c0e786159774705b01b56686b64e5b4` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:47.935988 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580ec2f-fe3b-4086-9b47-15a484b8e062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c0e786159774705b01b56686b64e5b4)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:47.937943 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580ec2f-fe3b-4086-9b47-15a484b8e062 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:47.939595 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:48.061323 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-0580ec2f-fe3b-4086-9b47-15a484b8e062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c0e786159774705b01b56686b64e5b4', 'request_id': 'req-0580ec2f-fe3b-4086-9b47-15a484b8e062'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:48.067859 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-0580ec2f-fe3b-4086-9b47-15a484b8e062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c0e786159774705b01b56686b64e5b4', 'request_id': 'req-0580ec2f-fe3b-4086-9b47-15a484b8e062'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:48.074887 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-0580ec2f-fe3b-4086-9b47-15a484b8e062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c0e786159774705b01b56686b64e5b4', 'request_id': 'req-0580ec2f-fe3b-4086-9b47-15a484b8e062'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:48.206861 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-0580ec2f-fe3b-4086-9b47-15a484b8e062 admin admin] The token cache is being invalidate because project 1c0e786159774705b01b56686b64e5b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:48.207151 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-0580ec2f-fe3b-4086-9b47-15a484b8e062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:48.207775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-0580ec2f-fe3b-4086-9b47-15a484b8e062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:48.209269 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1424/2887] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:47 2022] DELETE /identity/v3/projects/1c0e786159774705b01b56686b64e5b4 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:37:48.215554 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4c458-4398-4623-ae2b-0b2f3c284c54 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:48.216135 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4c458-4398-4623-ae2b-0b2f3c284c54 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:48.216135 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4c458-4398-4623-ae2b-0b2f3c284c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:48.237645 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-f3d4c458-4398-4623-ae2b-0b2f3c284c54 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:48.238905 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f3d4c458-4398-4623-ae2b-0b2f3c284c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:48.301885 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1464/2888] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:48.311984 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f249f8b-ef86-4283-b10a-18335738025c None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:48.312269 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f249f8b-ef86-4283-b10a-18335738025c None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:48.312575 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f249f8b-ef86-4283-b10a-18335738025c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:48.334613 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-2f249f8b-ef86-4283-b10a-18335738025c None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:48.335902 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-2f249f8b-ef86-4283-b10a-18335738025c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:48.345018 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1425/2889] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:48.349563 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4c458-4398-4623-ae2b-0b2f3c284c54 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:48.360317 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4c458-4398-4623-ae2b-0b2f3c284c54 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:48.365436 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8710c-299f-4f70-a4fe-0a9673fca012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:48.366075 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8710c-299f-4f70-a4fe-0a9673fca012 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:48.366363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8710c-299f-4f70-a4fe-0a9673fca012 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:48.366643 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8710c-299f-4f70-a4fe-0a9673fca012 admin admin] PATH_INFO: `/v3/domains` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:48.367289 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8710c-299f-4f70-a4fe-0a9673fca012 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:37:48.367599 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8710c-299f-4f70-a4fe-0a9673fca012 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:48.369530 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8710c-299f-4f70-a4fe-0a9673fca012 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:48.376652 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:48.381757 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1465/2890] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:37:48.387239 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f249f8b-ef86-4283-b10a-18335738025c None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:48.396882 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f249f8b-ef86-4283-b10a-18335738025c None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:48.402338 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a89fa-48fa-4232-8c76-ccfdee761370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:48.402949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a89fa-48fa-4232-8c76-ccfdee761370 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:48.403260 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a89fa-48fa-4232-8c76-ccfdee761370 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:48.403536 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a89fa-48fa-4232-8c76-ccfdee761370 admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:48.404282 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a89fa-48fa-4232-8c76-ccfdee761370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:48.406171 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a89fa-48fa-4232-8c76-ccfdee761370 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:48.566211 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1426/2891] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:48 2022] POST /identity/v3/projects => generated 389 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:37:48.576378 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8710c-299f-4f70-a4fe-0a9673fca012 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:48.586369 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8710c-299f-4f70-a4fe-0a9673fca012 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:48.643265 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332226a-b5ab-410f-b5b8-76a60f6a6fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:48.643876 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332226a-b5ab-410f-b5b8-76a60f6a6fec admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:48.644160 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332226a-b5ab-410f-b5b8-76a60f6a6fec admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:48.644437 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332226a-b5ab-410f-b5b8-76a60f6a6fec admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:48.645078 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332226a-b5ab-410f-b5b8-76a60f6a6fec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:48.647026 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332226a-b5ab-410f-b5b8-76a60f6a6fec admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:48.741915 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1466/2892] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:48 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:48.746180 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a89fa-48fa-4232-8c76-ccfdee761370 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:48.756932 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a89fa-48fa-4232-8c76-ccfdee761370 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:48.762561 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5309e-3b91-4adf-ac16-be3125d0e516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:48.763179 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5309e-3b91-4adf-ac16-be3125d0e516 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:48.763459 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5309e-3b91-4adf-ac16-be3125d0e516 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:48.763737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5309e-3b91-4adf-ac16-be3125d0e516 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:48.764390 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5309e-3b91-4adf-ac16-be3125d0e516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:48.766071 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5309e-3b91-4adf-ac16-be3125d0e516 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:48.777419 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1427/2893] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:48.782124 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332226a-b5ab-410f-b5b8-76a60f6a6fec admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:48.792089 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332226a-b5ab-410f-b5b8-76a60f6a6fec admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:48.797114 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd1fab-5af0-4a5a-8fd0-5fc55e1e455f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:48.797714 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd1fab-5af0-4a5a-8fd0-5fc55e1e455f admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:48.798037 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd1fab-5af0-4a5a-8fd0-5fc55e1e455f admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:48.798310 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd1fab-5af0-4a5a-8fd0-5fc55e1e455f admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:48.798960 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd1fab-5af0-4a5a-8fd0-5fc55e1e455f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:48.800560 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd1fab-5af0-4a5a-8fd0-5fc55e1e455f admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:48.812559 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1467/2894] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:48.816850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5309e-3b91-4adf-ac16-be3125d0e516 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:48.827805 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5309e-3b91-4adf-ac16-be3125d0e516 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:48.832594 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c1f67-25c7-4470-a9c7-31108a5311ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:48.833257 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c1f67-25c7-4470-a9c7-31108a5311ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:48.833539 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c1f67-25c7-4470-a9c7-31108a5311ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:48.833836 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c1f67-25c7-4470-a9c7-31108a5311ee admin admin] PATH_INFO: `/v3/projects/db5a056c7d4f484badf5a5848998d451/users/74c99b71b90140fca8d1f894d10e95df/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:48.849076 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c1f67-25c7-4470-a9c7-31108a5311ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=db5a056c7d4f484badf5a5848998d451, user_id=74c99b71b90140fca8d1f894d10e95df, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:48.851799 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c1f67-25c7-4470-a9c7-31108a5311ee admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:48.967821 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1428/2895] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:48 2022] PUT /identity/v3/projects/db5a056c7d4f484badf5a5848998d451/users/74c99b71b90140fca8d1f894d10e95df/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:48.978677 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f3ebc-140b-40fe-b778-f14043d1556a None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:48.978968 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f3ebc-140b-40fe-b778-f14043d1556a None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:48.979246 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f3ebc-140b-40fe-b778-f14043d1556a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:49.010819 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-d93f3ebc-140b-40fe-b778-f14043d1556a None None] MFA Rules not processed for user `74c99b71b90140fca8d1f894d10e95df`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:49.012044 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-d93f3ebc-140b-40fe-b778-f14043d1556a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:49.078280 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1468/2896] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:49.082810 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c1f67-25c7-4470-a9c7-31108a5311ee admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:49.160514 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c1f67-25c7-4470-a9c7-31108a5311ee admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:49.165453 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efd37e-6f70-482b-bbcc-2415e43a993d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:49.166974 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efd37e-6f70-482b-bbcc-2415e43a993d admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:49.167136 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efd37e-6f70-482b-bbcc-2415e43a993d admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:49.167285 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efd37e-6f70-482b-bbcc-2415e43a993d admin admin] PATH_INFO: `/v3/projects` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:49.167978 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efd37e-6f70-482b-bbcc-2415e43a993d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:49.169916 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efd37e-6f70-482b-bbcc-2415e43a993d admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:49.285737 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1429/2897] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:49 2022] POST /identity/v3/projects => generated 389 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:49.290088 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f3ebc-140b-40fe-b778-f14043d1556a None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:49.300986 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f3ebc-140b-40fe-b778-f14043d1556a None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:49.361495 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb555bc1-ec26-4827-9479-ae62c2c42fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:49.362057 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb555bc1-ec26-4827-9479-ae62c2c42fbb admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:49.362345 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb555bc1-ec26-4827-9479-ae62c2c42fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:49.362604 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb555bc1-ec26-4827-9479-ae62c2c42fbb admin admin] PATH_INFO: `/v3/users` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:49.363298 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb555bc1-ec26-4827-9479-ae62c2c42fbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:49.365188 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb555bc1-ec26-4827-9479-ae62c2c42fbb admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:49.376620 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:49.498970 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1469/2898] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:49 2022] POST /identity/v3/users => generated 301 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 02 21:37:49.504631 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efd37e-6f70-482b-bbcc-2415e43a993d admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:49.516779 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efd37e-6f70-482b-bbcc-2415e43a993d admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:49.523308 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bca0cb-6384-4625-8399-435202e999bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:49.523926 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bca0cb-6384-4625-8399-435202e999bd admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:49.524209 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bca0cb-6384-4625-8399-435202e999bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:49.525191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bca0cb-6384-4625-8399-435202e999bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:49.526023 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bca0cb-6384-4625-8399-435202e999bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:49.528784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bca0cb-6384-4625-8399-435202e999bd admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:49.537937 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:49.543829 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1430/2899] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:37:49.555093 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb555bc1-ec26-4827-9479-ae62c2c42fbb admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:49.565790 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb555bc1-ec26-4827-9479-ae62c2c42fbb admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:49.570593 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f1773-8118-4e10-a05a-e16b144987a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:49.572104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f1773-8118-4e10-a05a-e16b144987a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:49.572555 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f1773-8118-4e10-a05a-e16b144987a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:49.572841 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f1773-8118-4e10-a05a-e16b144987a2 admin admin] PATH_INFO: `/v3/projects/a6a141f0c40549b09b36b0c0e1cb5c89/users/697cdf8cc6094db7ab8b08a8d1272304/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:49.589904 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f1773-8118-4e10-a05a-e16b144987a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a141f0c40549b09b36b0c0e1cb5c89, user_id=697cdf8cc6094db7ab8b08a8d1272304, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:49.592895 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f1773-8118-4e10-a05a-e16b144987a2 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:49.668266 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1470/2900] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:49 2022] PUT /identity/v3/projects/a6a141f0c40549b09b36b0c0e1cb5c89/users/697cdf8cc6094db7ab8b08a8d1272304/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:49.672624 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bca0cb-6384-4625-8399-435202e999bd admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:49.686023 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bca0cb-6384-4625-8399-435202e999bd admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:49.757105 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e916ff3-38ea-4392-8e13-14c9e0fbec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:49.757722 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e916ff3-38ea-4392-8e13-14c9e0fbec9e admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:49.758040 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e916ff3-38ea-4392-8e13-14c9e0fbec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:49.758438 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e916ff3-38ea-4392-8e13-14c9e0fbec9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:49.759565 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e916ff3-38ea-4392-8e13-14c9e0fbec9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:49.761314 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e916ff3-38ea-4392-8e13-14c9e0fbec9e admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:49.772548 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1431/2901] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:49.778179 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f1773-8118-4e10-a05a-e16b144987a2 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:49.788768 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f1773-8118-4e10-a05a-e16b144987a2 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:49.794252 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71657311-4bdf-43ef-91d3-be928534a155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:49.794777 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71657311-4bdf-43ef-91d3-be928534a155 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:49.795062 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71657311-4bdf-43ef-91d3-be928534a155 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:49.795341 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71657311-4bdf-43ef-91d3-be928534a155 admin admin] PATH_INFO: `/v3/projects/a6a141f0c40549b09b36b0c0e1cb5c89/users/697cdf8cc6094db7ab8b08a8d1272304/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:49.797353 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71657311-4bdf-43ef-91d3-be928534a155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a141f0c40549b09b36b0c0e1cb5c89, user_id=697cdf8cc6094db7ab8b08a8d1272304, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:49.800035 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71657311-4bdf-43ef-91d3-be928534a155 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:49.812470 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1471/2902] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:49 2022] PUT /identity/v3/projects/a6a141f0c40549b09b36b0c0e1cb5c89/users/697cdf8cc6094db7ab8b08a8d1272304/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:49.824955 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8cf51-1dc1-45fd-a111-9bd310cdcadf None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:49.825245 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8cf51-1dc1-45fd-a111-9bd310cdcadf None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:49.825509 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8cf51-1dc1-45fd-a111-9bd310cdcadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:49.859009 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-fda8cf51-1dc1-45fd-a111-9bd310cdcadf None None] MFA Rules not processed for user `697cdf8cc6094db7ab8b08a8d1272304`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:49.863241 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-fda8cf51-1dc1-45fd-a111-9bd310cdcadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:49.931981 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1432/2903] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:49 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 02 21:37:49.943476 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71657311-4bdf-43ef-91d3-be928534a155 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:49.945245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-71657311-4bdf-43ef-91d3-be928534a155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:50.016013 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71657311-4bdf-43ef-91d3-be928534a155 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:50.019802 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725769dd-1dac-41af-a37c-d02315a41f71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:50.020488 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725769dd-1dac-41af-a37c-d02315a41f71 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:50.020775 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725769dd-1dac-41af-a37c-d02315a41f71 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:50.021055 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725769dd-1dac-41af-a37c-d02315a41f71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:50.031601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725769dd-1dac-41af-a37c-d02315a41f71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:50.033062 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725769dd-1dac-41af-a37c-d02315a41f71 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:50.043370 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1472/2904] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:49 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:50.193516 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8cf51-1dc1-45fd-a111-9bd310cdcadf None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:50.260253 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8cf51-1dc1-45fd-a111-9bd310cdcadf None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:50.265053 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a65f1-00fd-4539-84b8-dfa1f6a446b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:50.265685 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a65f1-00fd-4539-84b8-dfa1f6a446b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:50.266014 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a65f1-00fd-4539-84b8-dfa1f6a446b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:50.266289 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a65f1-00fd-4539-84b8-dfa1f6a446b8 admin admin] PATH_INFO: `/v3/users/74c99b71b90140fca8d1f894d10e95df` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:50.267416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a65f1-00fd-4539-84b8-dfa1f6a446b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c99b71b90140fca8d1f894d10e95df)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:50.269481 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a65f1-00fd-4539-84b8-dfa1f6a446b8 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:50.295188 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:50.518109 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-b65a65f1-00fd-4539-84b8-dfa1f6a446b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c99b71b90140fca8d1f894d10e95df'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:50.518694 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-b65a65f1-00fd-4539-84b8-dfa1f6a446b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c99b71b90140fca8d1f894d10e95df'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:50.525781 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-b65a65f1-00fd-4539-84b8-dfa1f6a446b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c99b71b90140fca8d1f894d10e95df'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:50.537949 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-b65a65f1-00fd-4539-84b8-dfa1f6a446b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c99b71b90140fca8d1f894d10e95df'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:50.538656 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-b65a65f1-00fd-4539-84b8-dfa1f6a446b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c99b71b90140fca8d1f894d10e95df'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:50.651500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1433/2905] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:50 2022] DELETE /identity/v3/users/74c99b71b90140fca8d1f894d10e95df => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:37:50.656397 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab3876-d6d2-455b-97cd-f526eba75055 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:50.656918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab3876-d6d2-455b-97cd-f526eba75055 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:50.657032 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab3876-d6d2-455b-97cd-f526eba75055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:50.677571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-16ab3876-d6d2-455b-97cd-f526eba75055 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:50.678948 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-16ab3876-d6d2-455b-97cd-f526eba75055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:50.741035 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1473/2906] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:50.751516 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a65f1-00fd-4539-84b8-dfa1f6a446b8 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:50.752986 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-b65a65f1-00fd-4539-84b8-dfa1f6a446b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:50.813639 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a65f1-00fd-4539-84b8-dfa1f6a446b8 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:50.817256 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6d4ed-3598-46cf-a11b-9f379ca375d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:50.817771 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6d4ed-3598-46cf-a11b-9f379ca375d4 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:50.818079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6d4ed-3598-46cf-a11b-9f379ca375d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:50.818356 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6d4ed-3598-46cf-a11b-9f379ca375d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:50.828500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6d4ed-3598-46cf-a11b-9f379ca375d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:50.829980 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6d4ed-3598-46cf-a11b-9f379ca375d4 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:50.841135 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1434/2907] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:51.334307 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab3876-d6d2-455b-97cd-f526eba75055 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:51.335674 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-16ab3876-d6d2-455b-97cd-f526eba75055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:51.348784 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab3876-d6d2-455b-97cd-f526eba75055 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:51.354500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03492fc5-219a-49ac-956b-22a91ce26d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:51.355800 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03492fc5-219a-49ac-956b-22a91ce26d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:51.356263 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03492fc5-219a-49ac-956b-22a91ce26d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:51.356924 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03492fc5-219a-49ac-956b-22a91ce26d6a admin admin] PATH_INFO: `/v3/projects/db5a056c7d4f484badf5a5848998d451` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:51.358475 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03492fc5-219a-49ac-956b-22a91ce26d6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=db5a056c7d4f484badf5a5848998d451)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:51.360555 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03492fc5-219a-49ac-956b-22a91ce26d6a admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:51.481525 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-03492fc5-219a-49ac-956b-22a91ce26d6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db5a056c7d4f484badf5a5848998d451', 'request_id': 'req-03492fc5-219a-49ac-956b-22a91ce26d6a'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:51.487835 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-03492fc5-219a-49ac-956b-22a91ce26d6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db5a056c7d4f484badf5a5848998d451', 'request_id': 'req-03492fc5-219a-49ac-956b-22a91ce26d6a'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:51.489969 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:51.493878 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-03492fc5-219a-49ac-956b-22a91ce26d6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db5a056c7d4f484badf5a5848998d451', 'request_id': 'req-03492fc5-219a-49ac-956b-22a91ce26d6a'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:51.606229 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-03492fc5-219a-49ac-956b-22a91ce26d6a admin admin] The token cache is being invalidate because project db5a056c7d4f484badf5a5848998d451 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:51.606447 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-03492fc5-219a-49ac-956b-22a91ce26d6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:51.607083 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-03492fc5-219a-49ac-956b-22a91ce26d6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:51.608754 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1474/2908] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:51 2022] DELETE /identity/v3/projects/db5a056c7d4f484badf5a5848998d451 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:51.612850 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6d4ed-3598-46cf-a11b-9f379ca375d4 service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:51.624414 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6d4ed-3598-46cf-a11b-9f379ca375d4 service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:51.684132 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ccb69-bb7e-40c6-a675-0b77e664d0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:51.684766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ccb69-bb7e-40c6-a675-0b77e664d0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:51.685046 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ccb69-bb7e-40c6-a675-0b77e664d0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:51.685318 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ccb69-bb7e-40c6-a675-0b77e664d0d0 admin admin] PATH_INFO: `/v3/users/697cdf8cc6094db7ab8b08a8d1272304` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:51.686500 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ccb69-bb7e-40c6-a675-0b77e664d0d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=697cdf8cc6094db7ab8b08a8d1272304)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:51.688429 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ccb69-bb7e-40c6-a675-0b77e664d0d0 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:51.986755 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:51.988526 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f74ccb69-bb7e-40c6-a675-0b77e664d0d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '697cdf8cc6094db7ab8b08a8d1272304'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:51.989263 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f74ccb69-bb7e-40c6-a675-0b77e664d0d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '697cdf8cc6094db7ab8b08a8d1272304'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:51.996656 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f74ccb69-bb7e-40c6-a675-0b77e664d0d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '697cdf8cc6094db7ab8b08a8d1272304'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:52.008502 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f74ccb69-bb7e-40c6-a675-0b77e664d0d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '697cdf8cc6094db7ab8b08a8d1272304'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:52.009191 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-f74ccb69-bb7e-40c6-a675-0b77e664d0d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '697cdf8cc6094db7ab8b08a8d1272304'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:52.159182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1435/2909] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:37:51 2022] DELETE /identity/v3/users/697cdf8cc6094db7ab8b08a8d1272304 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:52.606370 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03492fc5-219a-49ac-956b-22a91ce26d6a admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:52.607983 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-03492fc5-219a-49ac-956b-22a91ce26d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:52.623846 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03492fc5-219a-49ac-956b-22a91ce26d6a admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:52.690196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fd592-d20c-4670-93fe-e31780f65b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:52.690844 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fd592-d20c-4670-93fe-e31780f65b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:52.691128 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fd592-d20c-4670-93fe-e31780f65b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:52.691401 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fd592-d20c-4670-93fe-e31780f65b10 admin admin] PATH_INFO: `/v3/projects/a6a141f0c40549b09b36b0c0e1cb5c89` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:52.692556 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fd592-d20c-4670-93fe-e31780f65b10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6a141f0c40549b09b36b0c0e1cb5c89)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:52.694500 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fd592-d20c-4670-93fe-e31780f65b10 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:52.834481 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-678fd592-d20c-4670-93fe-e31780f65b10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6a141f0c40549b09b36b0c0e1cb5c89', 'request_id': 'req-678fd592-d20c-4670-93fe-e31780f65b10'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:52.841352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-678fd592-d20c-4670-93fe-e31780f65b10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6a141f0c40549b09b36b0c0e1cb5c89', 'request_id': 'req-678fd592-d20c-4670-93fe-e31780f65b10'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:52.847651 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-678fd592-d20c-4670-93fe-e31780f65b10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6a141f0c40549b09b36b0c0e1cb5c89', 'request_id': 'req-678fd592-d20c-4670-93fe-e31780f65b10'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:52.984380 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-678fd592-d20c-4670-93fe-e31780f65b10 admin admin] The token cache is being invalidate because project a6a141f0c40549b09b36b0c0e1cb5c89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:37:52.985035 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-678fd592-d20c-4670-93fe-e31780f65b10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:52.985730 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-678fd592-d20c-4670-93fe-e31780f65b10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:37:52.987293 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1475/2910] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:37:52 2022] DELETE /identity/v3/projects/a6a141f0c40549b09b36b0c0e1cb5c89 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:52.992478 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be14fe3-0444-4717-b515-badc701d16d9 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:52.993037 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be14fe3-0444-4717-b515-badc701d16d9 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:52.993147 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be14fe3-0444-4717-b515-badc701d16d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:53.017362 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-6be14fe3-0444-4717-b515-badc701d16d9 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:53.018635 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-6be14fe3-0444-4717-b515-badc701d16d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:53.079264 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1436/2911] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:53.087058 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10824f5-6db2-4e20-bb5c-9c869df5ada8 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:53.087352 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10824f5-6db2-4e20-bb5c-9c869df5ada8 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:53.087639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10824f5-6db2-4e20-bb5c-9c869df5ada8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:53.109094 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-c10824f5-6db2-4e20-bb5c-9c869df5ada8 None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:53.119639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-c10824f5-6db2-4e20-bb5c-9c869df5ada8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:53.119639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1476/2912] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:53.124182 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be14fe3-0444-4717-b515-badc701d16d9 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:53.134280 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be14fe3-0444-4717-b515-badc701d16d9 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:53.140544 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a76570-7042-43ae-b1a5-5b9b699e0308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:53.141164 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a76570-7042-43ae-b1a5-5b9b699e0308 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:53.141459 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a76570-7042-43ae-b1a5-5b9b699e0308 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:53.141718 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a76570-7042-43ae-b1a5-5b9b699e0308 admin admin] PATH_INFO: `/v3/domains` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:53.142413 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a76570-7042-43ae-b1a5-5b9b699e0308 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 02 21:37:53.142712 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a76570-7042-43ae-b1a5-5b9b699e0308 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:53.144319 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a76570-7042-43ae-b1a5-5b9b699e0308 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:53.158527 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1437/2913] 10.222.0.79 () {58 vars in 1153 bytes} [Fri Sep 2 21:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 02 21:37:53.162984 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10824f5-6db2-4e20-bb5c-9c869df5ada8 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:53.172918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10824f5-6db2-4e20-bb5c-9c869df5ada8 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:53.177788 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520d32b-f320-4c8b-a01e-f7a6e5824586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:53.178412 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520d32b-f320-4c8b-a01e-f7a6e5824586 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:53.178715 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520d32b-f320-4c8b-a01e-f7a6e5824586 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:53.179012 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520d32b-f320-4c8b-a01e-f7a6e5824586 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:53.179725 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520d32b-f320-4c8b-a01e-f7a6e5824586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:53.181528 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520d32b-f320-4c8b-a01e-f7a6e5824586 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:53.282115 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1477/2914] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:53 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:53.286402 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a76570-7042-43ae-b1a5-5b9b699e0308 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:53.297315 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a76570-7042-43ae-b1a5-5b9b699e0308 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:53.357862 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88bed1-5e97-4884-8a56-dea491f0d1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:53.358521 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88bed1-5e97-4884-8a56-dea491f0d1d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:53.359065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88bed1-5e97-4884-8a56-dea491f0d1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:53.359065 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88bed1-5e97-4884-8a56-dea491f0d1d7 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:53.359714 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88bed1-5e97-4884-8a56-dea491f0d1d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:53.361675 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88bed1-5e97-4884-8a56-dea491f0d1d7 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:53.492297 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1438/2915] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:53 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:53.496728 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520d32b-f320-4c8b-a01e-f7a6e5824586 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:53.507209 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520d32b-f320-4c8b-a01e-f7a6e5824586 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:53.512355 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6a489-9256-484f-a12c-99f5f5205869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:53.513006 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6a489-9256-484f-a12c-99f5f5205869 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:53.513295 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6a489-9256-484f-a12c-99f5f5205869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:53.513571 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6a489-9256-484f-a12c-99f5f5205869 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:53.514283 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6a489-9256-484f-a12c-99f5f5205869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:53.515864 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6a489-9256-484f-a12c-99f5f5205869 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:53.526440 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1478/2916] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:53.531223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88bed1-5e97-4884-8a56-dea491f0d1d7 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:53.541590 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88bed1-5e97-4884-8a56-dea491f0d1d7 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:53.547086 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f61f95-3381-4ced-b520-dbbaecf82fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:53.547685 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f61f95-3381-4ced-b520-dbbaecf82fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:53.547963 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f61f95-3381-4ced-b520-dbbaecf82fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:53.548237 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f61f95-3381-4ced-b520-dbbaecf82fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:53.548878 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f61f95-3381-4ced-b520-dbbaecf82fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:53.550535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f61f95-3381-4ced-b520-dbbaecf82fa0 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:53.562465 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1439/2917] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:53.566797 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6a489-9256-484f-a12c-99f5f5205869 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:53.578139 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6a489-9256-484f-a12c-99f5f5205869 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:53.582744 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2eb43-469e-4e63-af43-595b4c6c613f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:53.583394 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2eb43-469e-4e63-af43-595b4c6c613f admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:53.583678 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2eb43-469e-4e63-af43-595b4c6c613f admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:53.583961 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2eb43-469e-4e63-af43-595b4c6c613f admin admin] PATH_INFO: `/v3/projects/1022bbf458ba421e801d64f6aeec2ef2/users/fbe0f0728f604dec95e8c1a97d64de0f/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:53.600182 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2eb43-469e-4e63-af43-595b4c6c613f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1022bbf458ba421e801d64f6aeec2ef2, user_id=fbe0f0728f604dec95e8c1a97d64de0f, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:53.602875 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2eb43-469e-4e63-af43-595b4c6c613f admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:53.719701 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1479/2918] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:53 2022] PUT /identity/v3/projects/1022bbf458ba421e801d64f6aeec2ef2/users/fbe0f0728f604dec95e8c1a97d64de0f/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:53.730298 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cb473-9da9-4d48-bf25-dbb1aa2fef6c None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:53.732687 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cb473-9da9-4d48-bf25-dbb1aa2fef6c None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:53.732687 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cb473-9da9-4d48-bf25-dbb1aa2fef6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:53.759059 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-0e3cb473-9da9-4d48-bf25-dbb1aa2fef6c None None] MFA Rules not processed for user `fbe0f0728f604dec95e8c1a97d64de0f`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:53.760295 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-0e3cb473-9da9-4d48-bf25-dbb1aa2fef6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:53.781784 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:53.828964 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1440/2919] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:53.833527 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2eb43-469e-4e63-af43-595b4c6c613f admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:53.847245 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:53.907148 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2eb43-469e-4e63-af43-595b4c6c613f admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:53.911949 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df55d7-199b-40ff-b55a-5ca2c883e469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:53.912552 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df55d7-199b-40ff-b55a-5ca2c883e469 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:53.912848 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df55d7-199b-40ff-b55a-5ca2c883e469 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:53.913127 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df55d7-199b-40ff-b55a-5ca2c883e469 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:53.913778 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df55d7-199b-40ff-b55a-5ca2c883e469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:53.915722 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df55d7-199b-40ff-b55a-5ca2c883e469 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:53.991066 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1480/2920] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:53 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:53.995334 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cb473-9da9-4d48-bf25-dbb1aa2fef6c None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:54.006493 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cb473-9da9-4d48-bf25-dbb1aa2fef6c None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:54.065667 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7701b-ee37-4239-b53c-4947e88d2f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:54.066310 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7701b-ee37-4239-b53c-4947e88d2f1d admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:54.066591 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7701b-ee37-4239-b53c-4947e88d2f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:54.066863 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7701b-ee37-4239-b53c-4947e88d2f1d admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:54.067812 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7701b-ee37-4239-b53c-4947e88d2f1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:54.069732 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7701b-ee37-4239-b53c-4947e88d2f1d admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:54.155982 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1441/2921] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:53 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:54.160246 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df55d7-199b-40ff-b55a-5ca2c883e469 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:54.172745 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df55d7-199b-40ff-b55a-5ca2c883e469 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:54.177867 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811287d-3ae3-472b-ba77-eeb85fc81c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:54.178480 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811287d-3ae3-472b-ba77-eeb85fc81c15 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:54.178769 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811287d-3ae3-472b-ba77-eeb85fc81c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:54.179098 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811287d-3ae3-472b-ba77-eeb85fc81c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:54.179747 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811287d-3ae3-472b-ba77-eeb85fc81c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:54.181421 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811287d-3ae3-472b-ba77-eeb85fc81c15 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:54.193393 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1481/2922] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 02 21:37:54.197497 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7701b-ee37-4239-b53c-4947e88d2f1d admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:54.209098 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7701b-ee37-4239-b53c-4947e88d2f1d admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:54.214335 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ef5b1-ddca-43cf-982d-47e723c82807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:54.215276 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ef5b1-ddca-43cf-982d-47e723c82807 admin admin] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:54.215535 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ef5b1-ddca-43cf-982d-47e723c82807 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:54.215840 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ef5b1-ddca-43cf-982d-47e723c82807 admin admin] PATH_INFO: `/v3/roles` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:54.216490 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ef5b1-ddca-43cf-982d-47e723c82807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:54.218332 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ef5b1-ddca-43cf-982d-47e723c82807 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:54.228729 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1442/2923] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:54.233507 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811287d-3ae3-472b-ba77-eeb85fc81c15 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:54.243692 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811287d-3ae3-472b-ba77-eeb85fc81c15 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:54.249116 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df1ad9-351a-4b43-9480-20f2cfc87477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:54.249858 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df1ad9-351a-4b43-9480-20f2cfc87477 admin admin] REQUEST_METHOD: `PUT` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:54.250185 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df1ad9-351a-4b43-9480-20f2cfc87477 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:54.250418 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df1ad9-351a-4b43-9480-20f2cfc87477 admin admin] PATH_INFO: `/v3/projects/772d349b75df4b858eb91a8ad3666e30/users/0c68d96380164e3cb69c3e317bace971/roles/17200f478f4f42afb0a4d42b5da2183d` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:54.266936 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df1ad9-351a-4b43-9480-20f2cfc87477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=772d349b75df4b858eb91a8ad3666e30, user_id=0c68d96380164e3cb69c3e317bace971, role_id=17200f478f4f42afb0a4d42b5da2183d)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:54.269691 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df1ad9-351a-4b43-9480-20f2cfc87477 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:54.349168 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1482/2924] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:54 2022] PUT /identity/v3/projects/772d349b75df4b858eb91a8ad3666e30/users/0c68d96380164e3cb69c3e317bace971/roles/17200f478f4f42afb0a4d42b5da2183d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:54.361148 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb116de0-25d5-4613-a75d-f8bd26f5a0a4 None None] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:54.361441 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb116de0-25d5-4613-a75d-f8bd26f5a0a4 None None] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:54.361728 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb116de0-25d5-4613-a75d-f8bd26f5a0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:54.394181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.auth.core [None req-bb116de0-25d5-4613-a75d-f8bd26f5a0a4 None None] MFA Rules not processed for user `0c68d96380164e3cb69c3e317bace971`. Rule list: `[]` (Enabled: `True`). {{(pid=82124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:54.395395 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-bb116de0-25d5-4613-a75d-f8bd26f5a0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:54.462089 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1443/2925] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:54.467656 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df1ad9-351a-4b43-9480-20f2cfc87477 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:54.531396 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df1ad9-351a-4b43-9480-20f2cfc87477 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:54.536356 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281efc3b-d0f3-4e9a-b094-e16a70a7dc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:54.536975 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281efc3b-d0f3-4e9a-b094-e16a70a7dc12 admin admin] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:54.537254 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281efc3b-d0f3-4e9a-b094-e16a70a7dc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:54.537535 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281efc3b-d0f3-4e9a-b094-e16a70a7dc12 admin admin] PATH_INFO: `/v3/projects` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:54.538399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281efc3b-d0f3-4e9a-b094-e16a70a7dc12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:54.540363 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281efc3b-d0f3-4e9a-b094-e16a70a7dc12 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:54.733718 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1483/2926] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Sep 2 21:37:54 2022] POST /identity/v3/projects => generated 379 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:54.738019 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb116de0-25d5-4613-a75d-f8bd26f5a0a4 None None] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:54.749875 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb116de0-25d5-4613-a75d-f8bd26f5a0a4 None None] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:54.777766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:54.813380 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a912d29-451e-4456-873c-815ad004b5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:54.814020 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a912d29-451e-4456-873c-815ad004b5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:54.814302 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a912d29-451e-4456-873c-815ad004b5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:54.814576 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a912d29-451e-4456-873c-815ad004b5f2 admin admin] PATH_INFO: `/v3/users` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:54.815223 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a912d29-451e-4456-873c-815ad004b5f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:54.817134 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a912d29-451e-4456-873c-815ad004b5f2 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:54.943232 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1444/2927] 10.222.0.79 () {60 vars in 1144 bytes} [Fri Sep 2 21:37:54 2022] POST /identity/v3/users => generated 296 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 02 21:37:54.947399 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281efc3b-d0f3-4e9a-b094-e16a70a7dc12 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:54.960409 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281efc3b-d0f3-4e9a-b094-e16a70a7dc12 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:54.965601 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b78733-8ccf-481e-a177-6844ae10f2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:54.966261 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b78733-8ccf-481e-a177-6844ae10f2db admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:54.966547 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b78733-8ccf-481e-a177-6844ae10f2db admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:54.966825 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b78733-8ccf-481e-a177-6844ae10f2db admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:54.967474 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b78733-8ccf-481e-a177-6844ae10f2db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:54.969104 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b78733-8ccf-481e-a177-6844ae10f2db admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:54.981442 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1484/2928] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:54.986181 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a912d29-451e-4456-873c-815ad004b5f2 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:54.997497 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a912d29-451e-4456-873c-815ad004b5f2 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:55.002410 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c3823-ac09-4f32-bd71-685ca0210c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:55.003083 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c3823-ac09-4f32-bd71-685ca0210c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:55.003370 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c3823-ac09-4f32-bd71-685ca0210c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:55.003654 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c3823-ac09-4f32-bd71-685ca0210c76 admin admin] PATH_INFO: `/v3/projects/fa3f3ba0301f4c2f8bb47721f8f63901/users/5c53a44c60ea47dbb6f717f05a433245/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:55.022923 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c3823-ac09-4f32-bd71-685ca0210c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa3f3ba0301f4c2f8bb47721f8f63901, user_id=5c53a44c60ea47dbb6f717f05a433245, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:55.025764 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c3823-ac09-4f32-bd71-685ca0210c76 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:55.131811 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1445/2929] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:54 2022] PUT /identity/v3/projects/fa3f3ba0301f4c2f8bb47721f8f63901/users/5c53a44c60ea47dbb6f717f05a433245/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:55.136909 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b78733-8ccf-481e-a177-6844ae10f2db admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:55.149001 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b78733-8ccf-481e-a177-6844ae10f2db admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:55.191192 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:37:55.221408 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5570f1b-1b13-47bf-a6b4-41e8611e1b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:55.222058 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5570f1b-1b13-47bf-a6b4-41e8611e1b62 admin admin] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:55.222334 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5570f1b-1b13-47bf-a6b4-41e8611e1b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:55.222608 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5570f1b-1b13-47bf-a6b4-41e8611e1b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:55.223257 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5570f1b-1b13-47bf-a6b4-41e8611e1b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:55.224963 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5570f1b-1b13-47bf-a6b4-41e8611e1b62 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:55.236939 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1485/2930] 10.222.0.79 () {58 vars in 1122 bytes} [Fri Sep 2 21:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 02 21:37:55.242186 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c3823-ac09-4f32-bd71-685ca0210c76 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:55.254000 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c3823-ac09-4f32-bd71-685ca0210c76 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:55.259401 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ad734-52b5-4262-8e04-a40139708404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:55.260088 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ad734-52b5-4262-8e04-a40139708404 admin admin] REQUEST_METHOD: `PUT` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:55.260367 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ad734-52b5-4262-8e04-a40139708404 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:55.260643 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ad734-52b5-4262-8e04-a40139708404 admin admin] PATH_INFO: `/v3/projects/fa3f3ba0301f4c2f8bb47721f8f63901/users/5c53a44c60ea47dbb6f717f05a433245/roles/32e6a7f83b444d1ca9e5891a2b175f9a` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:55.263294 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ad734-52b5-4262-8e04-a40139708404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa3f3ba0301f4c2f8bb47721f8f63901, user_id=5c53a44c60ea47dbb6f717f05a433245, role_id=32e6a7f83b444d1ca9e5891a2b175f9a)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:55.265574 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ad734-52b5-4262-8e04-a40139708404 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:55.276684 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1446/2931] 10.222.0.79 () {60 vars in 1483 bytes} [Fri Sep 2 21:37:55 2022] PUT /identity/v3/projects/fa3f3ba0301f4c2f8bb47721f8f63901/users/5c53a44c60ea47dbb6f717f05a433245/roles/32e6a7f83b444d1ca9e5891a2b175f9a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:37:55.287717 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b988d5-4bba-4e84-9f1b-831c5baaa542 None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:55.288009 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b988d5-4bba-4e84-9f1b-831c5baaa542 None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:55.288288 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b988d5-4bba-4e84-9f1b-831c5baaa542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:55.320935 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-a9b988d5-4bba-4e84-9f1b-831c5baaa542 None None] MFA Rules not processed for user `5c53a44c60ea47dbb6f717f05a433245`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:37:55.322196 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-a9b988d5-4bba-4e84-9f1b-831c5baaa542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:55.404940 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1486/2932] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:37:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:37:55.418079 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ad734-52b5-4262-8e04-a40139708404 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:55.420607 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-958ad734-52b5-4262-8e04-a40139708404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:55.485029 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ad734-52b5-4262-8e04-a40139708404 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:55.489006 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e7c1c-f07a-4bee-891c-2dbc46297855 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:55.489683 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e7c1c-f07a-4bee-891c-2dbc46297855 service cinder] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:55.490105 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e7c1c-f07a-4bee-891c-2dbc46297855 service cinder] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:55.490510 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e7c1c-f07a-4bee-891c-2dbc46297855 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:55.501947 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e7c1c-f07a-4bee-891c-2dbc46297855 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:55.503459 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e7c1c-f07a-4bee-891c-2dbc46297855 service cinder] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:55.515033 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1447/2933] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:37:55.665310 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b988d5-4bba-4e84-9f1b-831c5baaa542 None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:37:55.666712 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-a9b988d5-4bba-4e84-9f1b-831c5baaa542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:37:55.679749 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b988d5-4bba-4e84-9f1b-831c5baaa542 None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:37:55.683908 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae775a2-1e5e-4a07-ab32-02d3f364ddf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fc07c138a414936b2bb95dd3ded9ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:37:55.684523 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae775a2-1e5e-4a07-ab32-02d3f364ddf9 service cinder] REQUEST_METHOD: `GET` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:37:55.684809 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae775a2-1e5e-4a07-ab32-02d3f364ddf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:37:55.685081 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae775a2-1e5e-4a07-ab32-02d3f364ddf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:37:55.747297 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae775a2-1e5e-4a07-ab32-02d3f364ddf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:37:55.748670 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae775a2-1e5e-4a07-ab32-02d3f364ddf9 service cinder] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:37:55.758184 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1487/2934] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:37:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 02 21:38:00.086320 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e7c1c-f07a-4bee-891c-2dbc46297855 service cinder] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:38:00.152740 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e7c1c-f07a-4bee-891c-2dbc46297855 service cinder] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:38:00.158042 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5b083-6de1-4cba-8305-6bfb82eb7573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:38:00.158769 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5b083-6de1-4cba-8305-6bfb82eb7573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:38:00.159049 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5b083-6de1-4cba-8305-6bfb82eb7573 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:38:00.159327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5b083-6de1-4cba-8305-6bfb82eb7573 admin admin] PATH_INFO: `/v3/users/fbe0f0728f604dec95e8c1a97d64de0f` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:38:00.160469 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5b083-6de1-4cba-8305-6bfb82eb7573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe0f0728f604dec95e8c1a97d64de0f)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:38:00.162468 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5b083-6de1-4cba-8305-6bfb82eb7573 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:38:00.187260 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:00.363122 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-6ca5b083-6de1-4cba-8305-6bfb82eb7573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe0f0728f604dec95e8c1a97d64de0f'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:00.363766 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-6ca5b083-6de1-4cba-8305-6bfb82eb7573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe0f0728f604dec95e8c1a97d64de0f'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:00.370778 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-6ca5b083-6de1-4cba-8305-6bfb82eb7573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe0f0728f604dec95e8c1a97d64de0f'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:00.383823 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-6ca5b083-6de1-4cba-8305-6bfb82eb7573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe0f0728f604dec95e8c1a97d64de0f'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:00.384519 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-6ca5b083-6de1-4cba-8305-6bfb82eb7573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe0f0728f604dec95e8c1a97d64de0f'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:00.451913 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1448/2935] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:38:00 2022] DELETE /identity/v3/users/fbe0f0728f604dec95e8c1a97d64de0f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:38:00.456362 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589eda3a-85c5-4942-8dfc-dc9bc23b816b None None] REQUEST_METHOD: `POST` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:38:00.456900 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589eda3a-85c5-4942-8dfc-dc9bc23b816b None None] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:38:00.457080 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589eda3a-85c5-4942-8dfc-dc9bc23b816b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:38:00.478201 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.auth.core [None req-589eda3a-85c5-4942-8dfc-dc9bc23b816b None None] MFA Rules not processed for user `ce385e879bed47f191e967e0c64d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=82125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 02 21:38:00.479398 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-589eda3a-85c5-4942-8dfc-dc9bc23b816b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:38:00.529137 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=100 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:00.540256 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1488/2936] 10.222.0.79 () {58 vars in 958 bytes} [Fri Sep 2 21:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 02 21:38:00.550933 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5b083-6de1-4cba-8305-6bfb82eb7573 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:38:00.552362 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-6ca5b083-6de1-4cba-8305-6bfb82eb7573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:38:00.615841 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5b083-6de1-4cba-8305-6bfb82eb7573 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:38:00.619607 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf5169-ac5a-489f-a391-21ee4faabf64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefaf6998acc4434aab62b9625bd25fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:38:00.620214 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf5169-ac5a-489f-a391-21ee4faabf64 service neutron] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:38:00.620499 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf5169-ac5a-489f-a391-21ee4faabf64 service neutron] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:38:00.620768 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf5169-ac5a-489f-a391-21ee4faabf64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:38:00.630649 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf5169-ac5a-489f-a391-21ee4faabf64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:38:00.632058 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf5169-ac5a-489f-a391-21ee4faabf64 service neutron] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:38:00.641744 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1449/2937] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:38:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:38:01.124970 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589eda3a-85c5-4942-8dfc-dc9bc23b816b None None] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:38:01.128144 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-589eda3a-85c5-4942-8dfc-dc9bc23b816b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:38:01.140092 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589eda3a-85c5-4942-8dfc-dc9bc23b816b None None] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:38:01.144673 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46812f6-80f9-458e-8c3b-a61b5dd0468f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:38:01.145519 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46812f6-80f9-458e-8c3b-a61b5dd0468f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:38:01.145832 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46812f6-80f9-458e-8c3b-a61b5dd0468f admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:38:01.146120 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46812f6-80f9-458e-8c3b-a61b5dd0468f admin admin] PATH_INFO: `/v3/projects/1022bbf458ba421e801d64f6aeec2ef2` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:38:01.147367 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46812f6-80f9-458e-8c3b-a61b5dd0468f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1022bbf458ba421e801d64f6aeec2ef2)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:38:01.149639 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46812f6-80f9-458e-8c3b-a61b5dd0468f admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:38:01.280913 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-f46812f6-80f9-458e-8c3b-a61b5dd0468f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1022bbf458ba421e801d64f6aeec2ef2', 'request_id': 'req-f46812f6-80f9-458e-8c3b-a61b5dd0468f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:01.287497 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-f46812f6-80f9-458e-8c3b-a61b5dd0468f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1022bbf458ba421e801d64f6aeec2ef2', 'request_id': 'req-f46812f6-80f9-458e-8c3b-a61b5dd0468f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:01.296021 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-f46812f6-80f9-458e-8c3b-a61b5dd0468f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1022bbf458ba421e801d64f6aeec2ef2', 'request_id': 'req-f46812f6-80f9-458e-8c3b-a61b5dd0468f'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:01.363631 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-f46812f6-80f9-458e-8c3b-a61b5dd0468f admin admin] The token cache is being invalidate because project 1022bbf458ba421e801d64f6aeec2ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:38:01.363910 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-f46812f6-80f9-458e-8c3b-a61b5dd0468f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:01.364526 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-f46812f6-80f9-458e-8c3b-a61b5dd0468f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:01.366152 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1489/2938] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:38:01 2022] DELETE /identity/v3/projects/1022bbf458ba421e801d64f6aeec2ef2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:38:01.370337 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf5169-ac5a-489f-a391-21ee4faabf64 service neutron] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:38:01.380621 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf5169-ac5a-489f-a391-21ee4faabf64 service neutron] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:38:01.438017 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af17fd0-490a-4602-a02d-c90efad2ea83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:38:01.438653 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af17fd0-490a-4602-a02d-c90efad2ea83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:38:01.438935 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af17fd0-490a-4602-a02d-c90efad2ea83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:38:01.439212 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af17fd0-490a-4602-a02d-c90efad2ea83 admin admin] PATH_INFO: `/v3/users/0c68d96380164e3cb69c3e317bace971` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:38:01.440347 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af17fd0-490a-4602-a02d-c90efad2ea83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c68d96380164e3cb69c3e317bace971)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:38:01.442327 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af17fd0-490a-4602-a02d-c90efad2ea83 admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:38:01.635796 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:01.637544 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-3af17fd0-490a-4602-a02d-c90efad2ea83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c68d96380164e3cb69c3e317bace971'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:01.638284 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-3af17fd0-490a-4602-a02d-c90efad2ea83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c68d96380164e3cb69c3e317bace971'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:01.646443 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-3af17fd0-490a-4602-a02d-c90efad2ea83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c68d96380164e3cb69c3e317bace971'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:01.662466 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-3af17fd0-490a-4602-a02d-c90efad2ea83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c68d96380164e3cb69c3e317bace971'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:01.663205 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-3af17fd0-490a-4602-a02d-c90efad2ea83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c68d96380164e3cb69c3e317bace971'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:01.759486 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1450/2939] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:38:01 2022] DELETE /identity/v3/users/0c68d96380164e3cb69c3e317bace971 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:38:02.248918 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46812f6-80f9-458e-8c3b-a61b5dd0468f admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:38:02.252325 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-f46812f6-80f9-458e-8c3b-a61b5dd0468f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:38:02.270441 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46812f6-80f9-458e-8c3b-a61b5dd0468f admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:38:02.331232 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd43e6-6cf1-4d22-a66a-c11b3d95f4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:38:02.338391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd43e6-6cf1-4d22-a66a-c11b3d95f4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:38:02.338391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd43e6-6cf1-4d22-a66a-c11b3d95f4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:38:02.338391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd43e6-6cf1-4d22-a66a-c11b3d95f4b8 admin admin] PATH_INFO: `/v3/projects/772d349b75df4b858eb91a8ad3666e30` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:38:02.338391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd43e6-6cf1-4d22-a66a-c11b3d95f4b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=772d349b75df4b858eb91a8ad3666e30)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:38:02.338391 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd43e6-6cf1-4d22-a66a-c11b3d95f4b8 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:38:02.520507 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6fdd43e6-6cf1-4d22-a66a-c11b3d95f4b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '772d349b75df4b858eb91a8ad3666e30', 'request_id': 'req-6fdd43e6-6cf1-4d22-a66a-c11b3d95f4b8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:02.526706 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6fdd43e6-6cf1-4d22-a66a-c11b3d95f4b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '772d349b75df4b858eb91a8ad3666e30', 'request_id': 'req-6fdd43e6-6cf1-4d22-a66a-c11b3d95f4b8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:02.532682 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6fdd43e6-6cf1-4d22-a66a-c11b3d95f4b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '772d349b75df4b858eb91a8ad3666e30', 'request_id': 'req-6fdd43e6-6cf1-4d22-a66a-c11b3d95f4b8'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:02.642544 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6fdd43e6-6cf1-4d22-a66a-c11b3d95f4b8 admin admin] The token cache is being invalidate because project 772d349b75df4b858eb91a8ad3666e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:38:02.642840 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6fdd43e6-6cf1-4d22-a66a-c11b3d95f4b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:02.643503 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-6fdd43e6-6cf1-4d22-a66a-c11b3d95f4b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:02.644995 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1490/2940] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:38:02 2022] DELETE /identity/v3/projects/772d349b75df4b858eb91a8ad3666e30 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 02 21:38:02.650248 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af17fd0-490a-4602-a02d-c90efad2ea83 admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:38:02.651840 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-3af17fd0-490a-4602-a02d-c90efad2ea83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:38:02.665144 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af17fd0-490a-4602-a02d-c90efad2ea83 admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:38:02.726775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269212e-ffba-4f54-a2b5-08631d7bf57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:38:02.726775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269212e-ffba-4f54-a2b5-08631d7bf57f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:38:02.726775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269212e-ffba-4f54-a2b5-08631d7bf57f admin admin] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:38:02.726775 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269212e-ffba-4f54-a2b5-08631d7bf57f admin admin] PATH_INFO: `/v3/users/5c53a44c60ea47dbb6f717f05a433245` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:38:02.727492 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269212e-ffba-4f54-a2b5-08631d7bf57f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c53a44c60ea47dbb6f717f05a433245)` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:38:02.729469 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269212e-ffba-4f54-a2b5-08631d7bf57f admin admin] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:38:02.972043 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-1269212e-ffba-4f54-a2b5-08631d7bf57f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c53a44c60ea47dbb6f717f05a433245'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:02.972703 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-1269212e-ffba-4f54-a2b5-08631d7bf57f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c53a44c60ea47dbb6f717f05a433245'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:02.979851 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-1269212e-ffba-4f54-a2b5-08631d7bf57f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c53a44c60ea47dbb6f717f05a433245'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:02.992476 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-1269212e-ffba-4f54-a2b5-08631d7bf57f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c53a44c60ea47dbb6f717f05a433245'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:02.993198 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.notifications [None req-1269212e-ffba-4f54-a2b5-08631d7bf57f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c53a44c60ea47dbb6f717f05a433245'} {{(pid=82124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:03.077049 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1451/2941] 10.222.0.79 () {58 vars in 1224 bytes} [Fri Sep 2 21:38:02 2022] DELETE /identity/v3/users/5c53a44c60ea47dbb6f717f05a433245 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:38:03.511164 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd43e6-6cf1-4d22-a66a-c11b3d95f4b8 admin admin] Authenticating user token {{(pid=82125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:38:03.512761 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.fernet_utils [None req-6fdd43e6-6cf1-4d22-a66a-c11b3d95f4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:38:03.527869 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd43e6-6cf1-4d22-a66a-c11b3d95f4b8 admin admin] Validating token access rules against request {{(pid=82125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:38:03.535855 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:03.598432 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46818e5-49e8-484a-8a34-5e438f31b598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce385e879bed47f191e967e0c64d0d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c04c8d4bc7dc450a92b56e01849b9dc9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:38:03.600202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46818e5-49e8-484a-8a34-5e438f31b598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:38:03.600202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46818e5-49e8-484a-8a34-5e438f31b598 admin admin] SCRIPT_NAME: `/identity` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:38:03.600202 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46818e5-49e8-484a-8a34-5e438f31b598 admin admin] PATH_INFO: `/v3/projects/fa3f3ba0301f4c2f8bb47721f8f63901` {{(pid=82125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:38:03.601884 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46818e5-49e8-484a-8a34-5e438f31b598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa3f3ba0301f4c2f8bb47721f8f63901)` {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:38:03.605449 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46818e5-49e8-484a-8a34-5e438f31b598 admin admin] RBAC: Authorization granted {{(pid=82125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:38:03.729626 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e46818e5-49e8-484a-8a34-5e438f31b598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa3f3ba0301f4c2f8bb47721f8f63901', 'request_id': 'req-e46818e5-49e8-484a-8a34-5e438f31b598'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:03.735893 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e46818e5-49e8-484a-8a34-5e438f31b598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa3f3ba0301f4c2f8bb47721f8f63901', 'request_id': 'req-e46818e5-49e8-484a-8a34-5e438f31b598'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:03.741795 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e46818e5-49e8-484a-8a34-5e438f31b598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa3f3ba0301f4c2f8bb47721f8f63901', 'request_id': 'req-e46818e5-49e8-484a-8a34-5e438f31b598'} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:03.838720 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e46818e5-49e8-484a-8a34-5e438f31b598 admin admin] The token cache is being invalidate because project fa3f3ba0301f4c2f8bb47721f8f63901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 02 21:38:03.838955 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e46818e5-49e8-484a-8a34-5e438f31b598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:03.839820 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG keystone.notifications [None req-e46818e5-49e8-484a-8a34-5e438f31b598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 02 21:38:03.841313 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: [pid: 82125|app: 0|req: 1491/2942] 10.222.0.79 () {58 vars in 1233 bytes} [Fri Sep 2 21:38:03 2022] DELETE /identity/v3/projects/fa3f3ba0301f4c2f8bb47721f8f63901 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 02 21:38:13.073203 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=66,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:38:13.845221 dv-cinder-852209-11-iscsi devstack@keystone.service[82125]: DEBUG dbcounter [-] [82125] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:41:51.468416 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269212e-ffba-4f54-a2b5-08631d7bf57f admin admin] Authenticating user token {{(pid=82124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 02 21:41:51.469871 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-1269212e-ffba-4f54-a2b5-08631d7bf57f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:41:51.616839 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269212e-ffba-4f54-a2b5-08631d7bf57f admin admin] Validating token access rules against request {{(pid=82124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 02 21:41:51.677379 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae01868-f549-4f93-93e0-d0a49a7a00cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0f9604ee2e43b4967cbdc779e63e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61c5f56764934c4a90ad38357b46f397', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 02 21:41:51.678062 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae01868-f549-4f93-93e0-d0a49a7a00cc service placement] REQUEST_METHOD: `GET` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 02 21:41:51.678579 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae01868-f549-4f93-93e0-d0a49a7a00cc service placement] SCRIPT_NAME: `/identity` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 02 21:41:51.678579 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae01868-f549-4f93-93e0-d0a49a7a00cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 02 21:41:51.680302 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.fernet_utils [None req-8ae01868-f549-4f93-93e0-d0a49a7a00cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 02 21:41:51.692844 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae01868-f549-4f93-93e0-d0a49a7a00cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 02 21:41:51.694528 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae01868-f549-4f93-93e0-d0a49a7a00cc service placement] RBAC: Authorization granted {{(pid=82124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 02 21:41:51.705716 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: [pid: 82124|app: 0|req: 1452/2943] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Sep 2 21:41:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 02 21:42:01.700883 dv-cinder-852209-11-iscsi devstack@keystone.service[82124]: DEBUG dbcounter [-] [82124] Writing DB stats keystone:SELECT=89 {{(pid=82124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}